WSHP - Code for CVPR'18 spotlight "Weakly and Semi Supervised Human Body Part Parsing via Pose-Guided Knowledge Transfer"

  •        5

Check out our demo video here. Checkout parsing_network for training\testing\demo code of our parsing network.



Related Projects

CrowdNav - [ICRA19] Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learning

  •    Python

This repository contains the codes for our ICRA 2019 paper. For more details, please refer to the paper Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learning. Mobility in an effective and socially-compliant manner is an essential yet challenging task for robots operating in crowded spaces. Recent works have shown the power of deep reinforcement learning techniques to learn socially cooperative policies. However, their cooperation ability deteriorates as the crowd grows since they typically relax the problem as a one-way Human-Robot interaction problem. In this work, we want to go beyond first-order Human-Robot interaction and more explicitly model Crowd-Robot Interaction (CRI). We propose to (i) rethink pairwise interactions with a self-attention mechanism, and (ii) jointly model Human-Robot as well as Human-Human interactions in the deep reinforcement learning framework. Our model captures the Human-Human interactions occurring in dense crowds that indirectly affects the robot's anticipation capability. Our proposed attentive pooling mechanism learns the collective importance of neighboring humans with respect to their future states. Various experiments demonstrate that our model can anticipate human dynamics and navigate in crowds with time efficiency, outperforming state-of-the-art methods.

sketch - A Common Lisp framework for the creation of electronic art, visual design, game prototyping, game making, computer graphics, exploration of human-computer interaction, and more

  •    Common

Sketch is a Common Lisp environment for the creation of electronic art, visual design, game prototyping, game making, computer graphics, exploration of human-computer interaction and more. It is inspired by Processing Language and shares some of the API. To make Sketch run correctly, though, a few requirements must be met.

deepgaze - Computer Vision library for human-computer interaction

  •    Python

Update 04/06/2017 Article "Head pose estimation in the wild using Convolutional Neural Networks and adaptive gradient methods" have been accepted for publication in Pattern Recogntion (Elsevier). The Deepgaze CNN head pose estimator module is based on this work. Update 22/03/2017 Fixed a bug in and almost completed a more robust version of the CNN head pose estimator.

OpenCV - Open Source Computer Vision

  •    C++

OpenCV (Open Source Computer Vision) is a library of programming functions for real time computer vision. The library has more than 500 optimized algorithms. It is used to interactive art, to mine inspection, stitching maps on the web on through advanced robotics.

openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, and hands estimation

  •    C++

OpenPose represents the first real-time multi-person system to jointly detect human body, hand, and facial keypoints (in total 135 keypoints) on single images. For further details, check all released features and release notes.

CatPapers - Cool vision, learning, and graphics papers on Cats!

  •    HTML

As reported by Cisco, 90% of net traffic will be visual, and indeed, most of the visual data are cat photos and videos. Thus, understanding, modeling and synthesizing our feline friends becomes a more and more important research problem these days, especially for our cat lovers. Cat Paper Collection is an academic paper collection that includes computer graphics, computer vision, machine learning and human-computer interaction papers that produce experimental results related to cats. If you want to add/remove a paper, please send an email to Jun-Yan Zhu (junyanz at berkeley dot edu).

Pure Interaction

  •    Java

Pure Interaction is a formal model on how to encode human-computer interaction. This project will implement the Pure Interaction Corba Interfaces and create an implementation for C++ and X-Windows called the FOH-framework.

inspect.lua - Human-readable representation of Lua tables

  •    Lua

This library transforms any Lua value into a human-readable representation. It is especially useful for debugging errors in tables. The objective here is human understanding (i.e. for debugging), not serialization or compactness.

flightmare - An Open Flexible Quadrotor Simulator

  •    C++

Flightmare is a flexible modular quadrotor simulator. Flightmare is composed of two main components: a configurable rendering engine built on Unity and a flexible physics engine for dynamics simulation. Those two components are totally decoupled and can run independently from each other. Flightmare comes with several desirable features: (i) a large multi-modal sensor suite, including an interface to extract the 3D point-cloud of the scene; (ii) an API for reinforcement learning which can simulate hundreds of quadrotors in parallel; and (iii) an integration with a virtual-reality headset for interaction with the simulated environment. Flightmare can be used for various applications, including path-planning, reinforcement learning, visual-inertial odometry, deep learning, human-robot interaction, etc. Installation instructions can be found in our Wiki.

Realtime_Multi-Person_Pose_Estimation - Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)

  •    Jupyter

By Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh. Code repo for winning 2016 MSCOCO Keypoints Challenge, 2016 ECCV Best Demo Award, and 2017 CVPR Oral paper.

yarp - YARP - Yet Another Robot Platform

  •    C++

YARP is a library and toolkit for communication and device interfaces, used on everything from humanoids to embedded devices. Regular YARP builds use the ACE library. On Linux and macOS, YARP can be compiled without ACE by adding -DSKIP_ACE=TRUE when running cmake.

Benetech Human Rights Program Util Lib

  •    D

Benetech Human Rights Program Utility Library: Collection of utilities used by the Benetech Human Rights programming for processing human rights data in preparation for statistical analysis. Library handles DSV files, name canonicalization, binarray, et

WaypointHR - Human Resource Database

  •    PHP

WaypointHR is a human resource database, providing organizations with a free, immediate and flexible Human Resource Management System (HRIS). It helps to store Employee personal details and emergency contact information, absence history, Employment, contract, job and salary details, Tracking employee performance and much more.

OrangeHRM - Human Resource Management Software

  •    PHP

OrangeHRM offers a complete suite of human capital management / human resource management tools. This includes employee information management, employee absence management / employee holiday management or employee leave management, recruitment management, employee performance evaluation and many other HR management tools.

Human Interval - Human readable time distances for javascript

  •    Javascript

Human readable interval parser for Javascript. Human Interval supports numbers up to ten being written out in English. If you want to extend it, you can do so by adding more keys to the language map. Alternatively you could add support for alternative languages.

DensePose - A real-time approach for mapping all human pixels of 2D RGB images to a 3D surface-based model of the body

  •    Jupyter

Dense human pose estimation aims at mapping all human pixels of an RGB image to the 3D surface of the human body. DensePose-RCNN is implemented in the Detectron framework and is powered by Caffe2. In this repository, we provide the code to train and evaluate DensePose-RCNN. We also provide notebooks to visualize the collected DensePose-COCO dataset and show the correspondences to the SMPL model.

trt_pose - Real-time pose estimation accelerated with NVIDIA TensorRT

  •    Python

Pre-trained models for human pose estimation capable of running in real time on Jetson Nano. This makes it easy to detect features like left_eye, left_elbow, right_ankle, etc. Training scripts to train on any keypoint task data in MSCOCO format. This means you can experiment with training trt_pose for keypoint detection tasks other than human pose.

Bree - Best job scheduler for Node.js and JavaScript with cron, dates, ms, later, and human-friendly support

  •    Javascript

Bree is the best job scheduler for Node.js and JavaScript with cron, dates, ms, later, and human-friendly support. It uses worker threads (Node.js) and web workers (browsers) to spawn sandboxed processes, and supports async/await, retries, throttling, concurrency, and cancelable jobs with graceful shutdown.

Human-Robot Engagement

  •    Java

ROS repository for human-robot engagement package, developed at Worcester Polytechnic Institute. Currently contains ROS stack for recognizing and generating connection events. This work is supported by the NSF awards IIS-0811942 and IIS-1012083.

We have large collection of open source products. Follow the tags from Tag Cloud >>

Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.