December 6-8, 2010, Sheraton Nashville Downtown, Nashville, TN

Humanoids 2010 Paper Abstract


Paper    WP-II .2

Arumbakkam, Arjun (Honda Research Institute USA, Inc.), Yoshikawa, Taizo (Honda Research Institute USA, Inc.), Dariush, Behzad (Honda Research Institute USA), Fujimura, Kikuo (Honda Research Institute)

A Multi-Modal Architechture for Human-Robot Communication

Scheduled for presentation during the Regular "Interaction" (   WP-II ), Wednesday, December 8, 2010, 15:50−16:10, Ballroom 4

2010 IEEE-RAS International Conference on Humanoid Robots, December 6-8, 2010, Sheraton Nashville Downtown, Nashville, TN, USA

This information is tentative and subject to change. Compiled on March 29, 2015

Keywords Software Platform and Architecture, Human-Humanoid Interaction, Kinematics, Dynamics, and Control


In this paper we present a human-friendly control framework and an associated system architecture for performing compliant trajectory tracking of multimodal human gesture information on a position controlled humanoid robot in realtime. The contribution of this paper includes a system architecture and control methodology that enables real-time compliant control of humanoid robots from demonstrated human motion and speech inputs. The human motion consists of the body and head pose. The human body motion, represented by a set of Cartesian space motion descriptors, is captured using a single depth camera marker-less vision processing module. The human head pose, represented by three degrees of freedom, is estimated and tracked using a single CCD camera. The architecture also enables fine motion control through human speech commands processed by a dedicated speech processing system. Motion description from the three input modes are synchronized and retargeted to the joint space coordinates of the humanoid robot in real-time. The retargeted motion adheres to the robot's kinematic constraints and represents the reference joint motion that is subsequently executed by a model based compliant control framework through a torque to position transformation system. The compliant and low gain tracking performed by this framework renders the system physically safe and therefore friendly to humans interacting with the robot. Experiments were performed on the Honda humanoid robot and the results are presented here.



Technical Content © IEEE Robotics & Automation Society

This site is protected by copyright and trademark laws under US and International law.
All rights reserved. © 2002-2015 PaperCept, Inc.
Page generated 2015-03-29  19:15:11 PST  Terms of use