Einecke, Nils (Honda Research Institute Europe), Mühlig, Manuel (CoR-Lab Bielefeld, Honda Research Institute Europe), Schmuedderich, Jens (Honda Research Institute Europe), Gienger, Michael (Honda Research Institute Europe)

"Bring It to Me" - Generation of Behavior-Relevant Scene Elements for Interactive Robot Scenarios

Scheduled for presentation during the Regular Sessions "Computer Vision for Robotics and Automation II" (WeA214), Wednesday, May 11, 2011, 10:35−10:50, Room 5J

2011 IEEE International Conference on Robotics and Automation, May 9-13, 2011, Shanghai International Conference Center, Shanghai, China

This information is tentative and subject to change. Compiled on July 5, 2020

Abstract

Humanoid robots are intended to act and interact in dynamically changing environments in the presence of humans. Current robotic systems are usually able to move in dynamically changing environments because of an inbuilt depth and obstacle sensing. However, for acting in their environment the internal representation of such systems is usually constructed by hand and known in advance. In contrast, this paper presents a system that dynamically constructs its internal scene representation using a model-based vision approach. This enables our system to approach and grasp objects in an previously unknown scene. We combine standard stereo with model-based image fitting techniques for a real-time estimation of the position and orientation of objects. The model-based image processing allows for an easy transfer to the internal, dynamic scene representation. For movement generation we use a task-level whole-body control approach that is coupled with a movement optimization scheme. Furthermore, we present a novel method that constrains the robot to keep certain objects in the FOV while moving. We demonstrate the successful interplay between model-based vision, dynamic scene representation, and movement generation by means of some interactive reaching and grasping tasks.