ICRA 2012 Paper Abstract

Close

Paper TuD09.5

Aldoma, Aitor (Vienna University of Technology), Tombari, Federico (University of Bologna), Vincze, Markus (Vienna University of Technology)

Supervised Learning of Hidden and Non-Hidden 0-Order Affordances and Detection in Real Scenes

Scheduled for presentation during the Regular Session "Sensing for manipulation" (TuD09), Tuesday, May 15, 2012, 17:30−17:45, Meeting Room 9 (Sa)

2012 IEEE International Conference on Robotics and Automation, May 14-18, 2012, RiverCentre, Saint Paul, Minnesota, USA

This information is tentative and subject to change. Compiled on December 11, 2017

Keywords Computer Vision for Robotics and Automation, Recognition, Visual Learning

Abstract

The ability to perceive possible interactions with the environment is a key capability of task-guided robotic agents. An important subset of possible interactions depends solely on the objects of interest and their position and orientation in the scene. We call these object-based interactions $0$-order affordances and divide them among non-hidden and hidden whether the current configuration of an object in the scene renders its affordance directly usable or not. Conversely to other works, we propose that detecting affordances that are not directly perceivable increase the usefulness of robotic agents with manipulation capabilities, so that by appropriate manipulation they can modify the object configuration until the seeked affordance becomes available. In this paper we show how $0$-order affordances depending on the geometry of the objects and their pose can be learned using a supervised learning strategy on 3D mesh representations of the objects allowing the use of the whole object geometry. Moreover, we show how the learned affordances can be detected in real scenes obtained with a low-cost depth sensor like the Microsoft Kinect through object recognition and 6D0F pose estimation and present results for both learning on meshes and detection on real scenes to demonstrate the practical application of the presented approach.

 

 

Technical Content © IEEE Robotics & Automation Society

This site is protected by copyright and trademark laws under US and International law.
All rights reserved. © 2002-2017 PaperCept, Inc.
Page generated 2017-12-11  16:42:21 PST  Terms of use