ICRA 2011 Paper Abstract


Paper WeP114.4

Dong, Yuanqiang (University of Missouri-Columbia), Conrad, Daniel (University of Missouri, Columbia), DeSouza, Guilherme (University of Missouri-Columbia)

"Wii Using Only 'We'": Using Background Subtraction and Human Pose Recognition to Eliminate Game Controllers

Scheduled for presentation during the Regular Sessions "Computer Vision for Robotics and Automation III" (WeP114), Wednesday, May 11, 2011, 14:25−14:40, Room 5J

2011 IEEE International Conference on Robotics and Automation, May 9-13, 2011, Shanghai International Conference Center, Shanghai, China

This information is tentative and subject to change. Compiled on July 14, 2020

Keywords Gesture, Posture and Facial Expressions, Computer Vision for Robotics and Automation, Human detection & tracking


We propose a novel human-computer interface for video gaming systems. Unlike current systems that use active sensors (e.g. Kinect), in the proposed approach, the human-poses are captured by a single camera and used to control the course of the game. This eliminates the need for traditional hand-held controllers and allows for the player to be immersed into the virtual environment of the game. The success of the approach is achieve through a robust extraction of human silhouettes and by a simple but effective human-pose recognizer. The system employs an adaptive framework for background subtraction using Adaptive Local Principal Component Analysis (ALPCA), which is able to handle sudden as well as gradual changes in background. Next, the extracted human silhouettes are used to train a appearance-based algorithm that can recognize the human poses. The excellent results reported here justify the elimination of active sensors and game controllers for many traditional games.



Technical Content © IEEE Robotics & Automation Society

This site is protected by copyright and trademark laws under US and International law.
All rights reserved. © 2002-2020 PaperCept, Inc.
Page generated 2020-07-14  15:50:18 PST  Terms of use