Hand-Gesture-Recognition-using-Multi-Scale-Colour-Features，-Hierarchical-Models-and-Particl.pdf

Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering Lars Bretzner, Ivan Laptev and Tony Lindeberg Computational Vision and Active Perception Laboratory (CVAP) Dept of Numerical Analysis and Computing Science KTH, 100 44 Stockholm, Sweden bretzner,laptev,tony@nada.kth.se Shortened version in Proc. Face and Gesture 2002, Washington DC, 423–428. Abstract This paper presents algorithms and a prototype system for hand tracking and hand posture recognition. Hand pos- tures are represented in terms of hierarchies of multi-scale colour image features at different scales, with qualitative inter-relations in terms of scale, position and orientation. In each image, detection of multi-scale colour features is per- formed. Hand states are then simultaneously detected and tracked using particle filtering, with an extension of layered sampling referred to as hierarchical layered sampling. Ex- periments are presented showing that the performance of the system is substantially improved by performing feature detection in colour space and including a prior with respect Figure 1. An example of how gesture inter- to skin colour. These components have been integrated into faces could possibly replace or complement a real-time prototype system, applied to a test problem of remote controls. In this scenario, a user con- controlling consumer electronics using hand gestures. In a trols consumer electronics with hand ges- simplified demo scenario, this system has been successfully tures. The prototype system is described in tested by participants at two fairs