基于Kinect深度图像指尖检测和手势识别①.PDFVIP

计 算 机 系 统 应 用 2017 年 第 26 卷 第 4 期 基于Kinect 深度图像的指尖检测与手势识别① 高 晨, 张亚军 (北京化工大学 机电工程学院, 北京 100029) 摘 要: 针对基于普通摄像头的手势识别系统在不同光照条件和复杂环境下易受影响的问题, 提出一种基于 kinect 深度图像进行指尖检测和手势识别的算法. 首先利用 Kinect 传感器获取深度图像, 再利用 OpenNI 手部跟 踪器检测出手部的位置, 根据手部位置对手势进行深度阈值分割. 提出一种结合凸包和曲率检测指尖的算法, 检 测出指尖数目和位置后, 计算出包括指尖和手掌水平方向的夹角、相邻两个指尖夹角以及指尖与掌心的距离的特 征向量, 最后利用支持向量机(SVM)对预定的 9 种数字手势进行识别. 实验邀请 5 位实验者在复杂环境下每个手 势做 30 次, 每次的手势角度不同, 实验结果表明该方法能够准确检测出指尖的数目和位置, 9 种数字手势平均识 别率达到 97.1%, 该方法使用特征简单, 实时性好, 有较好的鲁棒性. 关键词: Kinect 传感器; 指尖检测; 支持向量机; 手势识别 Fingertip Detection and Hand Gesture Recognition Based on Kinect Depth Image GAO Chen, ZHANG Ya-Jun (Beijing University of Chemical Technology, College of Mechanical and Electrical Engineering, Beijing 100029, China) Abstract: Aiming at the problem that hand gesture recognition system based on ordinary camera is susceptible to the different lighting conditions and complex background, a fingertip detection and hand gesture recognition algorithm based on Kinect depth image is proposed. First, we get depth image by Kinect sensor. Then the hand region is extracted by putting the depth of thresholds on hand point detected by using OpenNI library. Fingertip detection based on convex hull and curvature is proposed. After the number of fingertips and the location of fingertips being detected, it calculates a feature vector including the number of fingers, the angles between fingertips and horizontal of the hand, the angles between two consecutive fingers, and the distance between fingertips and hand center point. Finally, a support vector machine(SVM) is applied to identify nine scheduled number hand gesture. Five experimenters are invited to perform 9 different hand gestures in the complex environment, which each gesture is repeated at thirty times