Abstract: Aiming at the problems that gesture recognition required high environmental background, segmented gesture usually contained wrist data and closing fingers easily caused false recognition, a gesture recognition method based on depth data was proposed. It captured gesture depth map, and it used Hands Generator to obtain the information of palm for gesture segmentation, in order to remove redundant wrist data, the constraint of the palm which looks like a square was added. The number of all the other four fingers except thumb could be acquired with the use of the scanline method, therefore, the width ratio of the adjacent fingers and the peculiarity of the thumb position were integrated to achieve the gesture recognition. Experimental results show that the average recognition rate of the method is 98.4%, and the method has good real-time performance and robustness in the different illumination conditions and complex backgrounds.

Key words: Kinect sensor, depth data, gesture segmentation, gesture recognition