A Vision-Based Method to Find Fingertips in a Closed Hand = A Vision-Based Method to Find Fingertips in a Closed Hand

다국어 초록 (Multilingual Abstract)

Hand gesture recognition is an important area of research in the field of Human Computer Interaction (HCI). The geometric attributes of the hand play an important role in hand shape reconstruction and gesture recognition. That said, fingertips are one of the important attributes for the detection of hand gestures and can provide valuable information from hand images. Many methods are available in scientific literature for fingertips detection with an open hand but very poor results are available for fingertips detection when the hand is closed. This paper presents a new method for the detection of fingertips in a closed hand using the corner detection method and an advanced edge detection algorithm. It is important to note that the skin color segmentation methodology did not work for fingertips detection in a closed hand. Thus the proposed method applied Gabor filter techniques for the detection of edges and then applied the corner detection algorithm for the detection of fingertips through the edges. To check the accuracy of the method, this method was tested on a vast number of images taken with a webcam. The method resulted in a higher accuracy rate of detections from the images. The method was further implemented on video for testing its validity on real time image capturing. These closed hand fingertips detection would help in controlling an electro-mechanical robotic hand via hand gesture in a natural way.

참고문헌 (Reference)

1 Gastaldi G., "a man-machine communication system based on the visual analysis of dynamic gestures" 397-400, 2005

2 Nolker, C., "Visual Recognition of Continuous Hand Postures" 13 (13): 983-994, 2002

3 이대호, "Vision-Based Remote Control System by Motion Detection and Open Finger Counting" IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC 55 (55): 2308-2313, 200911

4 Raheja, J.L., "Tracking of Fingertips and Centers of Palm Using KINECT" 248-252, 2011

5 Malik, S., "Real-time Hand Tracking and Finger Tracking for Interaction"

6 Raheja J.L., "Real-Time Robotic Hand Control using Hand Gesture" 12-16, 2010

7 Choi, J., "Morphological Gesture Recognition Algorithm, Proceeding of IEEE region" 291-296, 2001

8 전준철, "Manipulation of Virtual Objects in Marker-less AR System by Fingertip Tracking and Hand Gesture Recognition" ACM, AICIT 1110-1115, 2009

9 이웅기, "Hand Shape Recognition Using Fingertip" IEEE Computer Society 44-48, 2008

10 Shin, M. C., "Gesture recognition using bezier curves for visualization navigation from registered 3d data" 37 (37): 1011-1024, 2004

11 Nguyen, D.D., "Fingertip Detection with Morphology and Geometric Calculation" 1460-1465, 2009

12 Chaudhary, A., "An ANN based Approach to Calculate Robotic fingers positions" 192 (192): 488-496, 2011

13 Raheja, J. L., "A. An Efficient Real time method of fingertip detection" 447-450, 2011

14 Sawah, A.E., "A framework for 3D hand tracking and gesture recognition using elements of genetic programming" 495-502, 2007

15 Chaudhary, A., "A Vision based Geometrical Method to find Fingers Positions in Real Time Hand Gesture Recognition" Academy Publisher 7 : 2012

16 Chaudhary, A., "A Survey on Hand Gesture Recognition in context of Soft Computing" Springer Berlin Heidelberg 133 : 46-55, 2010

17 Zhou, H., "A Real-time Gesture Recognition Algorithm on Video Surveillance" 3 : 2006