Gesture based Input Device = An All Inertial Approach

다국어 초록 (Multilingual Abstract)

In this paper, we develop a gesture-based input device equipped with accelerometers and gyroscopes. The sensors measure the inertial measurements, i.e., accelerations and angular velocities produced by the movement of the system when a user is inputting gestures on a plane surface or in a 3D space. The gyroscope measurements are integrated to give orientation of the device and consequently used to compensate the accelerations. The compensated accelerations are doubly integrated to yield the position of the device. With this approach, a user's gesture input trajectories can be recovered without any external sensors. Three versions of motion tracking algorithms are provided to cope with wide spectrum of applications. Then, a Bayesian network based recognition system processes the recovered trajectories to identify the gesture class. Experimental results convincingly show the feasibility and effectiveness of the proposed gesture input device. In order to show practical use of the proposed input method, we implemented a prototype system, which is a gesture-based remote controller (Magic Wand).

목차 (Table of Contents)

• Abstract
• 1. Introduction
• 2. Overview of the proposed gesture based input device
• 3. Sensing Motions Produced by user's Gesture
• 4. Recognition
• 5. Experiments
• 6. Application example
• 7. Conclusions
• References

참고문헌 (Reference)

1 "in Digest of paper. Third International Symposium on Wearable Computers. Los Alamos" 178-180, oct.1999

2 "a input system based on three dimensional inertial navigation system and method for trajectory estimation thereof" 2004.

3 "Two-dimensional position detection systems with MEMS accelerometer for mouse applications in Proceedings of the 38th Design Automation Conference" 852-857,

4 "Trends in inertial systems technology for high accuracy AUV navigation" 1998. auv'98 : -1998, pp.63-73.

5 "Three-dimensional input device with six degree of freedom" 9 : 717-729, oct.1999.

6 "The use of gestures in multimodal input" 35-42, 1998

7 "The development of a pointing device with a cursor in inertial motion" 31 (31): 268 1990-274,

8 "Spatial input apparatus" -13, 1989.

9 "Signature verification method and apparatus" -28, 1976.

10 "Signature verification based on complete accelerometry" 4827-4829, 1977.05

11 "Self tracking of human motion for virtual reality systems" 2177 : 1994-, pp.278-287.

12 "Pen-shaped input device using inertial measurement units and method thereof" 2004.

13 "Pen-shaped handwriting input apparatus using accelerometers and gyroscopes and an associated operational device for determining pen movement" (v. 9) : 1999.

14 "Pen-shaped handwriting input apparatus using accelerometers and gyroscopes and an associated operational device for determining pen movement" -11, 1999.

15 "Pen type input device" -30, 2000.

16 "Pen for signature verification by acceleration and pressure" 24 : 902-, 1981.07

17 "No silver bullet^but a respectable arsenal^November / December 2002" 24-38,

18 "Multidimensional signal input device" -12, 1994.

19 "Motion recognition system using a imaginary writing plane^method thereof" 2004.

20 "Motion recognition system capable of distinguishment a stroke for writing motion and method thereof" 2004.

21 "Micro-accelerometer based hardware interfaces for wearable computer mixed reality applications" and S. Prince 2002.

22 "Method for utilization of a gyroscopic or inertial device as a user interface mechanism for computer" -22, 2002.

23 "Method and device for tracking an object" -12, 2002.

24 "Method and device for executing pedometer in wireless terminal" (v. 19) : 2004.

25 "Method and apparatus for inputting information spatially" 2004.

26 "Method and apparatus for compensating the acceleration error and inertial navigation system using thereof" 2004.

27 "Integrated INS/GPS system for high precision navigation applications" -1994, pp.310-313.

28 "Inertial proprioceptive devices: self-motion-sensing toys and tools" 34 : 639-650, 1996.

29 "INS reset removal for enhanced post-flight performance analysis 1990. Record. The 1990's - A decade of Excellence in the navigation sciences. IEEE PLANS'90." 226-230,

30 "Human motion capture by integrating gyroscopes and accelerometers in Proceedings of IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems" and s. i (and s. i): 470-475,

31 "Head mouse system using a gyro sensor - the man-machine interface for laparoscopic manipulator in Proceedings of the 12th International Symposium and Exhibition on CAR'98. Computer Assisted Radiology and Surgery. Elsevier Science" 742-746, 1998

32 "Handwritten pattern reproduction using 3d inertial measurement of handwriting movement" 38 : -2002, andm.hashimoto

33 "Handwriting recognition using acceleration-based motion detection" london : 25 51-56,

34 "Handwriting pattern reproduction using 3D inertial measurement of handwriting movement" 38 : 1-8, jan.2002.

35 "Handwriting input apparatus for handwriting recognition using more than one sensing technique" may 14 : 1996-, andv.korsensky

36 "Gyroscopic goniometry during quasistatic and kinematic conditions using a new and conventional methods for aiding" 131-, 1999.

37 "Gestures as input" 56-61, -2003.0406

38 "Gesture input method and apparatus" -3, 1998.

39 "Extraction of character information from acceleration of handwriting pen" j76d-i : 541-543, oct.1993.

40 "Electronic pointing apparatus and method" -20, 1998.

41 "Electronic calculator based on character recognition of input from stylus acceleration dynamics" 19 : 2816-2817, dec.1976.

42 "Digital data entry glove interface device" -8, 1983.

43 "Development of the gyro-free handwriting input device based on inertial navigation system in SICE Annual Conference in Sapporo Hokkaido Institute of Technology" 1176-1181, aug.2004

44 "Design of self-contained gesture-based input device for human robot interface" to be published. oct.2004

45 "Data input pen for signature verification" 4513437-23, 1985.

46 "Coordinate detecting apparatus having acceleration detectors" -24, 1996.

47 "Control device of electronic devices based on motion" 2004.

48 "Computer apparatus input device for three-dimensional information" 1993-19, jan.

49 "Can people use gesture commands?" 86002284-, 1986.

50 "Bayesian network modeling of strokes and their relationships for on-line handwriting recognition" 37 (37): 253-264 2004,

51 "Bayesian network modeling of hangul characters for on-line handwritten recognition" edinburgh : 207-211, aug.2003

52 "Autonomous computer input device and marking instrument" -21, 1993.

53 "Automatic signature verification" yorktown heights (yorktown heights): 5810-1975,

54 "Apparatus and method for move recognizing of mobile phone" -5, 2001.

55 "Apparatus and method for inputting information spatially" dec. 23 : 2004-, andw.-c.bang

56 "An Introduction to Bayesian Networks. New York" Springer 1996.

57 "Accuracy limitations of fog-based continuous measurement-while-drilling surveying instruments for horizontal wells" 51 (51): 1177-1191, dec.2002.

58 "Accelerometry - a technique for the measurement of human body movement" 729-736, 1973.

59 "Accelerometer vibration analysis in finding out velocities" 2000 1 : -2000, pp.585-588.

60 "A novel accelerometer for sensing pen tip motion in Proceedings of the 4th European Conference on Smart Structures and Materials in conjunction with the 2nd International Conference on Micromechanics" 709-714, 1998

61 "A hand-drawn gesture input device in 3-d space with inertial sensors" 35-, nov.2004

62 "A gesture based user interface prototyping system" -1989, pp.127-132.