Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 31900
2-Dimensional Finger Gesture Based Mobile Robot Control Using Touch Screen

Authors: O. Ejale, N.B. Siddique, R. Seals


The purpose of this study was to present a reliable mean for human-computer interfacing based on finger gestures made in two dimensions, which could be interpreted and adequately used in controlling a remote robot's movement. The gestures were captured and interpreted using an algorithm based on trigonometric functions, in calculating the angular displacement from one point of touch to another as the user-s finger moved within a time interval; thereby allowing for pattern spotting of the captured gesture. In this paper the design and implementation of such a gesture based user interface was presented, utilizing the aforementioned algorithm. These techniques were then used to control a remote mobile robot's movement. A resistive touch screen was selected as the gesture sensor, then utilizing a programmed microcontroller to interpret them respectively.

Keywords: 2-Dimensional interface, finger gesture, mobile robot control, touch screen.

Digital Object Identifier (DOI):

Procedia APA BibTeX Chicago EndNote Harvard JSON MLA RIS XML ISO 690 PDF Downloads 1763


[1] K. Hinckley, Input Technologies and Techniques, in Handbook of Human-Computer Interaction, ed. By A. Sears and J. Jacko., L. Erlbaum Associates Inc., USA, 2003, pp. 1-11. ISBN:0-8058-3838-4
[2] Hudlicka, E., To feel or not to feel: The role of affect in human- computer interaction, International Journal of Human-Computer Studies, 2003, vol. 59 (1-2), pp. 1-32. ISSN: 10715819.
[3] Hong-Ki, K., Seunggun, L., Kwang-Seok Y., Capacitive tactile sensor array for touch screen application, Sensors and Actuators A: Physical, January 2011, vol. 165 (1), pp. 2-7. ISSN: 0924-4247
[4] Pisacreta, R., Rilling, M., Infrared touch technology as a response detector in animal research, Behaviour Research Methods, July 1987, vol. 19 (4), pp. 389-396. ISSN: 1554-351X
[5] Hyeon-Kyu L., Jin-Hyung K., Gesture spotting from continuous hand motion, Pattern Recognition Letters, April 1998, vol. 19 (5-6), pp. 513- 520. ISSN: 0167-8655
[6] Ho-Sub Y. Et al, Hand gesture recognition using combined features of location, angle and velocity, Pattern Recognition, 2001, vol. 34 (7), pp. 1491-1501. ISSN 0031-3203
[7] EloTouch, AccuTouch Five-Wire Resistive Touchscreens, 2011,
[online]. Available from AccuTouch /default.asp (accessed 1st August 2011)
[8] Microchip®, PIC18F2420/2520/4420/4520 Data Sheet (DS39631E), Microchip, 2008, pg. 1
[9] ShreharSha R., Estimating the ZigBee transmission-range ISM band, May 4 2007, (online). Available from contents/images/6 442439.pdf (accessed 20th August 2011)
[10] Future Technology Devices Ltd, MM232R USB - Serial UART Development Module Datasheet Doc. Ref. No. FT_000214, 2010.
[11] Nichols, S., New Interfaces at the Touch of a Fingertip, Computer, Aug. 2007, vol.40 (8), pp.12-15. ISSN: 0018-9162