To meet the challenges of ubiquitous computing, ambient technologies and an increasingly older population, researchers have been trying to break away from traditional modes of interaction. A history of studies over the past 30 years reported in this paper suggests that Gesture Controlled User Interfaces (GCUI) now provide realistic and affordable opportunities, which may be appropriate for older and disabled people. We have developed a GCUI prototype application, called Open Gesture, to help users carry out everyday activities such as making phone calls, controlling their television and performing mathematical calculations. Open Gesture uses simple hand gestures to perform a diverse range of tasks via a television interface. This paper describes Open Gesture and reports its usability evaluation. We conclude that this inclusive technology offers some potential to improve the independence and quality of life of older and disabled users along with general users, although there remain significant challenges to be overcome.
S. Trewin and H. Pain, “Keyboard and Mouse Errors due to Motor Disabilities,” International Journal of Human-Computer Studies, Vol. 50, No. 2, 1999, pp. 109-144.
Nintendo Wii, “Wii at Nintendo,” 2006. http://www.nintendo.com/wii
M. Bhuiyan, “Xessibility: XML-XSL for Web Browser Accessibility,” Poster in the 2nd BCS/IET International Conference on Internet Technologies and Applications, Wrexham, 4-7 September 2007.
D. Hawthorn, “How Universal Is Good Design for Older Users?” Proceedings of the Conference on Universal Usability, New York, 2003, p. 38.
K. Giannakouris, “Eurostat: Ageing Characterises the Demographic Perspectives of the European Societies,” 2008. http://epp.eurostat.ec.europa.eu
F. G. Miskelly, “Assistive Technology in Elderly Care,” Age and Ageing, Vol. 30, No. 6, 2001, pp. 455-458.
S. Borland, “Elderly ‘ADDICTED’ to Nintendo Wii at Care Home,” 2007. http://www.telegraph.co.uk/news/uknews/1563076/Elderly-addicted-to-Nintendo-Wii-at-care-home.html
K. D. Bot and R. W. Schrauf, “Language Development over the Lifespan,” Taylor & Francis, UK, 2009.
A. F. Newell, P. Gregor, M. Morgan, G. Pullin and C. Macaulay, “User Sensitive Inclusive Design,” Universal Access in the Information Society, Vol. 9, July 2010, pp. 235-243.
M. Bhuiyan and R. Picking, “Gesture Control User Interface, What Have We Done and What’s Next?” Proceedings of the 5th Collaborative Research Symposium on Security, E-Learning, Internet and Networking, Plymouth, 2009a, p. 59.
S. Lenman, L. Bretzner and B. Thuresson, “Computer Vision Based Recognition of Hand Gestures for Human-Computer Interaction,” Technical Report TRITANAD-0209, 2002.
C. G. Wolf, “Can People Use Gesture Commands?” Newsletter, ACM SIGCHI Bulletin, Vol. 18, No. 2, 1986, pp. 73-74.
A. Zimmerman, “A Hand Gesture Interface Device,” Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface, Toronto, 5-9 April 1987, pp. 189-192.
T. Baudel and M. Beaudouin-Lafon, “Charade: Remote Control of Objects Using Free Hand Gesture,” Communications of the ACM, Vol. 36, No. 7, 1993, pp. 28-35.
S. Kallio, J. Kela, J. Mantyjarvi and J. Plomp, “Visualization of Hand Gestures for Pervasive Computing Environments,” Proceedings of the Working Conference on Advanced Visual Interfaces, Venezia, 23-26 May 2006, pp. 480-483.
XBOX Live Vision and Kinect, “Microsoft Live Vision Camera,” Natal & Kinect, 2006. http://en.wikipedia.org/wiki/Xbox_Live_Vision
GestureTek, “Gesture Recognition & Computer Vision Control Technology & Motion Sensing Systems for Presentation & Entertainment,” 2009. http://www.gesturetek.com
S. Malik and J. Laszlo, “Visual Touchpad: A Two-Handed Gestural Input Device,” Proceedings of the ACM International Conference on Multimodal Interfaces, State College, 13-15 October 2004, pp. 289-296.
P. Jia and H. Huosheng, “Head Gesture Recognition for Hands-Free Control of an Intelligent Wheelchair,” Industrial Robot: An International Journal, Vol. 34, No. 1, 2007, pp. 60-68.
D. Kim and D. Kim, “An Intelligent Smart Home Control Using Body Gestures,” Proceedings of International Conference on Hybrid Information Technology, Jeju Island, 9-11 November 2006.
J. Kela, et al., “Accelerometer-Based Gesture Control for a Design Environment,” Personal and Ubiquitous Computing, Vol. 10, No. 5, 2005, pp. 285-299.
L. Blaxter, C. Hughes and M. Tight, “How to Research,” Open University, USA, 1996.
A. Wilson and N. Oliver, “GWindows: Towards Robust Perception-Based UI,” Proceedings of CVPR 2003 (Workshop on Computer Vision for HCI), 2003.
H. Lee, et al., “Select-and-Point: A Novel Interface for Multi-Device Connection and Control Based on Simple Hand Gestures,” CHI 2008, Florence, 5-10 April 2008.
K. Tsukadaa and M. Yasumura, “Ubi-Finger: Gesture Input Device for Mobile Use,” Journal of Transactions of Information Processing Society of Japan, Vol. 43, No. 12, 2002, pp. 3675-3684.
J. Goodman, S. Brewster and P. Gray, “Not Just a Matter of Design: Key Issues surrounding the Inclusive Design Process,” Helen Hamlyn Research Centre, London, 2005.
R. Picking, et al., “A Case Study Using a Methodological Approach to Developing User Interfaces for Elderly and Disabled People,” The Computer Journal, Vol. 53, No. 6, 2010, pp. 842-859.
A. Helal, M. Mokhtari and B. Abdulrazak, “The Engineering Handbook of Smart Technology for Aging, Disability and Independence,” 1st Edition, Wiley-Interscience, USA, 2008.
R. Eisma, et al., “Early User Involvement in the Development o Information Technology-Related Products for Older People,” Universal Access in the Information Society, Vol. 3, No. 2, 2004, pp. 131-140.
R. Jim, “Dialogue Management for Gestural Interfaces,” ACM SIGGRAPH Computer Graphics, Vol. 21, No. 2, 1987, pp. 137-142.
Philips Net TV, 2010. http://www.philips.co.uk/c/about-philips-nettv-partnerships/22183/cat/ http://www.philips.co.uk/c/about-philips-nettv-partnerships/22183/cat/
E. Sellek, “Toshiba’s Gesture-Based User Interface,” 2010. http://www.slashgear.com/toshiba-airswing-is-a-gesture-based-ui-for-the-masses-video-2787379/
G. Von Krogh and S. Spaeth, “The Open Source Software Phenomenon: Characteristics That Promote Research,” Journal of Strategic Information System, Vol. 16, No. 3, 2007, pp. 236-253.
R. Picking, V. Grout, J. Crisp and H. Grout, “Simplicity, Consistency, Universality and Familiarity: Applying ‘SCUF’ Principles to Technology for Assisted Living,” Proceedings of the 1st International Workshop on Designing Ambient Interactions for Older Users—Part of the 3rd European Conference on Ambient Intelligence, Vienna, 2009.
Easyline, “Easyline+: Low Cost Advanced White Goods for a Longer Independent Life of Elderly People,” 2009. http://easylineplus.com/
INHOME, “INHOME Project: An Intelligent Interactive Services Environment for Assisted Living,” 2009. http://www.ist-inhome.eu
OLDES, “OLDES: Older People’s E-Service at Home,” 2009. http://www.oldes.eu/
J. Z. Rubin, D. Chisnell and J. M. Spool, “Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests,” 2nd Edition, Wiley Publishing, Indianapolis, 2008.
G. Perlman, “User Interface Usability Evaluation with Web-Based Questionnaire,” 2009. http://hcibib.org/perlman/questiOn.html
P. M. Fitts, “The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement,” Journal of Experimental Psychology; Reading in Research Methods in Human-Computer Interaction (Lazar, Feng and Hochheiser, 2010), Vol. 47, No. 6, June 1954, pp. 381-391.