article

GeeAir: a universal multimodal remote control device for home appliances

Authors:

Shijian LiAuthors Info & Claims

Personal and Ubiquitous Computing, Volume 14, Issue 8

Pages 723 - 735

https://doi.org/10.1007/s00779-010-0287-7

Published: 01 December 2010 Publication History

Abstract

In this paper, we present a handheld device called GeeAir for remotely controlling home appliances via a mixed modality of speech, gesture, joystick, button, and light. This solution is superior to the existing universal remote controllers in that it can be used by the users with physical and vision impairments in a natural manner. By combining diverse interaction techniques in a single device, the GeeAir enables different user groups to control home appliances effectively, satisfying even the unmet needs of physically and vision-impaired users while maintaining high usability and reliability. The experiments demonstrate that the GeeAir prototype achieves prominent performance through standardizing a small set of verbal and gesture commands and introducing the feedback mechanisms.

References

[1]

Campbell LW (1997) A more 'universal' remote control. http://web. media.mit.edu/~lieber/Teaching/Collab97/Collab-Projects/remote. html

[2]

http://www.consumer.philips.com/consumer/en/gb/consumer/ cc/_categoryid_3000_SERIES_REMOTE_CONTROL_SU_GB_ CONSUMER/{4-in-1TV/VCR/DVD/SAT}.

[3]

http://www.oneforall.co.uk/en_UK/product/1/universal-remotes/ 3/advanced/25/digital-12

[4]

http://www.logitech.com/index.cfm/remotes/universal_remotes/ devices/3898&cl=us,en

[5]

http://www.universalremote.com/product_detail.php?model=158

[6]

Lee L, Johnson T (2006) URCousin: universal remote control user interface. In: Proceedings of the Human Interface Technologies Conference, April 2006.

[7]

Niezen G, Hancke GP (2008) Gesture recognition as ubiquitous input for mobile phones. International Workshop on Devices that Alter Perception (DAP08), conjunction with Ubicomp08, 2008.

[8]

Bolt RA (1980) Put-that-there: voice and gesture at the graphics interface, SIGGRAPH'80, pp 262-270.

[9]

Machate J, Burmester M, Bekiaris E (1997) Towards an intelligent multimodal and multimedia user interface providing a new dimension of natural HMI in the teleoperation of all home appliances by E&D users, 6th International Conference Man-Machine Interactions Intelligent Systems in Business, Montpellier, May 1997, pp 226-229.

[10]

Machate J (1999) Being natural--on the use of multimodal interaction concepts in smart homes. In: Proceedings of the HCI International '99, pp 937-941.

[11]

Wilson A, Oliver N (2003) Gwindows: robust stereo vision for gesture-. based control of windows. In: Proceedings of the 5th international conference on multimodal interfaces, New York, NY, USA, pp 211-218.

[12]

Krum DM, Omoteso O, Ribarsky W, Starner T, Hodges LF (2002) Speech and Gesture Multimodal Control of a Whole Earth 3D Visualization Environment. In: Proceedings of Symposium on Data Visualization, Barcelona, Spain, pp 195-200.

[13]

Starner T, Auxier J, Ashbrook D, Gandy M (2000) The gesture pendant: a self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. International Symposium on Wearable Computers (ISWC00), pp 87-95.

[14]

Kela J, Korpipaa P, Mantyjarvi J, Kallio S, Savino G, Jozzo L, Marca D (2006) Accelerometer-based gesture control for a design environment, Personal Ubiquitous Computing, 10:285-299.

[15]

Wu J, Pan G, Li S, Zhang D (2009) Gesture Recognition with a 3D Accelerometer. The Sixth International Conference on Ubiquitous Intelligence and Computing (UIC-09), Brisbane, Australia, 7-9 July, 2009.

[16]

Rabiner L, Levinson L (1981) Isolated and connected word recognition--theory and selected applications. IEEE Trans Commun 29(5):621-659.

[17]

Rabiner LR (1989) A tutorial on hidden markov models and selected applications in speech recognition. Proc IEEE 77:257- 286.

[18]

Lee C-H, Lin C-H, Juang B-H (1991) A study on speaker adaptation of the parameters of continuous density hidden Markov models. IEEE Trans Signal Process 39(4):806-814.

[19]

Davis SB, Mermelstein P (1980) Comparison of parametric representation for monosyllabic word recognition in continuously spoken sentences. IEEE Trans Acoust Speech Signal Process 28:357-366.

[20]

Mitra S, Acharya T (2007) Acharya: gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C 37(3):311-324.

[21]

Schlömer T, Poppinga B, Henze N, Boll S (2008) Gesture Recognition with a Wii Controller. International Conference on Tangible and Embedded Interaction (TEI'08), pp 11-14, Bonn Germany, Feb. 18-20, 2008.

[22]

Mäntylä V-M (2001) Discrete hidden markov models with application to isolated user-dependent hand gesture recognition. VTT publications.

[23]

Liu J, Wang Z, Zhong L, Wickramasuriya J, Vasudevan V (2009) uWave: accelerometer-based personalized gesture recognition and its applications. IEEE PerCom'09, 2009.

[24]

Mäntyjärvi J, Kela J, Korpipää P, Kallio S (2004) Enabling fast and effortless customization in accelerometer based gesture interaction. Proceedings of the 3rd International Conference on Mobile and Ubiquitous Multimedia (MUM'04), ACM Press, 25- 31, October 27-29.

[25]

Christanini J, Taylor JS (2000) An introduction to support vector machines and other kernel-based methods. Cambridge University Press, Cambridge.

[26]

HTK: http://htk.eng.cam.ac.uk/

[27]

Frigo M, Johnson SG (2005) The design and implementation of FFTW3. Proc IEEE 93(2).

[28]

Joachims T (1999) Making large-scale SVM learning practical. Advances in kernel methods--support vector learning. In: Schöllkopf B, Burges C, Smola A (ed) MIT-Press.

[29]

Quinlan JR (1996) Improved use of continuous attributes in c4.5. J Artif Intell Res 4:77-90.

Cited By

Anbarasan Lee JBoll SJain RO'Connor NMcDaniel TMeyer J(2018)Speech and Gestures for Smart-Home Control and Interaction for Older AdultsProceedings of the 3rd International Workshop on Multimedia for Personal Health and Health Care10.1145/3264996.3265002(49-57)Online publication date: 15-Oct-2018
https://dl.acm.org/doi/10.1145/3264996.3265002
Huo KCao YYoon SXu ZChen GRamani KMandryk RHancock MPerry MCox A(2018)ScenariotProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173793(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173793
Xiao RLaput GZhang YHarrison CMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Deus EM MachinaProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025828(4000-4008)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025828
Show More Cited By

Recommendations

GeeAir: Waving in the Air to Control Home Appliances
UIC-ATC '10: Proceedings of the 2010 Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing

This video is a demonstration of our previous work [5], where we presented a handheld mobile device Gee Air, a gesture-based universal controller for home appliances. Combining the speech, gesture, joystick, button, and light, Gee Air allows the users ...
Advanced universal remote controller for home automation and security

There has been inconvenience in controlling each digital home appliance which requires its own remote controller. In this paper, we present an advanced universal remote controller (URC) with the total solution for home automation and security. All kinds ...
Next Generation Home Automation System Based on Voice Recognition
ICEMIS'20: Proceedings of the 6th International Conference on Engineering & MIS 2020

In the past years, doctors have been aware of the need for self-reliance and self-help. The Internet of Things is the result of an evolution in technology that helps improve everyone's lifestyle if used carefully and efficiently. Recently homed ...

Comments

Information & Contributors

Information

Published In

cover image Personal and Ubiquitous Computing

Personal and Ubiquitous Computing Volume 14, Issue 8

December 2010

94 pages

ISSN:1617-4909

Issue’s Table of Contents

Copyright © Copyright © 2010 Springer-Verlag London Limited.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 December 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
638
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Anbarasan Lee JBoll SJain RO'Connor NMcDaniel TMeyer J(2018)Speech and Gestures for Smart-Home Control and Interaction for Older AdultsProceedings of the 3rd International Workshop on Multimedia for Personal Health and Health Care10.1145/3264996.3265002(49-57)Online publication date: 15-Oct-2018
https://dl.acm.org/doi/10.1145/3264996.3265002
Huo KCao YYoon SXu ZChen GRamani KMandryk RHancock MPerry MCox A(2018)ScenariotProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173793(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173793
Xiao RLaput GZhang YHarrison CMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Deus EM MachinaProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025828(4000-4008)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025828
López GQuesada LGuerrero L(2015)A Gesture-Based Interaction Approach for Manipulating Augmented Objects Using Leap MotionProceedings of the 7th International Work-Conference on Ambient Assisted Living. ICT-based Solutions in Real Life Situations - Volume 945510.1007/978-3-319-26410-3_22(231-243)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1007/978-3-319-26410-3_22
Jin YDang CPrehofer CAndré EDachselt RGraham NHornbæk KNacenta M(2014)A Multi-Display System for Deploying and Controlling Home AutomationProceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces10.1145/2669485.2669553(399-402)Online publication date: 16-Nov-2014
https://dl.acm.org/doi/10.1145/2669485.2669553
Hakulinen JTurunen MHeimonen T(2013)Spatial Control Framework for Interactive LightingProceedings of International Conference on Making Sense of Converging Media10.1145/2523429.2523462(59-66)Online publication date: 1-Oct-2013
https://dl.acm.org/doi/10.1145/2523429.2523462
Carvalho JManzato MGoularte RBressan GMelo Silveira RMunson ESantanchà Ada Graèa Campos Pimentel M(2012)Accelerometers data interoperabilityProceedings of the 18th Brazilian symposium on Multimedia and the web10.1145/2382636.2382702(305-312)Online publication date: 15-Oct-2012
https://dl.acm.org/doi/10.1145/2382636.2382702
Yu YHe DHua WLi SQi YWang YPan GDey AChu HHayes G(2012)FlyingBuddy2Proceedings of the 2012 ACM Conference on Ubiquitous Computing10.1145/2370216.2370359(669-670)Online publication date: 5-Sep-2012
https://dl.acm.org/doi/10.1145/2370216.2370359
Zhang LPan GWu ZLi SWang CDey AChu HHayes G(2012)SmartShadow-KProceedings of the 2012 ACM Conference on Ubiquitous Computing10.1145/2370216.2370337(627-628)Online publication date: 5-Sep-2012
https://dl.acm.org/doi/10.1145/2370216.2370337
Bartolini SMilosevic BD'Elia AFarella EBenini LCinotti T(2012)Reconfigurable natural interaction in smart environmentsPersonal and Ubiquitous Computing10.1007/s00779-011-0454-516:7(943-956)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.1007/s00779-011-0454-5
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents