short-paper

Motion-path based gesture interaction with smart home services

Authors:

ASM Mahfujur Rahman,

M. Anwar Hossain,

Jorge Parra,

Abdulmotaleb El SaddikAuthors Info & Claims

MM '09: Proceedings of the 17th ACM international conference on Multimedia

Pages 761 - 764

https://doi.org/10.1145/1631272.1631407

Published: 19 October 2009 Publication History

Get Access

Abstract

In this paper, we propose a motion-path based gesture recognition technique and show its application in a smart home environment. Users hand gestures are recognized by capturing the motion-path while they draw different symbols in the air. In order to capture the motion-path, we use infra-red camera's IR sensing capability. The IR camera tracks the infra-red emitter attached to the user's hand gloves and produces a sequence of motion-points, which are then analyzed syntactically to recognize the intended hand gesture. The recognized gesture is used to interact with the intelligent environment for accessing various services. Toggling a lamp switch, changing the light intensity, and playing/pausing a movie are few examples where we have integrated the gesture-based interaction. Our experiment shows that the proposed gesture recognition technique is robust and its use in the smart home environment is interesting and appealing to the people.

References

[1]

Pavlovic, V.I. et al, 1997. Visual interpretation of hand gestures for human computer interaction: a review. IEEE Transactions on Pattern Analysis and Machine Intelligence. vol. 19, no. 7, pp. 677--695, Jul. 1997.

Digital Library

Google Scholar

[2]

Chen, Q. et al., 2009. Human-computer interaction for smart environment applications using hand--gestures and facial-expressions. International Journal of Advanced Media and Communication, 2009.

Digital Library

Google Scholar

[3]

Hossain, M. A. et al., 2009. A Framework for Human-centered Provisioning of Ambient Media Services. Springer Multimedia Tools and Applications, May 2009 (online).

Digital Library

Google Scholar

[4]

James, A. and Sebe, N. 2007. Multimodal human-computer interaction: A survey. Computer Vision and Image Understanding, vol. 108, no. 1--2, pp. 116--134, Oct.--Nov. 2007.

Digital Library

Google Scholar

[5]

Mo, Z. and Neumann, U., 2007. A Framework for Gesture Interface Design. Journal of Multimedia, vol. 2, no. 1, pp. 1--9, Feb. 2007.

Crossref

Google Scholar

Cited By

View all

Rahman AAbdikebir M(2024)Answering Mickey Mouse: A Novel Authoring-Based Learning Movie System to Promote Active Movie Watching for the Young ViewersIntelligent Systems and Applications10.1007/978-3-031-47718-8_55(862-881)Online publication date: 14-Feb-2024
https://doi.org/10.1007/978-3-031-47718-8_55
Rahman AMomeni MBraton C(2024)Towards Programmable Context Aware Interaction with Smart Home Internet of ThingsIntelligent Systems and Applications10.1007/978-3-031-47715-7_45(663-681)Online publication date: 30-Jan-2024
https://doi.org/10.1007/978-3-031-47715-7_45
Nikiforov NTsoy TSafin RBai YSvinin MMagid E(2021)Pilot Studies on Avrora Unior Car-Like Robot Control Using GesturesElectromechanics and Robotics10.1007/978-981-16-2814-6_24(271-283)Online publication date: 29-Aug-2021
https://doi.org/10.1007/978-981-16-2814-6_24
Show More Cited By

Index Terms

Motion-path based gesture interaction with smart home services
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Human-Machine Interaction based on Hand Gesture Recognition using Skeleton Information of Kinect Sensor
ICAIT'2018: Proceedings of the 3rd International Conference on Applications in Information Technology

The hand gesture provides a natural and intuitive communication medium for the human and machine interaction. Because, it can use in virtual reality, language detection, computer games, and other human-computer or human-machine instruction applications. ...
User centered gesture development for smart lighting
HCIK '16: Proceedings of HCI Korea

The aim of this study is to investigate hand gesture expression and to understand it when controlling smart lighting system. The technology development has brought us the smart device which we can control multifunction of one or more systems. In order ...
Tracking of deformable human hand in real time as continuous input for gesture-based interaction
IUI '07: Proceedings of the 12th international conference on Intelligent user interfaces

Gesture input is a natural and effective interactive model. The tracking of deformable hand gesture is a very important task in gesture-based interaction. A novel real-time tracking approach is proposed to capture hand motion with single camera. It ...

Comments

Information & Contributors

Information

Published In

MM '09: Proceedings of the 17th ACM international conference on Multimedia

October 2009

1202 pages

ISBN:9781605586083

DOI:10.1145/1631272

General Chairs:
Wen Gao
Peking University, China
,
Yong Rui
Microsoft, China
,
Alan Hanjalic
Delft University of Technology, The Netherlands
,
Program Chairs:
Changsheng Xu
Institute of Automation, Chinese Academy of Sciences, China
,
Eckehard Steinbach
Technical University of Munich, Germany
,
Abdulmotaleb El Saddik
University of Ottawa, Canada
,
Michelle Zhou
IBM T. J. Watson Research Center, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM09

Sponsor:

SIGMM

MM09: ACM Multimedia Conference

October 19 - 24, 2009

Beijing, China

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
1,024
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rahman AAbdikebir M(2024)Answering Mickey Mouse: A Novel Authoring-Based Learning Movie System to Promote Active Movie Watching for the Young ViewersIntelligent Systems and Applications10.1007/978-3-031-47718-8_55(862-881)Online publication date: 14-Feb-2024
https://doi.org/10.1007/978-3-031-47718-8_55
Rahman AMomeni MBraton C(2024)Towards Programmable Context Aware Interaction with Smart Home Internet of ThingsIntelligent Systems and Applications10.1007/978-3-031-47715-7_45(663-681)Online publication date: 30-Jan-2024
https://doi.org/10.1007/978-3-031-47715-7_45
Nikiforov NTsoy TSafin RBai YSvinin MMagid E(2021)Pilot Studies on Avrora Unior Car-Like Robot Control Using GesturesElectromechanics and Robotics10.1007/978-981-16-2814-6_24(271-283)Online publication date: 29-Aug-2021
https://doi.org/10.1007/978-981-16-2814-6_24
Lu YLv SWang X(2019)Towards Location Independent Gesture Recognition with Commodity WiFi DevicesElectronics10.3390/electronics81010698:10(1069)Online publication date: 20-Sep-2019
https://doi.org/10.3390/electronics8101069
Delamare WSilpasuwanchai CSarcar SShiraki TRen XLee BLee GScott STory MKim J(2019)On Gesture CombinationProceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces10.1145/3343055.3359706(135-146)Online publication date: 10-Nov-2019
https://dl.acm.org/doi/10.1145/3343055.3359706
Chen FDeng JPang ZBaghaei Nejad MYang HYang G(2018)Finger Angle-Based Hand Gesture Recognition for Smart Infrastructure Using Wearable Wrist-Worn CameraApplied Sciences10.3390/app80303698:3(369)Online publication date: 3-Mar-2018
https://doi.org/10.3390/app8030369
Song ELee HChoi JLee S(2018)AHD: Thermal Image-Based Adaptive Hand Detection for Enhanced Tracking SystemIEEE Access10.1109/ACCESS.2018.28109516(12156-12166)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2810951
Suresh Kumar NThangamani M(2018)Parallel Semi‐supervised enhanced fuzzy Co‐Clustering (PSEFC) and Rapid Association Rule Mining (RARM) based frequent route mining algorithm for travel sequence recommendation on big social mediaConcurrency and Computation: Practice and Experience10.1002/cpe.483731:14Online publication date: 27-Jul-2018
https://doi.org/10.1002/cpe.4837
Shin SBaek YLee JEun YSon S(2017)Korean sign language recognition using EMG and IMU sensors based on group-dependent NN models2017 IEEE Symposium Series on Computational Intelligence (SSCI)10.1109/SSCI.2017.8280908(1-7)Online publication date: Nov-2017
https://doi.org/10.1109/SSCI.2017.8280908
Rau PGong YHuang HWen J(2016)A Systematic Study for Smart Residential Thermostats: User Needs for the Input, Output, and Intelligence LevelBuildings10.3390/buildings60200196:2(19)Online publication date: 29-Apr-2016
https://doi.org/10.3390/buildings6020019
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Human-Machine Interaction based on Hand Gesture Recognition using Skeleton Information of Kinect Sensor

User centered gesture development for smart lighting

Tracking of deformable human hand in real time as continuous input for gesture-based interaction

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations