Article

TinyMotion: camera phone based interaction methods

Authors:

Jingtao Wang,

John CannyAuthors Info & Claims

CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems

Pages 339 - 344

https://doi.org/10.1145/1125451.1125526

Published: 21 April 2006 Publication History

Get Access

Abstract

This paper presents TinyMotion, a pure software approach that detects the movements of cell phones in real time by analyzing image sequences captured by the built-in camera. Typical movements that TinyMotion detects include - horizontal and vertical movements, rotational movements and tilt movements. In contrast to earlier work, TinyMotion does not require additional sensors, special scenes or backgrounds and can run on today's main-stream camera phones without hardware modification. We describe the design and implementation of TinyMotion and analyze the potential interactions that can leverage TinyMotion. Three applications and two games were created to test TinyMotion. Benchmarking results and usability study show that TinyMotion can detect camera movement reliably under most background and illumination conditions.

References

[1]

BREW (Binary Runtime Environment for Wireless), Qualcomm Corp, http://brew.qualcomm.com

Google Scholar

[2]

Camera Phone Market Continues to Boom - 200% Growth in Annual Shipments, http://www.instat.com/press.asp?ID=1181&sku=IN0401703WH

Google Scholar

[3]

Hansen, T., Eriksson, E., Lykke-Olesen, A., Mixed Interaction Space - Designing for Camera Based Interaction with Mobile Devices, In Extended Proc. CHI 2005

Digital Library

Google Scholar

[4]

Harrison, B. L., Fishkin, K., A. et al, Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In Proc. CHI 1998, p. 17--24.

Digital Library

Google Scholar

[5]

Hinckley, K., Pierce, J., Sinclair, M., Horvitz, E., Sensing Techniques for Mobile Interaction. In Proc. UIST 2000, p. 91--100.

Digital Library

Google Scholar

[6]

Kuhn, P., Algorithms, Complexity Analysis and VLSI Architectures for MPEG-4 Motion Estimation, Kluwer Academic Publishers.

Digital Library

Google Scholar

[7]

Rohs, M., Zweifel, P., A Conceptual Framework for Camera Phone-based Interaction Techniques, In Proc PERVASIVE 2005

Digital Library

Google Scholar

[8]

SemaCode, http://semacode.org/.

Google Scholar

[9]

Wigdor, D., Balakrishnan, R., TiltText: Using tilt for text input to mobile phones. In Proc UIST 2003.

Digital Library

Google Scholar

[10]

Yee, K. P., Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In Proc ACM CHI 2003, pp1--8.

Digital Library

Google Scholar

Cited By

View all

Pal A(2020)MicaPen: A Pen to Write in Air Using Mica Motes2020 16th International Conference on Distributed Computing in Sensor Systems (DCOSS)10.1109/DCOSS49796.2020.00035(151-154)Online publication date: May-2020
https://doi.org/10.1109/DCOSS49796.2020.00035
Turk MHua G(2013)Vision-Based InteractionSynthesis Lectures on Computer Vision10.2200/S00536ED1V01Y201309COV0054:1(1-134)Online publication date: 27-Oct-2013
https://doi.org/10.2200/S00536ED1V01Y201309COV005
Yang XHasan KBruce NIrani PIzadi SQuigley APoupyrev IIgarashi T(2013)Surround-seeProceedings of the 26th annual ACM symposium on User interface software and technology10.1145/2501988.2502049(291-300)Online publication date: 8-Oct-2013
https://dl.acm.org/doi/10.1145/2501988.2502049
Show More Cited By

Index Terms

TinyMotion: camera phone based interaction methods
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
    2. Interaction devices
      1. Touch screens
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Camera phone based motion sensing: interaction techniques, applications and performance study
UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

This paper presents TinyMotion, a pure software approach for detecting a mobile phone user's hand movement in real time by analyzing image sequences captured by the built-in camera. We present the design and implementation of TinyMotion and several ...
Sensing-based interaction for information navigation on handheld displays
MobileHCI '07: Proceedings of the 9th international conference on Human computer interaction with mobile devices and services

Information navigation on handheld displays is characterized by the small display dimensions and limited input capabilities of today's mobile devices. Special strategies are required to help users navigate to off-screen content and develop awareness of ...
SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with motion gesture
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Dictionary-based disambiguation (DBD) is a very popular solution for text entry on mobile phone keypads but suffers from two problems: 1. the resolution of encoding collision (two or more words sharing the same numeric key sequence) and 2. entering out-...

Comments

Information & Contributors

Information

Published In

CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems

April 2006

1914 pages

ISBN:1595932984

DOI:10.1145/1125451

Conference Chair:
Gary Olson
University of Michigan, Ann Arbor, MI
,
Program Chair:
Robin Jeffries
Google, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI06

Sponsor:

CHI06: CHI 2006 Conference on Human Factors in Computing Systems

April 22 - 27, 2006

Québec, Montréal, Canada

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
653
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Pal A(2020)MicaPen: A Pen to Write in Air Using Mica Motes2020 16th International Conference on Distributed Computing in Sensor Systems (DCOSS)10.1109/DCOSS49796.2020.00035(151-154)Online publication date: May-2020
https://doi.org/10.1109/DCOSS49796.2020.00035
Turk MHua G(2013)Vision-Based InteractionSynthesis Lectures on Computer Vision10.2200/S00536ED1V01Y201309COV0054:1(1-134)Online publication date: 27-Oct-2013
https://doi.org/10.2200/S00536ED1V01Y201309COV005
Yang XHasan KBruce NIrani PIzadi SQuigley APoupyrev IIgarashi T(2013)Surround-seeProceedings of the 26th annual ACM symposium on User interface software and technology10.1145/2501988.2502049(291-300)Online publication date: 8-Oct-2013
https://dl.acm.org/doi/10.1145/2501988.2502049
Molineux ACheverst K(2012)A Survey of Mobile Vision Recognition ApplicationsSpeech, Image, and Language Processing for Human Computer Interaction10.4018/978-1-4666-0954-9.ch014(292-309)Online publication date: 2012
https://doi.org/10.4018/978-1-4666-0954-9.ch014
Cheng LHsiao FLiu YChen MKonstan JChi EHöök K(2012)iRotateProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208374(2203-2210)Online publication date: 5-May-2012
https://dl.acm.org/doi/10.1145/2207676.2208374
Baur DBoring SFeiner SKonstan JChi EHöök K(2012)Virtual projectionProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208297(1693-1702)Online publication date: 5-May-2012
https://dl.acm.org/doi/10.1145/2207676.2208297
Zizka JOlwal ARaskar RPierce JAgrawala MKlemmer S(2011)SpeckleSenseProceedings of the 24th annual ACM symposium on User interface software and technology10.1145/2047196.2047261(489-498)Online publication date: 16-Oct-2011
https://dl.acm.org/doi/10.1145/2047196.2047261
Agrawal SConstandache IGaonkar SRoy Choudhury RCaves KDeRuyter FAgrawala ACorner MWetherall D(2011)Using mobile phones to write in airProceedings of the 9th international conference on Mobile systems, applications, and services10.1145/1999995.1999998(15-28)Online publication date: 28-Jun-2011
https://dl.acm.org/doi/10.1145/1999995.1999998
Dinh TKim JLee G(2011)Extracting the Path of Frame Center Points Using Spatial Transformation and Motion EstimationProceedings of the 2011 IEEE 11th International Conference on Computer and Information Technology10.1109/CIT.2011.53(283-290)Online publication date: 31-Aug-2011
https://dl.acm.org/doi/10.1109/CIT.2011.53
Scott MJiang WXie XTien JChen GXiang D(2009)VISIADSProceedings of the 2009 IEEE international conference on Multimedia and Expo10.5555/1698924.1699386(1833-1834)Online publication date: 28-Jun-2009
https://dl.acm.org/doi/10.5555/1698924.1699386
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Camera phone based motion sensing: interaction techniques, applications and performance study

Sensing-based interaction for information navigation on handheld displays

SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with motion gesture