poster

Ubiquitous shortcuts: mnemonics by just taking photos

Authors:

Mikko J. Rissanen,

Owen Noel Newton Fernando,

Horathalge Iroshan,

Samantha Vu,

Natalie Pang,

Schubert FooAuthors Info & Claims

CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Pages 1641 - 1646

https://doi.org/10.1145/2468356.2468650

Published: 27 April 2013 Publication History

Get Access

Abstract

Ubiquitous Shortcuts is an image processing based method for making and using mnemonics set onto the real world using smartphones or other computing systems. The mnemonics can be created by taking photos of the user's vicinity and by binding them onto command sequences. The mnemonic is triggered every time a similar photo is taken. Our method uses natural feature matching algorithms and end-user programming approaches. The mnemonics can be concatenated into more complex command sequences. Thus, limited user input is realized by just taking photos with a camera embedded into a finger-ring, which enables rapid, subtle and socially acceptable user interaction. Our method can be used as semi-automatic way of achieving location and context sensitive services, activity recognition or tangible interaction.

References

[1]

Ni, T. and Baudisch, P. Disappearing mobile devices. In Proc. UIST 2009, 101--110.

Digital Library

Google Scholar

[2]

Tan, D., Morris, D. and Saponas, T.S. Interfaces on the go. XRDS 16, 4 (June 2010), 30--34.

Digital Library

Google Scholar

[3]

Ljungstrand, P. and Holmquist, L.E. 1999. WebStickers: using physical objects as WWW bookmarks. In CHI EA '99, 332--333.

Digital Library

Google Scholar

[4]

Williamson, J.R., Crossan, A. and Brewster, S. Multimodal mobile interactions: usability studies in real world settings. In Proc. ICMI 2011, 361--368.

Digital Library

Google Scholar

[5]

Costanza, E., Inverso, S.A., Allen, R. and Maes, P. Intimate interfaces in action: assessing the usability and subtlety of EMG-based motionless gestures. In Proc. CHI 2007, 819--828.

Digital Library

Google Scholar

[6]

Montero, C.S., Alexander, J., Marshall, M.T. and Subramanian, S. Would you do that?: understanding social acceptance of gestural interfaces. In Proc MobileHCI 2010, 275--278.

Digital Library

Google Scholar

[7]

Oulasvirta, A., Tamminen, S., Roto, V. and Kuorelahti, J. Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. In Proc CHI 2005, 919--928.

Digital Library

Google Scholar

[8]

van Dyk, T., Renaud, K. and van Biljon, J. Moses method for selecting senior mobile phones: supporting design & choice for the elderly. In Proc. SAICSIT 2012, 277--285.

Digital Library

Google Scholar

[9]

Nanayakkara, S., Shilkrot, R. and Maes, P. EyeRing: a finger-worn assistant. In Proc CHI EA 2012, 1961--1966.

Digital Library

Google Scholar

[10]

Angeslevä, J., O'Modhrain, S., Oakley, I., Hughes, S. Body mnemonics. In Proc. PI 2003 Workshop on Real World User Interfaces.

Google Scholar

[11]

Fukumoto, M. and Suenaga, Y. 1994. "FingeRing": a full-time wearable interface. In Proc. CHI '94, 81--82.

Digital Library

Google Scholar

[12]

Blackwell, A.F., Cognitive dimensions of tangible programming techniques. In Proc. of PPIG 2003, 391405.

Google Scholar

[13]

Choudhury, T., Consolvo, S., Harrison, B., LaMarca, A., LeGrand, L., Rahimi, A., Rea, A., Borriello, G., Hemingway, B., Klasnja, P., Koscher, K., Landay, J., Lester, J., Wyatt, D. and Haehnel, D. The mobile sensing platform: An embedded activity recognition system. IEEE Pervasive Computing, 7(2) (April-June 2008), 32--41.

Digital Library

Google Scholar

Cited By

View all

Koelle MAnanthanarayan SBoll SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Social Acceptability in HCI: A Survey of Methods, Measures, and Design StrategiesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376162(1-19)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376162
Pohl HMuresan AHornbæk KBrewster SFitzpatrick GCox AKostakos V(2019)Charting Subtle Interaction in the HCI LiteratureProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300648(1-15)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300648
Shilkrot RHuber JBoldu RMaes PNanayakkara S(2017)FingerReader: A Finger-Worn Assistive AugmentationAssistive Augmentation10.1007/978-981-10-6404-3_9(151-175)Online publication date: 12-Nov-2017
https://doi.org/10.1007/978-981-10-6404-3_9
Show More Cited By

Index Terms

Ubiquitous shortcuts: mnemonics by just taking photos
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
  2. Computer graphics
    1. Image manipulation
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

The case for end-user programming of ubiquitous computing environments
FoSER '10: Proceedings of the FSE/SDP workshop on Future of software engineering research

Gone are the days that computers will be used by select users sitting at a desk with a mouse and keyboard. The next wave of computing, ubiquitous computing, is upon us. With smart phones, tablet computers, and embedded sensors/actuators flourishing, ...
How do users think about ubiquitous computing?
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing Systems

As ubiquitous computing technology migrates into the home environment, there has been a concurrent effort to allow users to build and customize such technologies to suit their own specific needs. Many tools have been built to enable users with little or ...
Ubiquitous Computing: Are We There Yet?

The widespread deployment of technologies like mobile phones continues to drive new applications and to open research opportunities.

Comments

Information & Contributors

Information

Published In

CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

April 2013

3360 pages

ISBN:9781450319522

DOI:10.1145/2468356

General Chair:
Wendy E. Mackay
INRIA
,
Program Chairs:
Stephen Brewster
Glasgow University
,
Susanne Bødker
University of Aarhus

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Check for updates

Author Tags

Qualifiers

Poster

Conference

CHI '13

Sponsor:

SIGCHI

CHI '13: CHI Conference on Human Factors in Computing Systems

April 27 - May 2, 2013

Paris, France

Acceptance Rates

CHI EA '13 Paper Acceptance Rate 630 of 1,963 submissions, 32%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
206
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Koelle MAnanthanarayan SBoll SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Social Acceptability in HCI: A Survey of Methods, Measures, and Design StrategiesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376162(1-19)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376162
Pohl HMuresan AHornbæk KBrewster SFitzpatrick GCox AKostakos V(2019)Charting Subtle Interaction in the HCI LiteratureProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300648(1-15)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300648
Shilkrot RHuber JBoldu RMaes PNanayakkara S(2017)FingerReader: A Finger-Worn Assistive AugmentationAssistive Augmentation10.1007/978-981-10-6404-3_9(151-175)Online publication date: 12-Nov-2017
https://doi.org/10.1007/978-981-10-6404-3_9
Shilkrot RHuber JSteimle JNanayakkara SMaes P(2015)Digital DigitsACM Computing Surveys10.1145/282899348:2(1-29)Online publication date: 21-Nov-2015
https://dl.acm.org/doi/10.1145/2828993
Pang NFoo SRaamkumar AXue Zhang Vu S(2015)Object recognition-based mnemonics mobile app for senior adults communication2015 6th International Conference on Computing, Communication and Networking Technologies (ICCCNT)10.1109/ICCCNT.2015.7395164(1-6)Online publication date: Jul-2015
https://doi.org/10.1109/ICCCNT.2015.7395164
Harlalka APJ PSinha KSingh NKumar JIlavarasan PDalvi G(2014)TangemonProceedings of the 6th Indian Conference on Human-Computer Interaction10.1145/2676702.2676718(126-131)Online publication date: 7-Dec-2014
https://dl.acm.org/doi/10.1145/2676702.2676718
Rissanen MVu SFernando OPang NFoo S(2013)Subtle, Natural and Socially Acceptable Interaction Techniques for Ringterfaces -- Finger-Ring Shaped User InterfacesProceedings of the First International Conference on Distributed, Ambient, and Pervasive Interactions - Volume 802810.1007/978-3-642-39351-8_6(52-61)Online publication date: 21-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39351-8_6

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

The case for end-user programming of ubiquitous computing environments

How do users think about ubiquitous computing?

Ubiquitous Computing: Are We There Yet?

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations