demonstration

Designing multiuser multimodal gestural interactions for the living room

Authors:

Sriganesh Madhvanath,

Ramadevi Vennelakanti,

Anbumani Subramanian,

Ankit Shekhawat,

Prasenjit Dey,

Amit RajanAuthors Info & Claims

ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction

Pages 61 - 62

https://doi.org/10.1145/2388676.2388693

Published: 22 October 2012 Publication History

Get Access

Abstract

Most work in the space of multimodal and gestural interaction has focused on single user productivity tasks. The design of multimodal, freehand gestural interaction for multiuser lean-back scenarios is a relatively nascent area that has come into focus because of the availability of commodity depth cameras. In this paper, we describe our approach to designing multimodal gestural interaction for multiuser photo browsing in the living room, typically a shared experience with friends and family. We believe that our learnings from this process will add value to the efforts of other researchers and designers interested in this design space.

Supplementary Material

JPG File (de113.jpg)

Download
11.23 KB

suppl.mov (de113.wmv)

Supplemental video

Download
29.66 MB

References

[1]

Dey, P., Madhvanath, S., Ranjan, A. and Das, S. 2011. An Exploration of Gesture-Speech Multimodal Patterns for Touch Interfaces. 3rd International Conference on Human Computer Interaction, April 7 - 10 2011, Bangalore, India.

Digital Library

Google Scholar

[2]

Dey, P., Selvaraj, M. and Lee, B. 2011. Robust User Context Analysis for Multimodal Interfaces. ICMI 2011: 13th International Conference on Multimodal Interaction, November 14-18, 2011, Alicante, Spain.

Digital Library

Google Scholar

[3]

Perron, L. 2007. What gestures to perform a collaborative storytelling? In ICVS'07: Proc. 4th Intl. Conf. on virtual storytelling: Using virtual reality technologies for storytelling (2007).

Digital Library

Google Scholar

[4]

Suryanarayan, P., Subramanian, A. and Mandalapu, D. 2010. 'Dynamic Hand Pose Recognition Using Depth Data'. 20th International Conference on Pattern Recognition (ICPR), Istanbul, Turkey, August 23-26, 2010

Digital Library

Google Scholar

[5]

http://www.hpl.hp.com/india/research/MMI.html.

Google Scholar

Cited By

View all

Wang INarayana PPatil DBangar RDraper BBeveridge RRuiz J(2021)It’s a Joint Effort: Understanding Speech and Gesture in Collaborative TasksHuman-Computer Interaction. Interaction Techniques and Novel Applications10.1007/978-3-030-78465-2_13(159-178)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78465-2_13
Vennelakanti RSubramanian AMadhvanath SDey P(2013)Factors of Influence in Co-located Multimodal InteractionsIntelligent Interactive Technologies and Multimedia10.1007/978-3-642-37463-0_21(231-245)Online publication date: 2013
https://doi.org/10.1007/978-3-642-37463-0_21

Index Terms

Designing multiuser multimodal gestural interactions for the living room
1. Human-centered computing
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments
      1. Integrated and visual development environments

Recommendations

Tangible Meets Gestural: Comparing and Blending Post-WIMP Interaction Paradigms
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

More and more objects of our everyday environment are becoming smart and connected, offering us new interaction possibilities. Tangible interaction and gestural interaction are promising communication means with these objects in this post-WIMP ...
A Touchless Gestural System for Extended Information Access Within a Campus
SIGUCCS '17: Proceedings of the 2017 ACM SIGUCCS Annual Conference

In the last two decades, we have witnessed a growing spread of touchless interfaces, facilitated by higher performances of computational systems, as well as the increased availability of cheaper sensors and devices. Putting the focus on gestural input, ...
Eliciting tangible and gestural user interactions with and on a cooking pan
MuC '20: Proceedings of Mensch und Computer 2020

Embedding computational capabilities in everyday objects enables novel interaction concepts that are seamlessly integrated in users' everyday tasks. We conducted an elicitation study to investigate how subjects use a pan to control functions related to ...

Comments

Information & Contributors

Information

Published In

ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction

October 2012

636 pages

ISBN:9781450314671

DOI:10.1145/2388676

General Chairs:
Louis-Philippe Morency
University of Southern California, USA
,
Dan Bohus
Microsoft Research, USA
,
Hamid Aghajan
Stanford University, USA
,
Program Chairs:
Justine Cassell
Carnegie Mellon University, USA
,
Anton Nijholt
University of Twente, Netherlands
,
Julien Epps
The University of New South Wales, Australia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

ICMI '12

Sponsor:

SIGCHI

ICMI '12: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 22 - 26, 2012

California, Santa Monica, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
254
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 31 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wang INarayana PPatil DBangar RDraper BBeveridge RRuiz J(2021)It’s a Joint Effort: Understanding Speech and Gesture in Collaborative TasksHuman-Computer Interaction. Interaction Techniques and Novel Applications10.1007/978-3-030-78465-2_13(159-178)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78465-2_13
Vennelakanti RSubramanian AMadhvanath SDey P(2013)Factors of Influence in Co-located Multimodal InteractionsIntelligent Interactive Technologies and Multimedia10.1007/978-3-642-37463-0_21(231-245)Online publication date: 2013
https://doi.org/10.1007/978-3-642-37463-0_21

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

Tangible Meets Gestural: Comparing and Blending Post-WIMP Interaction Paradigms

A Touchless Gestural System for Extended Information Access Within a Campus

Eliciting tangible and gestural user interactions with and on a cooking pan

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations