research-article

Strengths and weaknesses of software architectures for the rapid creation of tangible and multimodal interfaces

Authors:

Dominique Guinard,

Rolf IngoldAuthors Info & Claims

TEI '08: Proceedings of the 2nd international conference on Tangible and embedded interaction

Pages 47 - 54

https://doi.org/10.1145/1347390.1347403

Published: 18 February 2008 Publication History

Abstract

This paper reviews the challenges associated with the development of tangible and multimodal interfaces and exposes our experiences with the development of three different software architectures to rapidly prototype such interfaces. The article first reviews the state of the art, and further compares existing systems with our approaches. Finally, the article stresses the major issues associated with the development of toolkits allowing the creation of multimodal and tangible interfaces, and presents our future objectives.

References

[1]

Ballagas, R., Ringel, M., Stone, M., Brochers, J. iStuff: A Physical User Interface Toolkit for Ubiquitous Computing Envirnments. Proceedings of CHI'03, 2003.

Digital Library

[2]

Benoit, A., Bonnaud, L., Caplier, L., Damousis, I., Tzovaras, D., Jourde, F., Nigay, L., Serrano, M., Lawson, J.-Y. Multimodal Signal Processing and Interaction for a Driving Simulator: Component-based Architecture. Journal on Multimodal User Interfaces, Vol 1, No 1 (2007).

[3]

Bolt, R. Put-that-there: voice and gesture at the graphics interface. Computer Graphics, 14(3), 1980.

Digital Library

[4]

Bouchet, J., Nigay, L., and Ganille, T. ICARE Software Components for Rapidly Developing Multimodal Interfaces. Proceedings of ICMI'2004, State College, Pennsylvania, USA, Oct. 2004.

Digital Library

[5]

Bourguet, M. L. A Toolkit for Creating and Testing Multimodal Interface Designs. Proceedings of UIST'02, Paris, Oct. 2002, pp. 29--30.

[6]

Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., Clow, J. QuickSet: multimodal interaction for distributed applications. In Proceedings of the Fifth ACM international Conference on Multimedia, Seattle, USA, 1997.

Digital Library

[7]

Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J. and Young, R. Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The CARE properties. Proceedings of INTERACT'95 conference, Lillehammer, Norway, June 1995, pp. 115--120.

[8]

Dumas, B., Lalanne, D., Ingold, R. Prototyping Multimodal Interfaces with the SMUIML Modeling Language. To be published in Proc. of CHI 2008 workshop : User Interface Description Languages for Next Generation User Interfaces (organizers: O. Shaer, R. Jacob, M. Green, K. Luyten), Florence, Italy, 2008.

Digital Library

[9]

Flippo, F., Krebs, A. and Marsic, I. A Framework for Rapid Development of Multimodal Interfaces. Proc. Of ICMI'2003, Vancouver, BC, Nov. 5--7, 2003.

Digital Library

[10]

Greenberg, S., Fitchett, C. Phidgets: easy development of physical interfaces through physical widgets. User Interface Software & Technology, CHI Letters 2001.

Digital Library

[11]

Ishii, H., Ullmer, B. Tangible bits: toward seamless interfaces between people, bits and atoms. Proceedings of CHI'97, New York, USA, 1997.

Digital Library

[12]

Kaltenbrunner, M., Bencina, R. ReacTIVision: A Computer-Vision Framework for Table-Based Tangible Interaction. Proceedings of TEI'07. Baton Rouge, Louisiana, 2007.

Digital Library

[13]

Klemmer, S. R., Li, J., Lin, J., and Landay, J. A. Papier-Mâché: Toolkit Support for Tangible Input. CHI Letters: CHI 2004. 6(1).

[14]

Krahnstoever, N., Kettebekov, S. and Yeasin, M. and Sharma, R. A real-time framework for natural multimodal interaction with large screen displays. Proc. of ICMI 2002, Pittsburgh, PA, USA, Oct. 2002.

Digital Library

[15]

Mazalek, A. Tangible Toolkits: Integrating Application Development across Diverse Multi-User and Tangible Interaction Platforms. Let's Get Physical Workshop, DCC'06, Eindhoven, Netherlands, July 2006.

[16]

Nigay, L., Coutaz, J. A design space for multimodal interfaces: concurrent processing and data fusion. Proc. INTERCHI 1993 Human Factors in Computing Systems Amsterdam.

Digital Library

[17]

Tse, E., Greenberg, S. Rapidly prototyping Single Display Groupware through the SDGToolkit. Proceedings of the Fifth Conference on Australasian User interfaces (AUIC'04). Dunedin, NZ, 2004.

Digital Library

[18]

Wahlster, W. SmartKom: Fusion and Fission of Speech, Gestures, and Facial Expressions. Proc. of the 1st International Workshop on Man-Machine Symbiotic Systems, Kyoto, Japan, 2002. p. 213--225.

[19]

Walker, W., Lamere, P., Kwok P., Raj, B., Singh, R., Gouvea, E., Wolf, P., and Woelfel, J. Sphinx-4: A flexible open source framework for speech recognition. Sun Microsystems, Tech. Rep. TR-2004-139, 2004.

Digital Library

Cited By

Meissner JStrohmayer AWright PFitzpatrick GMandryk RHancock MPerry MCox A(2018)A Schnittmuster for Crafting Context-Sensitive ToolkitsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173725(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173725
Mecke R(2017)Teilprojekt TP 4 – InteraktionAngewandte Virtuelle Techniken im Produktentstehungsprozess10.1007/978-3-662-49317-5_6(223-286)Online publication date: 21-Feb-2017
https://doi.org/10.1007/978-3-662-49317-5_6
Schüssel FHonold FBubalo NWeber MHuckauf A(2017)Management of Multimodal User Interaction in Companion-SystemsCompanion Technology10.1007/978-3-319-43665-4_10(187-207)Online publication date: 5-Dec-2017
https://doi.org/10.1007/978-3-319-43665-4_10
Show More Cited By

Index Terms

Strengths and weaknesses of software architectures for the rapid creation of tangible and multimodal interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
    2. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
    2. Interaction design theory, concepts and paradigms

Recommendations

Multimodal user interfaces for smart environments: the multi-access service platform
AVI '08: Proceedings of the working conference on Advanced visual interfaces

User interface modeling is a well accepted approach to handle increasing user interface complexity. The approach presented in this paper utilizes user interface models at runtime to provide a basis for user interface distribution and synchronization. ...
Software Engineering for User Interfaces

The discipline of software engineering can be extended in a natural way to deal with the issues raised by a systematic approach to the design of human-machine interfaces. Two main points are made: that the user should be treated as part of the system ...
Using consensus methods to construct adaptive interfaces in multimodal web-based systems

This paper presents a concept of adaptive development of user interfaces in multimodal web-based systems. Today, it is crucial for general access web-based systems that the user interface is properly designed and adjusted to user needs and capabilities. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '08: Proceedings of the 2nd international conference on Tangible and embedded interaction

February 2008

267 pages

ISBN:9781605580043

DOI:10.1145/1347390

Conference Chairs:
Albrecht Schmidt
University of Duisburg-Essen, Germany
,
Hans Gellersen
Lancaster University, UK
,
Program Chairs:
Elise van den Hoven
Eindhoven University of Technology, NL
,
Ali Mazalek
Georgia Institute of Technology, USA
,
Publications Chairs:
Paul Holleis
University of Duisburg-Essen, Germany
,
Nicolas Villar
Lancaster University, UK

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Duisburg-Essen
Nokia Corporation, Finland
Microsoft Research, Cambridge, UK
Fraunhofer IAIS, Birlinghoven
Bonn-Aachen International Center for Information Technology (B-IT)

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 February 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEI08

Sponsor:

TEI08: Conference on Tangible and Embedded Interaction 2008

February 18 - 20, 2008

Bonn, Germany

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
741
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Meissner JStrohmayer AWright PFitzpatrick GMandryk RHancock MPerry MCox A(2018)A Schnittmuster for Crafting Context-Sensitive ToolkitsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173725(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173725
Mecke R(2017)Teilprojekt TP 4 – InteraktionAngewandte Virtuelle Techniken im Produktentstehungsprozess10.1007/978-3-662-49317-5_6(223-286)Online publication date: 21-Feb-2017
https://doi.org/10.1007/978-3-662-49317-5_6
Schüssel FHonold FBubalo NWeber MHuckauf A(2017)Management of Multimodal User Interaction in Companion-SystemsCompanion Technology10.1007/978-3-319-43665-4_10(187-207)Online publication date: 5-Dec-2017
https://doi.org/10.1007/978-3-319-43665-4_10
Lalanne D(2014)Document-Centric and Multimodal Meeting AssistantsMultimodal Interactive Systems Management10.1201/b15535-7(59-70)Online publication date: 2-Apr-2014
https://doi.org/10.1201/b15535-7
Elouali NLe Pallec XRouillard JTarby JJones MPalanque PSchmidt AGrossman T(2014)MIMICCHI '14 Extended Abstracts on Human Factors in Computing Systems10.1145/2559206.2581222(2323-2328)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2559206.2581222
LaViola Jr. JBuchanan SPittman C(2014)Multimodal Input for Perceptual User InterfacesInteractive Displays10.1002/9781118706237.ch9(285-312)Online publication date: 12-Jul-2014
https://doi.org/10.1002/9781118706237.ch9
Schwarz JMankoff JHudson SPierce JAgrawala MKlemmer S(2011)Monte carlo methods for managing interactive state, action and feedback under uncertaintyProceedings of the 24th annual ACM symposium on User interface software and technology10.1145/2047196.2047227(235-244)Online publication date: 16-Oct-2011
https://dl.acm.org/doi/10.1145/2047196.2047227
Tang WLo KChan AChan SLeong HNgai GTan DBegole BKellogg W(2011)i*ChameleonCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979703(305-310)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1979742.1979703
Israel JBelaifa OGispen AStark RGross MNunes NDo EBrewster SOakley I(2011)An object-centric interaction framework for tangible interfaces in virtual environmentsProceedings of the fifth international conference on Tangible, embedded, and embodied interaction10.1145/1935701.1935777(325-332)Online publication date: 22-Jan-2011
https://dl.acm.org/doi/10.1145/1935701.1935777
Dumas BLalanne DIngold RCrowley JIvanov YWren CGatica-Perez DJohnston MStiefelhagen R(2009)HephaisTKProceedings of the 2009 international conference on Multimodal interfaces10.1145/1647314.1647360(231-232)Online publication date: 2-Nov-2009
https://dl.acm.org/doi/10.1145/1647314.1647360
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents