abstract

Designing Speech, Acoustic and Multimodal Interactions

Authors:

Keisuke NakamuraAuthors Info & Claims

CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 601 - 608

https://doi.org/10.1145/3027063.3027086

Published: 06 May 2017 Publication History

Get Access

Abstract

Traditional interfaces are continuously being replaced by mobile, wearable, or pervasive interfaces. Yet when it comes to the input and output modalities enabling our interactions, we have yet to fully embrace some of the most natural forms of communication and information processing that humans possess: speech, language, gestures, thoughts. Very little HCI attention has been dedicated to designing and developing spoken language, acoustic-based, or multimodal interaction techniques, especially for mobile and wearable devices. In addition to the enormous, recent engineering progress in processing such modalities, there is now sufficient evidence that many real-life applications do not require 100% accuracy of processing multimodal input to be useful, particularly if such modalities complement each other. This multidisciplinary, one-day workshop will bring together interaction designers, usability researchers, and general HCI practitioners to analyze the opportunities and directions to take in designing more natural interactions especially with mobile and wearable devices, and to look at how we can leverage recent advances in speech, acoustic, and multimodal processing.

References

[1]

Aylett, M. et al. (2014). None of a CHInd: relationship counselling for HCI and speech technology. In Alt.CHI '14

Digital Library

Google Scholar

[2]

Business Insider (2012). Frankly, It's Concerning that Apple is Still Advertising A Product as Flawed as Siri. http://www.businessinsider.com, 2012.

Google Scholar

[3]

Gizmodo (2011). Siri is Apple's Broken Promise. http://www.gizmodo.com, 2011.

Google Scholar

[4]

Munteanu, C. et al. (2006). Automatic speech recognition for webcasts: how good is good enough and what to do when it isn't. Proc. of ICMI.

Digital Library

Google Scholar

[5]

Munteanu, C. and Penn, G. (2016). Speech-based interaction. Course, CHI 2011, 2012, 2013, 2014, 2015, 2016

Digital Library

Google Scholar

[6]

Munteanu, C. et al. (2013). We need to talk: HCI and the delicate topic of speech-based interaction. Panel, ACM SIGCHI 2013.

Digital Library

Google Scholar

[7]

Munteanu, C. et al (2016). Designing Spoken Language Interaction. CHI 2014 & 2016 Workshops

Google Scholar

[8]

Oviatt, S. (2003). Advances in Robust Multimodal Interface Design. IEEE Comput. Graph. Appl. 23--5.

Digital Library

Google Scholar

[9]

Penn, G. and Zhu, X. (2008). A critical reassessment of evaluation baselines for speech summarization. In Proc. of ACL-HLT.

Google Scholar

Cited By

View all

Murad CMunteanu CCowan BClark LPorcheron MFischer JCandello HLangevin R(2023)Is CUI Design Ready Yet? A Workshop on Community Practices and Gaps in CUI Design & Resource DevelopmentProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597440(1-5)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597440
Murad CCandello HMunteanu C(2023)What’s The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface DesignProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597129(1-16)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597129
Lein MDonnermann MSteinhaeusser SLugrin BCastellano GRiek LCakmak MLeite I(2023)Using a Social Robot as a Hotel Assessment ToolCompanion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3580054(117-121)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3580054
Show More Cited By

Index Terms

Designing Speech, Acoustic and Multimodal Interactions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Designing Speech and Multimodal Interactions for Mobile, Wearable, and Pervasive Applications
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Traditional interfaces are continuously being replaced by mobile, wearable, or pervasive interfaces. Yet when it comes to the input and output modalities enabling our interactions, we have yet to fully embrace some of the most natural forms of ...
Speech-based interaction: myths, challenges, and opportunities
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

HCI research has for long been dedicated to better and more naturally facilitating information transfer between humans and machines. Unfortunately, humans' most natural form of communication, speech, is also one of the most difficult modalities to be ...
Speech-based interaction: myths, challenges, and opportunities
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

Human-Computer Interaction (HCI) research has for long been dedicated to better and more naturally facilitating information transfer between humans and machines. Unfortunately, humans' most natural form of communication, speech, is also one of the most ...

Comments

Information & Contributors

Information

Published In

CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2017

3954 pages

ISBN:9781450346566

DOI:10.1145/3027063

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 May 2017

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI EA '17 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
663
Total Downloads

Downloads (Last 12 months)52
Downloads (Last 6 weeks)9

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Murad CMunteanu CCowan BClark LPorcheron MFischer JCandello HLangevin R(2023)Is CUI Design Ready Yet? A Workshop on Community Practices and Gaps in CUI Design & Resource DevelopmentProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597440(1-5)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597440
Murad CCandello HMunteanu C(2023)What’s The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface DesignProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597129(1-16)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597129
Lein MDonnermann MSteinhaeusser SLugrin BCastellano GRiek LCakmak MLeite I(2023)Using a Social Robot as a Hotel Assessment ToolCompanion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3580054(117-121)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3580054
Viswanathan SGuillot FChang MGrasso ARenders J(2022)Addressing Hiccups in Conversations with Recommender SystemsProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533491(1243-1259)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533491
Murad CMunteanu CCowan BClark LPorcheron MCandello HSchlögl SAylett MSin JMoore RHughes GKu A(2021)Let’s Talk About CUIs: Putting Conversational User Interface Design Into PracticeExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3441336(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3441336
Funk MCunningham CKanver DSaikalis CPansare R(2020)Usable and Acceptable Response Delays of Conversational Agents in Automotive User Interfaces12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3409120.3410651(262-269)Online publication date: 21-Sep-2020
https://dl.acm.org/doi/10.1145/3409120.3410651
Murad CMunteanu CTorres MSchlögl SClark LPorcheron M(2020)Alexa, How Do I Build a VUI Curriculum?Proceedings of the 2nd Conference on Conversational User Interfaces10.1145/3405755.3406137(1-3)Online publication date: 22-Jul-2020
https://dl.acm.org/doi/10.1145/3405755.3406137
Candello HMunteanu CClark LSin JTorres MPorcheron MMyers CCowan BFischer JSchlögl SMurad CReeves SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)CUI@CHI: Mapping Grand Challenges for the Conversational User Interface CommunityExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3375152(1-8)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3375152
Feng FLi PStockman T(2020)Exploring crossmodal perceptual enhancement and integration in a sequence-reproducing task with cognitive primingJournal on Multimodal User Interfaces10.1007/s12193-020-00326-y15:1(45-59)Online publication date: 13-Jul-2020
https://doi.org/10.1007/s12193-020-00326-y
Kondratova IEmond B(2020)Voice Interaction for Training: Opportunities, Challenges, and Recommendations from HCI PerspectiveLearning and Collaboration Technologies. Human and Technology Ecosystems10.1007/978-3-030-50506-6_6(59-75)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-50506-6_6
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Designing Speech and Multimodal Interactions for Mobile, Wearable, and Pervasive Applications

Speech-based interaction: myths, challenges, and opportunities

Speech-based interaction: myths, challenges, and opportunities