research-article

Evaluation of predictive text and speech inputs in a multimodal mobile route guidance application

Authors:

Ville AntilaAuthors Info & Claims

MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

Pages 355 - 358

https://doi.org/10.1145/1409240.1409287

Published: 02 September 2008 Publication History

Get Access

Abstract

We present initial results from an evaluation of a multimodal interface for a mobile route guidance application providing public transport information in Finland. The application includes a range of input and output modalities, such as speech input and output, a fisheye GUI, and contextual predictive text input. The application has been in public pilot use for almost a year. In this paper we present results from a formal user evaluation, focusing on predictive text input and speech input and output. Speech input outperformed other input methods, even with high error rates and slow response times. However, the domain specific predictive text input was the preferred method, surpassing users' expectations.

References

[1]

Bederson, B. B. Fisheye Menus. Proceedings of ACM Conference on User Interface Software and Technology (UIST 2000), pp. 217--226, ACM Press.

Digital Library

Google Scholar

[2]

Hartikainen, M., Salonen, E.-P. & Turunen, M. Subjective Evaluation of Spoken Dialogue Systems Using SERVQUAL Method. Proceedings of ICSLP 2004: 2273--2276.

Google Scholar

[3]

Turunen, M., Hakulinen, J. Spoken and Multimodal Communication Systems in Mobile Settings. In Verbal and Nonverbal Communication Behaviours, LNAI 4775: 227--241, Springer-Verlag Berlin Heidelberg, 2007.

Digital Library

Google Scholar

[4]

Turunen, M. Hakulinen, J., and Kainulainen, A., Melto, A., and Hurtig, T. Design of a Rich Multimodal Interface for Mobile Spoken Route Guidance. Proceedings of Interspeech 2007 - Eurospeech: 2193--2196, 2007.

Google Scholar

[5]

Turunen, M. Hakulinen, J., and Kainulainen, A., Evaluation of a Spoken Dialogue System with Usability Tests and Longterm Pilot Studies: Similarities and Differences. Proceedings of Interspeech 2006: 1057--1060, 2006.

Google Scholar

[6]

Turunen, M., Hurtig, T., Hakulinen, J., Virtanen, A., and Koskinen, S., Mobile Speech-based and Multimodal Public Transport Information Services. Proceedings of MobileHCI 2006 Workshop on Speech in Mobile and Pervasive Environments, 2006.

Google Scholar

[7]

Turunen, M., Hakulinen, J., Salonen, E.-P., Kainulainen, A., and Helin, L., Spoken and Multimodal Bus Timetable Systems: Design, Development and Evaluation. Proceedings of 10th International Conference on Speech and Computer (SPECOM 2005): 389--392, 2005.

Google Scholar

[8]

Walker, B. N., Nance, A., and Lindsay, J., Spearcons: Speech-based Earcons Improve Navigation Performance in Auditory Menus. Proceedings of ICAD 2006, 2006.

Google Scholar

[9]

Mizobuchi, S, Chignell, M., and Newton, D., Mobile Text Entry: Relationship between Walking Speed and Text Input Task Difficulty. Proceedings of MobileHCI 2005, 2005.

Digital Library

Google Scholar

[10]

MacKenzie, I. S., and Soukoreff, R. W., Text Entry for Mobile Computing: Models and Methods, Theory and Practice. HCI Journal: 147--198, Vol. 17, No. 2--3, 2002.

Google Scholar

Cited By

View all

Zhang DChou HZhou L(2012)Hype or Ready for Prime Time?International Journal of Handheld Computing Research10.4018/jhcr.20121001033:4(40-55)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.4018/jhcr.2012100103
Cortizo JDiaz LCarrero FYanes AMonsalve B(2011)On the Future of Mobile Phones as the Heart of Community-Built DatabasesCommunity-Built Databases10.1007/978-3-642-19047-6_11(261-287)Online publication date: 12-Apr-2011
https://doi.org/10.1007/978-3-642-19047-6_11
Zhang RNorth SKoutsofios Ede Sá MCarriço LCorreia N(2010)A comparison of speech and GUI input for navigation in complex visualizations on mobile devicesProceedings of the 12th international conference on Human computer interaction with mobile devices and services10.1145/1851600.1851665(357-360)Online publication date: 7-Sep-2010
https://dl.acm.org/doi/10.1145/1851600.1851665
Show More Cited By

Index Terms

Evaluation of predictive text and speech inputs in a multimodal mobile route guidance application
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output
      2. Touch screens
    2. Interaction paradigms

Recommendations

Automatic Speech Recognition Used for Intelligibility Assessment of Text-to-Speech Systems
Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction

Speech intelligibility is the most important parameter in evaluation of speech quality. In the contribution, a new objective intelligibility assessment of general speech processing algorithms is proposed. It is based on automatic recognition methods ...
Semi-synchronous speech and pen input for mobile user interfaces

This paper proposes new interfaces using semi-synchronous speech and pen input for mobile environments. A user speaks while writing, and the pen input complements the speech so that recognition performance will be higher than with speech alone. Since the ...
Multimodal systems for speech recognition

In this article, we have implemented a system of multimodal recognition of Kazakh speech, based on speech and lip recognition. During the feature extraction phase, several methods have been used, such as voice activity detection (VAD), mel-frequency ...

Comments

Information & Contributors

Information

Published In

MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

September 2008

568 pages

ISBN:9781595939524

DOI:10.1145/1409240

Conference Chairs:
Henri ter Hofte
Telematica Instituut
,
Ingrid Mulder
Telematica Instituut & Rotterdam University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 September 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI08

MobileHCI08: 10th International Conference on Human Computer Interaction with Mobile Devices and Services

September 2 - 5, 2008

Amsterdam, The Netherlands

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
459
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhang DChou HZhou L(2012)Hype or Ready for Prime Time?International Journal of Handheld Computing Research10.4018/jhcr.20121001033:4(40-55)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.4018/jhcr.2012100103
Cortizo JDiaz LCarrero FYanes AMonsalve B(2011)On the Future of Mobile Phones as the Heart of Community-Built DatabasesCommunity-Built Databases10.1007/978-3-642-19047-6_11(261-287)Online publication date: 12-Apr-2011
https://doi.org/10.1007/978-3-642-19047-6_11
Zhang RNorth SKoutsofios Ede Sá MCarriço LCorreia N(2010)A comparison of speech and GUI input for navigation in complex visualizations on mobile devicesProceedings of the 12th international conference on Human computer interaction with mobile devices and services10.1145/1851600.1851665(357-360)Online publication date: 7-Sep-2010
https://dl.acm.org/doi/10.1145/1851600.1851665
Turunen MMelto AHella JHeimonen THakulinen JMäkinen ELaivo TSoronen HOppermann REisenhauer MJarke MWulf V(2009)User expectations and user experience with different modalities in a mobile phone controlled home entertainment systemProceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/1613858.1613898(1-4)Online publication date: 15-Sep-2009
https://dl.acm.org/doi/10.1145/1613858.1613898
Tinwala HMacKenzie I(2009)Eyes-free text entry on a touchscreen phone2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH)10.1109/TIC-STH.2009.5444381(83-88)Online publication date: Sep-2009
https://doi.org/10.1109/TIC-STH.2009.5444381

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Automatic Speech Recognition Used for Intelligibility Assessment of Text-to-Speech Systems

Semi-synchronous speech and pen input for mobile user interfaces

Multimodal systems for speech recognition

Comments

Published In

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Automatic Speech Recognition Used for Intelligibility Assessment of Text-to-Speech Systems

Semi-synchronous speech and pen input for mobile user interfaces

Multimodal systems for speech recognition

Comments

Information

Published In

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations