short-paper

Multimodal positive computing system for public speaking with real-time feedback

Author:

Fiona DermodyAuthors Info & Claims

ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

Pages 541 - 545

https://doi.org/10.1145/2993148.2997616

Published: 31 October 2016 Publication History

Abstract

A multimodal system with real-time feedback for public speaking has been developed. The system has been developed within the paradigm of positive computing which focuses on designing for user wellbeing. To date we have focused on the following determinants of wellbeing – autonomy, self-awareness and stress reduction. Two system prototypes have been developed which differ in the way they display feedback to users. One prototype displays peripheral feedback and the other displays line-of-vision feedback. Initial user evaluation of the system prototypes has yielded positive results. All users reported that they preferred the prototype with line-of-vision feedback. Users reported having autonomy in choosing what visual feedback to focus on when using the system. They also reported that they gained self-awareness as a speaker from using the system.

References

[1]

Aristotle and Hugh Lawson-Tancred. 1991. The art of rhetoric. Penguin UK.

[2]

R Barmaki and C E Hughes. 2015. Providing real-time feedback for student teachers in a virtual rehearsal environment. ICMI 2015 - Proceedings of the 2015 ACM International Conference on Multimodal Interaction: 531– 537. http://doi.org/10.1145/2818346.2830604

Digital Library

[3]

Ligia Batrinca, Giota Stratou, and Ari Shapiro. 2013. Cicero - Towards a Multimodal Virtual Audience Platform for Public Speaking Training. In Intelligent Virtual Agents, Ruth Aylett, Brigitte Krenn, Catherine Pelachaud and Hiroshi Shimodaira (eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 116–128. http://doi.org/10.1007/978-3-642- 40415-3

[4]

Rafael A Calvo and Dorian Peters. 2012. Positive Computing: Technology for a Wiser World. interactions 19, 4: 28–31. http://doi.org/10.1145/2212877.2212886

Digital Library

[5]

Rafael A Calvo and Dorian Peters. 2014. Positive Computing: Technology for wellbeing and human potential. MIT Press.

Digital Library

[6]

Rafael A Calvo and Dorian Peters. 2015. Introduction to Positive Computing: Technology That Fosters Wellbeing. Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, ACM, 2499–2500. http://doi.org/10.1145/2702613.2706674

Digital Library

[7]

Rafael A Calvo and Dorian Peters. 2016. Designing Technology to Foster Psychological Wellbeing. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, ACM, 988–991. http://doi.org/10.1145/2851581.2856668

Digital Library

[8]

Rafael a. Calvo, Dorian Peters, Daniel Johnson, and Yvonne Rogers. 2014. Autonomy in technology design. Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems - CHI EA ’14: 37–40. http://doi.org/10.1145/2559206.2560468

Digital Library

[9]

Mathieu Chollet, Louis-philippe Morency, Ari Shapiro, Stefan Scherer, and Los Angeles. 2015. Exploring Feedback Strategies to Improve Public Speaking: An Interactive Virtual Audience Framework. UbiComp ’15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing: 1143–1154. http://doi.org/10.1145/2750858.2806060

Digital Library

[10]

Mathieu Chollet, Kalin Stefanov, Helmut Prendinger, and Stefan Scherer. 2015. Public Speaking Training with a Multimodal Interactive Virtual Audience Framework - Demonstration. ICMI 2015 - Proceedings of the 2015 ACM International Conference on Multimodal Interaction: 367– 368. http://doi.org/10.1145/2818346.2823294

Digital Library

[11]

Fiona Dermody, Alistair Sutherland, and Margaret Farren. 2015. A Multi-Modal System for Public Speaking Pilot Study on evaluation of real-time feedback. In INTERACT 2015, Part IV, LNCS 9299, John Abascal, Brigitte Krenn, Catherine Pelachaud and Hiroshi Shimodaira (eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 3–5. http://doi.org/10.1007/978-3-319-22723-8_47

Digital Library

[12]

Fiona Dermody and Alistair Sutherland. 2015. A Multimodal System for Public Speaking with Real Time Feedback. Proceedings of the 2015 ACM International Conference on Multimodal Interaction, 369–370.

Digital Library

[13]

Fiona Dermody. 2015. A Multimodal System for Public Speaking. INTERACT 2015 Adjunct Proceedings. 15th IFIP TC. 13 International Conference on Human-Computer Interaction 14-18 September 2015, Bamberg, Germany.

[14]

Fiona Dermody. 2016. A Multimodal System for Public Speaking Anxiety: A Positive Computing Perspective. Irish Research Council Interdisciplinarity for Impact Workshop June 2016 Trinity College Dublin. Retrieved July 14, 2016 from https://www.tcd.ie/trinitylongroomhub/events/details/2016/2 016-06-01interdisciplinarity.php

[15]

Karen Kangas Dwyer and Marlina M. Davidson. 2012. Is Public Speaking Really More Feared Than Death? Communication Research Reports 29, 2: 99–107. http://doi.org/10.1080/08824096.2012.667772

[16]

Sandra R Harris, Robert L Kemmerling, and Max M North. 2002. Brief virtual reality therapy for public speaking anxiety. Cyberpsychology & behavior  : the impact of the Internet, multimedia and virtual reality on behavior and society 5, 6: 543–550. http://doi.org/10.1089/109493102321018187

[17]

Mohammed Ehsan Hoque and Rosalind W Picard. 2014. Rich Nonverbal Sensing Technology for Automated Social Skills Training. Computer 47, 4: 28–35. http://doi.org/10.1109/MC.2014.98

Digital Library

[18]

James C. McCroskey, Steven Booth Butterfield, and Steven K. Payne. 1989. The impact of communication apprehension on college student retention and success. Communication Quarterly 37, 2: 100–107. http://doi.org/10.1080/01463378909385531

[19]

Nick Morgan. 2015. Why Gesture Is Important - And What You’re Not Doing About It. Forbes. Retrieved March 1, 2016 from http://www.forbes.com/sites/nickmorgan/2015/02/10/whygesture-is-important-and-what-youre-not-doing-aboutit/2/#3de62c0a6456

[20]

Jan Schneider, Dirk Börner, Peter Van Rosmalen, and Marcus Specht. 2015. Presentation Trainer, your Public Speaking Multimodal Coach. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, 539– 546.

Digital Library

[21]

Toastmasters International. 2008. Competent Communication A Practical Guide to Becoming a Better Speaker.

[22]

Toastmasters International. 2011. Your Speaking Voice. Your Speaking Voice. Retrieved from http://www.toastmasters.org

[23]

Toastmasters International. 2011. Gestures: Your Body Speaks. Retrieved from http://www.toastmasters.org

Cited By

Chiba MYamada WOchiai K(2024)Shadowed Speech: An Approach for Slowing Speech Rate Using Adaptive Delayed Auditory FeedbackJournal of Information Processing10.2197/ipsjjip.32.93832(938-947)Online publication date: 2024
https://doi.org/10.2197/ipsjjip.32.938
Orii LOgawa NHatada YNarumi T(2022)Designing for Speech Practice Systems: How Do User-Controlled Voice Manipulation and Model Speakers Impact Self-Perceptions of Voice?Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502093(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502093
Dermody FSutherland A(2019)Recommendations from a Study of a Multimodal Positive Computing System for Public SpeakingComputer Vision, Imaging and Computer Graphics Theory and Applications10.1007/978-3-030-26756-8_4(81-92)Online publication date: 24-Jul-2019
https://doi.org/10.1007/978-3-030-26756-8_4
Show More Cited By

Index Terms

Multimodal positive computing system for public speaking with real-time feedback
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
      2. User interface design

Recommendations

Multimodal system for public speaking with real time feedback: a positive computing perspective
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

A multimodal system for public speaking with real time feedback has been developed using the Microsoft Kinect. The system has been developed within the paradigm of positive computing which focuses on designing for user wellbeing. The system detects ...
Multimodal Public Speaking Performance Assessment
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

The ability to speak proficiently in public is essential for many professions and in everyday life. Public speaking skills are difficult to master and require extensive training. Recent developments in technology enable new approaches for public ...
A Multimodal System for Public Speaking with Real Time Feedback
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

We have developed a multimodal prototype for public speaking with real time feedback using the Microsoft Kinect. Effective speaking involves use of gesture, facial expression, posture, voice as well as the spoken word. These modalities combine to give ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

October 2016

605 pages

ISBN:9781450345569

DOI:10.1145/2993148

General Chairs:
Yukiko I. Nakano
Seikei University, Japan
,
Elisabeth André
Augsburg University, Germany
,
Toyoaki Nishida
Kyoto University, Japan
,
Program Chairs:
Louis-Philippe Morency
Carnegie Mellon University, USA
,
Carlos Busso
University of Texas at Dallas, USA
,
Catherine Pelachaud
ISIR, France / University of Paris6, France

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ICMI '16

Sponsor:

SIGCHI

ICMI '16: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 12 - 16, 2016

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
176
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chiba MYamada WOchiai K(2024)Shadowed Speech: An Approach for Slowing Speech Rate Using Adaptive Delayed Auditory FeedbackJournal of Information Processing10.2197/ipsjjip.32.93832(938-947)Online publication date: 2024
https://doi.org/10.2197/ipsjjip.32.938
Orii LOgawa NHatada YNarumi T(2022)Designing for Speech Practice Systems: How Do User-Controlled Voice Manipulation and Model Speakers Impact Self-Perceptions of Voice?Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502093(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502093
Dermody FSutherland A(2019)Recommendations from a Study of a Multimodal Positive Computing System for Public SpeakingComputer Vision, Imaging and Computer Graphics Theory and Applications10.1007/978-3-030-26756-8_4(81-92)Online publication date: 24-Jul-2019
https://doi.org/10.1007/978-3-030-26756-8_4
Gallegos AAcosta UPadilla AShiguihara-Juarez P(2018)GeoMap: Development of a Geospatial Application with Multimodal Interaction2018 Congreso Internacional de Innovación y Tendencias en Ingeniería (CONIITI)10.1109/CONIITI.2018.8587063(1-6)Online publication date: Oct-2018
https://doi.org/10.1109/CONIITI.2018.8587063

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents