demonstration

A Multimodal System for Public Speaking with Real Time Feedback

Authors:

Fiona Dermody,

Alistair SutherlandAuthors Info & Claims

ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Pages 369 - 370

https://doi.org/10.1145/2818346.2823295

Published: 09 November 2015 Publication History

Get Access

Abstract

We have developed a multimodal prototype for public speaking with real time feedback using the Microsoft Kinect. Effective speaking involves use of gesture, facial expression, posture, voice as well as the spoken word. These modalities combine to give the appearance of self-confidence in the speaker. This initial prototype detects body pose, facial expressions and voice. Visual and text feedback is displayed in real time to the user using a video panel, icon panel and text feedback panel. The user can also set and view elapsed time during their speaking performance. Real time feedback is displayed on gaze direction, body pose and gesture, vocal tonality, vocal dysfluencies and speaking rate.

References

[1]

Batrinca, L. et al. 2013. Cicero - Towards a Multimodal Virtual Audience Platform for Public Speaking Training. Intelligent Virtual Agents. R. Aylett et al., eds. Springer Berlin Heidelberg. 116--128.

Google Scholar

[2]

Dermody, F. et al. 2015. A Multi-Modal System for Public Speaking - Pilot Study on evaluation of real-time feedback. INTERACT 2015, Part IV, LNCS 9299. J. Abascal et al., eds. Springer Berlin Heidelberg. 3--5.

Crossref

Google Scholar

Cited By

View all

Thomas CJayagopi D(2022)Predicting Presentation Skill of a Speaker Using Automatic Speaker and Audience MeasurementIEEE Transactions on Learning Technologies10.1109/TLT.2022.317160115:3(350-363)Online publication date: 1-Jun-2022
https://doi.org/10.1109/TLT.2022.3171601
Ochoa X(2022)Multimodal Systems for Automated Oral Presentation Feedback: A Comparative AnalysisThe Multimodal Learning Analytics Handbook10.1007/978-3-031-08076-0_3(53-78)Online publication date: 31-May-2022
https://doi.org/10.1007/978-3-031-08076-0_3
Dominguez FOchoa XZambrano DCamacho KCastells J(2021)Scaling and Adopting a Multimodal Learning Analytics Application in an Institution-Wide SettingIEEE Transactions on Learning Technologies10.1109/TLT.2021.310077814:3(400-414)Online publication date: 1-Jun-2021
https://doi.org/10.1109/TLT.2021.3100778
Show More Cited By

Index Terms

A Multimodal System for Public Speaking with Real Time Feedback
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Multimodal system for public speaking with real time feedback: a positive computing perspective
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

A multimodal system for public speaking with real time feedback has been developed using the Microsoft Kinect. The system has been developed within the paradigm of positive computing which focuses on designing for user wellbeing. The system detects ...
Towards Automated Assessment of Public Speaking Skills Using Multimodal Cues
ICMI '14: Proceedings of the 16th International Conference on Multimodal Interaction

Traditional assessments of public speaking skills rely on human scoring. We report an initial study on the development of an automated scoring model for public speaking performances using multimodal technologies. Task design, rubric development, and ...
Presentation Trainer, your Public Speaking Multimodal Coach
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

The Presentation Trainer is a multimodal tool designed to support the practice of public speaking skills, by giving the user real-time feedback about different aspects of her nonverbal communication. It tracks the user's voice and body to interpret her ...

Comments

Information & Contributors

Information

Published In

ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

November 2015

678 pages

ISBN:9781450339124

DOI:10.1145/2818346

General Chairs:
Zhengyou Zhang
Microsoft Research, USA
,
Phil Cohen
VoiceBox Technologies, USA
,
Program Chairs:
Dan Bohus
Microsoft Research, USA
,
Radu Horaud
INRIA Grenoble Rhone-Alpes, France
,
Helen Meng
Chinese University of Hong Kong, China

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2015

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

Dublin City University

Conference

ICMI '15

Sponsor:

SIGCHI

ICMI '15: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 9 - 13, 2015

Washington, Seattle, USA

Acceptance Rates

ICMI '15 Paper Acceptance Rate 52 of 127 submissions, 41%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
248
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Thomas CJayagopi D(2022)Predicting Presentation Skill of a Speaker Using Automatic Speaker and Audience MeasurementIEEE Transactions on Learning Technologies10.1109/TLT.2022.317160115:3(350-363)Online publication date: 1-Jun-2022
https://doi.org/10.1109/TLT.2022.3171601
Ochoa X(2022)Multimodal Systems for Automated Oral Presentation Feedback: A Comparative AnalysisThe Multimodal Learning Analytics Handbook10.1007/978-3-031-08076-0_3(53-78)Online publication date: 31-May-2022
https://doi.org/10.1007/978-3-031-08076-0_3
Dominguez FOchoa XZambrano DCamacho KCastells J(2021)Scaling and Adopting a Multimodal Learning Analytics Application in an Institution-Wide SettingIEEE Transactions on Learning Technologies10.1109/TLT.2021.310077814:3(400-414)Online publication date: 1-Jun-2021
https://doi.org/10.1109/TLT.2021.3100778
Schneider JRomano GDrachsler H(2019)Beyond Reality—Extending a Presentation Trainer with an Immersive VR ModuleSensors10.3390/s1916345719:16(3457)Online publication date: 7-Aug-2019
https://doi.org/10.3390/s19163457
Schneider JDi Mitri DLimbu BDrachsler H(2018)Multimodal Learning Hub: A Tool for Capturing Customizable Multimodal Learning ExperiencesLifelong Technology-Enhanced Learning10.1007/978-3-319-98572-5_4(45-58)Online publication date: 14-Aug-2018
https://doi.org/10.1007/978-3-319-98572-5_4
Schneider JBörner DRosmalen PSpecht M(2017)Presentation TrainerJournal of Computer Assisted Learning10.1111/jcal.1217533:2(164-177)Online publication date: 1-Apr-2017
https://dl.acm.org/doi/10.1111/jcal.12175
Schneider JBörner Dvan Rosmalen PSpecht M(2017)Do You Know What Your Nonverbal Behavior Communicates? – Studying a Self-reflection Module for the Presentation TrainerImmersive Learning Research Network10.1007/978-3-319-60633-0_8(93-106)Online publication date: 7-Jun-2017
https://doi.org/10.1007/978-3-319-60633-0_8
Dermody FSutherland ANakano YAndré ENishida TMorency LBusso CPelachaud C(2016)Multimodal system for public speaking with real time feedback: a positive computing perspectiveProceedings of the 18th ACM International Conference on Multimodal Interaction10.1145/2993148.2998536(408-409)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.1145/2993148.2998536
Dermody FNakano YAndré ENishida TMorency LBusso CPelachaud C(2016)Multimodal positive computing system for public speaking with real-time feedbackProceedings of the 18th ACM International Conference on Multimodal Interaction10.1145/2993148.2997616(541-545)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.1145/2993148.2997616
Schneider JBörner Dvan Rosmalen PSpecht M(2016)Enhancing Public Speaking Skills - An Evaluation of the Presentation Trainer in the WildAdaptive and Adaptable Learning10.1007/978-3-319-45153-4_20(263-276)Online publication date: 7-Sep-2016
https://doi.org/10.1007/978-3-319-45153-4_20

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Multimodal system for public speaking with real time feedback: a positive computing perspective

Towards Automated Assessment of Public Speaking Skills Using Multimodal Cues

Presentation Trainer, your Public Speaking Multimodal Coach

Comments

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Multimodal system for public speaking with real time feedback: a positive computing perspective

Towards Automated Assessment of Public Speaking Skills Using Multimodal Cues

Presentation Trainer, your Public Speaking Multimodal Coach

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations