demonstration

Speaking with the crowd

Authors:

Walter Lasecki,

Rachel Wesley,

Anand Kulkarni,

Jeffrey BighamAuthors Info & Claims

UIST Adjunct Proceedings '12: Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology

Pages 25 - 26

https://doi.org/10.1145/2380296.2380310

Published: 07 October 2012 Publication History

Get Access

Abstract

Automated systems are not yet able to engage in a robust dialogue with users due the complexity and ambiguity of natural language. However, humans can easily converse with one another and maintain a shared history of past interactions. In this paper, we introduce Chorus, a system that enables real-time, two-way natural language conversation between an end user and a crowd acting as a single agent. Chorus is capable of maintaining a consistent, on-topic conversation with end users across multiple sessions, despite constituent individuals perpetually joining and leaving the crowd. This is enabled by using a curated shared dialogue history.

Even though crowd members are constantly providing input, we present users with a stream of dialogue that appears to be from a single conversational partner. Experiments demonstrate that dialogue with Chorus displays elements of conversational memory and interaction consistency. Workers were able to answer 84.6% of user queries correctly, demonstrating that crowd-powered communication interfaces can serve as a robust means of interacting with software systems.

References

[1]

J. F. Allen, L. K. Schubert, G. Ferguson, P. Heeman, C. H. Hwang, T. Kato, M. Light, N. G. Martin, B. W. Miller, M. Poesio, and D. R. Traum. Enriching speech recognition with automatic detection of sentence boundaries and disfluencies. Journal of Experimental and Theoretical AI (JETAI), 7:7--48, 1995.

Crossref

Google Scholar

[2]

M. S. Bernstein, G. Little, R. C. Miller, B. Hartmann, M. S. Ackerman, D. R. Karger, D. Crowell, and K. Panovich. Soylent: a word processor with a crowd inside. In Proceedings of the symposium on User interface software and technology, UIST '10, pages 313--322, 2010. ACM.

Digital Library

Google Scholar

[3]

J. P. Bigham, C. Jayant, H. Ji, G. Little, A. Miller, R. C. Miller, R. Miller, A. Tatarowicz, B. White, S. White, and T. Yeh. Vizwiz: nearly real-time answers to visual questions. In Proceedings of the symposium on User interface software and technology, UIST '10, pages 333--342, 2010. ACM.

Digital Library

Google Scholar

[4]

A. P. Kulkarni, M. Can, and B. Hartmann. Turkomatic: automatic recursive task and workflow design for mechanical turk. In Proc. of CHI 2011, pages 2053--2058, 2011.

Digital Library

Google Scholar

[5]

W. Lasecki, K. Murray, S. White, R. C. Miller, and J. P. Bigham. Real-time crowd control of existing interfaces. In Proceedings of the symposium on User Interface Software and Technology, UIST '11, pages 23--32, 2011. ACM.

Digital Library

Google Scholar

[6]

H. Zhang, E. Law, R. C. Miller, K. Z. Gajos, D. C. Parkes, and E. Horvitz. Human computation tasks with global constraints. In Proc. of CHI 2012, 2012. To appear.

Digital Library

Google Scholar

Cited By

View all

Lasecki WMackay WBrewster SBødker S(2013)Real-time conversational crowd assistantsCHI '13 Extended Abstracts on Human Factors in Computing Systems10.1145/2468356.2479500(2725-2730)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2468356.2479500
Ramchurn SHuynh TVenanzi MShi BDavis HHalpin HPentland ABernstein MAdamic LAlani HMonnin ARogers R(2013)CollabmapProceedings of the 5th Annual ACM Web Science Conference10.1145/2464464.2464508(326-335)Online publication date: 2-May-2013
https://dl.acm.org/doi/10.1145/2464464.2464508

Index Terms

Speaking with the crowd
1. Information systems
  1. Information systems applications

Recommendations

Effect of Speech Entrainment in Human-Computer Conversation: A Review
Intelligent Human Computer Interaction
Abstract
The phenomenon of entrainment in conversation is the process where participants become more similar to each other in terms of different verbal and non-verbal aspects such as acoustic-prosodic, lexical, syntactic, pitch, and speech rate. This ...
Speaking more like you: lexical, acoustic/prosodic, and discourse entrainment in spoken dialogue systems
SIGdial '08: Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue

When people engage in conversation, they adapt the way they speak to the speaking style of their conversational partner in a variety of ways. For example, they may adopt a certain way of describing something based upon the way their conversational ...
Towards human-like spoken dialogue systems

This paper presents an overview of methods that can be used to collect and analyse data on user responses to spoken dialogue system components intended to increase human-likeness, and to evaluate how well the components succeed in reaching that goal. ...

Comments

Information & Contributors

Information

Published In

UIST Adjunct Proceedings '12: Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology

October 2012

114 pages

ISBN:9781450315821

DOI:10.1145/2380296

General Chair:
Rob Miller
MIT CSAIL, USA
,
Program Chairs:
Hrvoje Benko
Microsoft Research, USA
,
Celine Latulipe
University of North Carolina at Charlotte, USA

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

UIST '12

Sponsor:

UIST '12: The 25th Annual ACM Symposium on User Interface Software and Technology

October 7 - 10, 2012

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
184
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lasecki WMackay WBrewster SBødker S(2013)Real-time conversational crowd assistantsCHI '13 Extended Abstracts on Human Factors in Computing Systems10.1145/2468356.2479500(2725-2730)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2468356.2479500
Ramchurn SHuynh TVenanzi MShi BDavis HHalpin HPentland ABernstein MAdamic LAlani HMonnin ARogers R(2013)CollabmapProceedings of the 5th Annual ACM Web Science Conference10.1145/2464464.2464508(326-335)Online publication date: 2-May-2013
https://dl.acm.org/doi/10.1145/2464464.2464508

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Effect of Speech Entrainment in Human-Computer Conversation: A Review

Speaking more like you: lexical, acoustic/prosodic, and discourse entrainment in spoken dialogue systems

Towards human-like spoken dialogue systems

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations