Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3290605.3300807acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Public Access

TalkTraces: Real-Time Capture and Visualization of Verbal Content in Meetings

Published: 02 May 2019 Publication History

Abstract

Group Support Systems provide ways to review and edit shared content during meetings, but typically require participants to explicitly generate the content. Recent advances in speech-to-text conversion and language processing now make it possible to automatically record and review spoken information. We present the iterative design and evaluation of TalkTraces, a real-time visualization that helps teams identify themes in their discussions and obtain a sense of agenda items covered. We use topic modeling to identify themes within the discussions and word embeddings to compute the discussion "relatedness" to items in the meeting agenda. We evaluate TalkTraces iteratively: we first conduct a comparative between-groups study between two teams using TalkTraces and two teams using traditional notes, over four sessions. We translate the findings into changes in the interface, further evaluated by one team over four sessions. Based on our findings, we discuss design implications for real-time displays of discussion content.

Supplementary Material

MP4 File (paper577.mp4)
Supplemental video

References

[1]
Daniel Angus, Andrew Smith, and Janet Wiles. 2012. Conceptual recurrence plots: Revealing patterns in human discourse. IEEE Transactions on Visualization and Computer Graphics 18, 6 (2012), 988--997.
[2]
Tony Bergstrom and Karrie Karahalios. 2009. Conversation clusters: grouping conversation topics through human-computer dialog. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. 2349--2352.
[3]
David M. Blei. 2012. Probabilistic Topic Models. Commun. ACM 55, 4 (2012), 77--84.
[4]
David M Blei and John D Lafferty. 2006. Dynamic topic models. In Proceedings of the International Conference on Machine Learning. 113-- 120.
[5]
David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. Journal of machine Learning research 3, 4/5 (2003), 993--1022.
[6]
Sara A Bly, Steve R Harrison, and Susan Irwin. 1993. Media spaces: bringing people together in a video, audio, and computing environment. Commun. ACM 36, 1 (1993), 28--46.
[7]
Michael Bostock, Vadim Ogievetsky, and Jeffrey Heer. 2011. D3: DataDriven Documents. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2301--2309.
[8]
Nadieh Bremer. 2015. Create a "gooey effect" during transitions in d3.js. https://www.visualcinnamon.com/2015/05/gooey-effect.
[9]
Vannevar Bush. 1945. As we may think. The atlantic monthly 176, 1 (1945), 101--108.
[10]
Nan Cao, Jimeng Sun, Yu-Ru Lin, David Gotz, Shixia Liu, and Huamin Qu. 2010. Facetatlas: Multifaceted visualization for rich text corpora. IEEE Transactions on Visualization and Computer Graphics 16, 6 (2010), 1172--1181.
[11]
Sandro Castronovo, Jochen Frey, and Peter Poller. 2008. A generic layout-tool for summaries of meetings in a constraint-based approach. In International Workshop on Machine Learning for Multimodal Interaction. 248--259.
[12]
Patrick Chiu, Ashutosh Kapuskar, Sarah Reitmeier, and Lynn Wilcox. 2000. Room with a rear view. Meeting capture in a multimedia conference room. IEEE MultiMedia 7, 4 (2000), 48--54.
[13]
Cisco Systems Inc. 2018. Cisco Collaboration Meeting Rooms. https://www.cisco.com/c/en/us/solutions/collaboration/ pervasive-conferencing/index.html. {Online; accessed 03-April-2018}.
[14]
Stephen Clark. 2015. Vector space models of lexical meaning. The Handbook of Contemporary semantic theory (2015), 493--522.
[15]
Weiwei Cui, Shixia Liu, Li Tan, Conglei Shi, Yangqiu Song, Zekai Gao, Huamin Qu, and Xin Tong. 2011. Textflow: Towards better understanding of evolving topics in text. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2412--2421.
[16]
Wenwen Dou, Xiaoyu Wang, Drew Skau, William Ribarsky, and Michelle X Zhou. 2012. Leadline: Interactive visual analysis of text data through event identification and exploration. In IEEE Conference on Visual Analytics Science and Technology. 93--102.
[17]
Patrick Ehlen, Matthew Purver, John Niekrasz, Kari Lee, and Stanley Peters. 2008. Meeting adjourned: off-line learning interfaces for automatic meeting understanding. In Proceedings of the ACM international conference on Intelligent user interfaces. 276--284.
[18]
Mennatallah El-Assady, Rita Sevastjanova, Bela Gipp, Daniel Keim, and Christopher Collins. 2017. NEREx: Named-Entity Relationship Exploration in Multi-Party Conversations. In Computer Graphics Forum, Vol. 36. 213--225.
[19]
Sayed M Elsayed-Elkhouly, Harold Lazarus, and Volville Forsythe. 1997. Why is a third of your time wasted in meetings? Journal of Management Development 16, 9 (1997), 672--676.
[20]
Carlos Filipe Freitas, Joao Barroso, and Carlos Ramos. 2015. A Survey on Smart Meeting Rooms and Open Issues. International Journal of Smart Home 9, 9 (2015), 13--20.
[21]
Brynjar Gretarsson, John O'donovan, Svetlin Bostandjiev, Tobias Höllerer, Arthur Asuncion, David Newman, and Padhraic Smyth. 2012. Topicnets: Visual analysis of large text corpora with topic modeling. ACM Transactions on Intelligent Systems and Technology 3, 2 (2012), 23. TalkTraces CHI 2019, May 4--9, 2019, Glasgow, Scotland UK
[22]
Amit Gruber, Yair Weiss, and Michal Rosen-Zvi. 2007. Hidden topic markov models. In Proceedings of the International Conference on Artificial intelligence and statistics. 163--170.
[23]
Richard M Heiberger, Naomi B Robbins, et al. 2014. Design of diverging stacked bar charts for Likert scales and other applications. Journal of Statistical Software 57, 5 (2014), 1--32.
[24]
Steven Houben, Connie Golsteijn, Sarah Gallacher, Rose Johnson, Saskia Bakker, Nicolai Marquardt, Licia Capra, and Yvonne Rogers. 2016. Physikit: Data engagement through physical ambient visualizations in the home. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. 1608--1619.
[25]
Seth Hunter, Pattie Maes, Stacey Scott, and Henry Kaufman. 2011. MemTable: an integrated system for capture and recall of shared histories in group workspaces. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. 3305--3314.
[26]
Seth Hunter, Pattie Maes, Stacey Scott, and Henry Kaufman. 2011. MemTable: an integrated system for capture and recall of shared histories in group workspaces. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. 3305--3314.
[27]
Intel Inc. 2018. Intel Unite Solution. https://www.intel. com/content/www/us/en/architecture-and-technology/unite/ intel-unite-overview.html. {Online; accessed 03-April-2018}.
[28]
Petra Isenberg, Niklas Elmqvist, Jean Scholtz, Daniel Cernea, Kwan-Liu Ma, and Hans Hagen. 2011. Collaborative visualization: Definition, challenges, and research agenda. Information Visualization 10, 4 (2011), 310--326.
[29]
Nassim Jafarinaimi, Jodi Forlizzi, Amy Hurst, and John Zimmerman. 2005. Breakaway: an ambient display designed to change human behavior. In ACM CHI extended abstracts on Human factors in computing systems. 1945--1948.
[30]
Armand Joulin, Edouard Grave, Piotr Bojanowski, and Tomas Mikolov. 2017. Bag of Tricks for Efficient Text Classification. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers. Association for Computational Linguistics, 427--431.
[31]
KyungTae Kim, Sungahn Ko, Niklas Elmqvist, and David S Ebert. 2011. WordBridge: Using composite tag clouds in node-link diagrams for visualizing content and relations in text corpora. In IEEE Hawaii International Conference on System Sciences. 1--8.
[32]
Taemie Kim, Agnes Chang, Lindsey Holland, and Alex Sandy Pentland. 2008. Meeting mediator: enhancing group collaborationusing sociometric feedback. In Proceedings of the ACM conference on Computer supported cooperative work. 457--466.
[33]
Kostiantyn Kucher and Andreas Kerren. 2015. Text visualization techniques: Taxonomy, visual survey, and community insights. In IEEE Pacific Visualization Symposium. 117--121.
[34]
Wei Li and Andrew McCallum. 2006. Pachinko allocation: DAGstructured mixture models of topic correlations. In Proceedings of the ACM international conference on Machine learning. 577--584.
[35]
Shixia Liu, Jialun Yin, Xiting Wang, Weiwei Cui, Kelei Cao, and Jian Pei. 2016. Online visual analytics of text streams. IEEE Transactions on Visualization and Computer Graphics 22, 11 (2016), 2451--2466.
[36]
Edward Loper and Steven Bird. 2002. NLTK: the natural language toolkit. In Proceedings of the ACL Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics - Volume 1. 63--70.
[37]
Jennifer Mankoff, Anind K Dey, Gary Hsieh, Julie Kientz, Scott Lederer, and Morgan Ames. 2003. Heuristic evaluation of ambient displays. In Proceedings of the ACM CHI conference on Human factors in computing systems. 169--176.
[38]
Microsoft Inc. 2018. IoT Smart Buldings | Microsoft. https://www. microsoft.com/en-us/internet-of-things/smart-building. {Online; accessed 03-April-2018}.
[39]
Jay F. Nunamaker, Robert O. Briggs, and Daniel D. Mittleman. 1996. Lessons from a decade of group support systems research. In Proceedings of the Hawaii International Conference on System Sciences Volume 3: Collaboration Systems and Technology. 418--427.
[40]
Jay F. Nunamaker, Alan R Dennis, Joseph S Valacich, Douglas Vogel, and Joey F George. 1991. Electronic meeting systems. Commun. ACM 34, 7 (1991), 40--61.
[41]
Chris Parnin and Carsten Gorg. 2007. Design guidelines for ambient software visualization in the workplace. In IEEE International Workshop on Visualizing Software for Understanding and Analysis. 18--25.
[42]
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the conference on empirical methods in natural language processing. 1532-- 1543.
[43]
Zachary Pousman and John Stasko. 2006. A taxonomy of ambient information systems: four patterns of design. In Proceedings of the ACM conference on Advanced visual interfaces. 67--74.
[44]
Carlos Ramos, Juan Carlos Augusto, and Daniel Shapiro. 2008. Ambient intelligence-the next step for artificial intelligence. IEEE Intelligent Systems 23, 2 (2008), 15--18.
[45]
Radim Rehurek and Petr Sojka. 2010. Software Framework for Topic Modelling with Large Corpora. In Proceedings of the LREC Workshop on New Challenges for NLP Frameworks. 45--50.
[46]
Alan R Robertson. 1977. The CIE 1976 Color-Difference Formulae. Color Research & Application 2, 1 (1977), 7--11.
[47]
Yang Shi, Chris Bryan, Sridatt Bhamidipati, Ying Zhao, Yaoxue Zhang, and Kwan-Liu Ma. 2018. MeetingVis: Visual Narratives to Assist in Recalling Meeting Context and Content. IEEE Transactions on Visualization and Computer Graphics (2018).
[48]
Yang Shi, Yang Wang, Ye Qi, John Chen, Xiaoyao Xu, and Kwan-Liu Ma. 2017. IdeaWall: improving creative collaboration through combinatorial visual stimuli. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing. 594--603.
[49]
Carson Sievert and Kenneth Shirley. 2014. LDAvis: A method for visualizing and interpreting topics. In Proceedings of the workshop on interactive language learning, visualization, and interfaces. 63--70.
[50]
Tobias Skog. 2004. Activity wallpaper: ambient visualization of activity information. In Proceedings of the ACM Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. 325--328.
[51]
Alison Smith, Varun Kumar, Jordan Boyd-Graber, Kevin Seppi, and Leah Findlater. 2018. Closing the Loop: User-Centered Design and Evaluation of a Human-in-the-Loop Topic Modeling System. In Proceedgs of the ACM Conference on Intelligent User Interfaces. 293--304.
[52]
Alison Smith, Tak Yeon Lee, Forough Poursabzi-Sangdeh, Jordan BoydGraber, Niklas Elmqvist, and Leah Findlater. 2017. Evaluating visual CHI 2019, May 4--9, 2019, Glasgow, Scotland UK S. Chandrasegaran et al. representations for topic understanding and their effects on manually generated labels. Transactions of the Association of Computational Linguistics 5, 1 (2017), 1--15.
[53]
Robert Speer, Joshua Chin, and Catherine Havasi. 2017. ConceptNet 5.5: An Open Multilingual Graph of General Knowledge. In AAAI Conference on Artificial Intelligence. 4444--4451.
[54]
Yun Sun, Yubo Tao, Geng Yang, and Hai Lin. 2013. Visitpedia: Wiki article visit log visualization for event exploration. In International Conference on Computer-Aided Design and Computer Graphics. 282--289.
[55]
Yuzuru Tanahashi and Kwan-Liu Ma. 2015. Stock lamp: An engagement-versatile visualization design. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. 595--604.
[56]
Gokhan Tur, Andreas Stolcke, Lynn Voss, Stanley Peters, Dilek Hakkani-Tur, John Dowding, Benoit Favre, Raquel Fernández, Matthew Frampton, Mike Frandsen, Clint Frederickson, Martin Graciarena, Donald Kintzing, Kyle Leveque, Shane Mason, John Niekrasz, Matthew Purver, Korbinian Riedhammer, Elizabeth Shriberg, Jing Tien, Dimitra Vergyri, and Fan Yang. 2010. The CALO meeting assistant system. IEEE Transactions on Audio, Speech, and Language Processing 18, 6 (2010), 1601--1611.
[57]
Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of the 48th annual meeting of the association for computational linguistics. 384--394.
[58]
Frank Van Ham, Martin Wattenberg, and Fernanda B Viégas. 2009. Mapping text with phrase nets. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009).
[59]
Sergio A Velastin, Boghos A Boghossian, Benny PL Lo, Jie Sun, and Maria Alicia Vicencio-Silva. 2005. PRISMATICA: toward ambient intelligence in public transport environments. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 35, 1 (2005), 164--182.
[60]
Daniel Vogel and Ravin Balakrishnan. 2004. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proceedings of the ACM symposium on User Interface Software and Technology. 137--146.
[61]
Xiting Wang, Shixia Liu, Yang Chen, Tai-Quan Peng, Jing Su, Jing Yang, and Baining Guo. 2016. How ideas flow across multiple social groups. IEEE Transactions on Visualization and Computer Graphics, 51--60.
[62]
Xiting Wang, Shixia Liu, Yangqiu Song, and Baining Guo. 2013. Mining evolutionary multi-branch trees from text streams. In Proceedings of the ACM SIGKDD international conference on Knowledge Discovery and Data mining. 722--730.
[63]
Xuerui Wang and Andrew McCallum. 2006. Topics over time: a nonMarkov continuous-time model of topical trends. In Proceedings of the ACM SIGKDD international conference on Knowledge Discovery and Data mining. 424--433.
[64]
Furu Wei, Shixia Liu, Yangqiu Song, Shimei Pan, Michelle X Zhou, Weihong Qian, Lei Shi, Li Tan, and Qiang Zhang. 2010. Tiara: a visual exploratory text analytic system. In Proceedings of the ACM SIGKDD international conference on Knowledge discovery and data mining. 153-- 162.
[65]
Steve Whittaker, Simon Tucker, and Denis Lalanne. 2012. Meeting browsers and meeting assistants. In Multimodal Signal Processing: Human Interactions in Meetings, Steve Renals, Hervé Bourlard, Jean Carletta, and Andrei Popescu-Belis (Eds.). Cambridge University Press, Chapter 12, 204--217.
[66]
Felix Wortmann and Kristina Flüchter. 2015. Internet of things. Business & Information Systems Engineering 57, 3 (2015), 221--224.
[67]
Zhiwen Yu and Yuichi Nakamura. 2010. Smart meeting systems: A survey of state-of-the-art and open issues. ACM Computing Surveys (CSUR) 42, 2 (2010), 8.

Cited By

View all
  • (2025)Impact of communication modalities on social presence and regulation processes in a collaborative gameJournal on Multimodal User Interfaces10.1007/s12193-024-00450-zOnline publication date: 10-Feb-2025
  • (2024)Sound of the Police—Virtual Reality Training for Police Communication for High-Stress OperationsMultimodal Technologies and Interaction10.3390/mti80600468:6(46)Online publication date: 4-Jun-2024
  • (2024)Enhancing Collaboration and Performance among EMS Students through Multimodal Learning AnalyticsProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3688613(607-611)Online publication date: 4-Nov-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
May 2019
9077 pages
ISBN:9781450359702
DOI:10.1145/3290605
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. collaboration
  2. real-time visualization
  3. streaming data

Qualifiers

  • Research-article

Funding Sources

Conference

CHI '19
Sponsor:

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)731
  • Downloads (Last 6 weeks)113
Reflects downloads up to 11 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Impact of communication modalities on social presence and regulation processes in a collaborative gameJournal on Multimodal User Interfaces10.1007/s12193-024-00450-zOnline publication date: 10-Feb-2025
  • (2024)Sound of the Police—Virtual Reality Training for Police Communication for High-Stress OperationsMultimodal Technologies and Interaction10.3390/mti80600468:6(46)Online publication date: 4-Jun-2024
  • (2024)Enhancing Collaboration and Performance among EMS Students through Multimodal Learning AnalyticsProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3688613(607-611)Online publication date: 4-Nov-2024
  • (2024)In Pursuit of Constructive Communication: Designing Tools to Support Development of Constructive Communication MetricsCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3663720(121-124)Online publication date: 1-Jul-2024
  • (2024)Anther: Cross-Pollinating Communities of Practice via Video TutorialsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660727(1991-2005)Online publication date: 1-Jul-2024
  • (2024)Meeting Bridges: Designing Information Artifacts that Bridge from Synchronous Meetings to Asynchronous CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/36373128:CSCW1(1-29)Online publication date: 26-Apr-2024
  • (2024)Exploring the Potential for Generative AI-based Conversational Cues for Real-Time Collaborative IdeationProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656184(117-131)Online publication date: 23-Jun-2024
  • (2024)COMPA: Using Conversation Context to Achieve Common Ground in AACProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642762(1-18)Online publication date: 11-May-2024
  • (2024)ChunkyEdit: Text-first video interview editing via chunkingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642667(1-16)Online publication date: 11-May-2024
  • (2024)The association between synchrony and intellectual productivity in a group discussion : a study using the SenseChairHumanities and Social Sciences Communications10.1057/s41599-023-02566-111:1Online publication date: 26-Feb-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media