Browsing interaction events in recordings of small group activities via multimedia operators
Pages 245 - 252
Abstract
The recording of multimedia sessions of small group activities, such as meetings, lectures and webconferences, is becoming increasingly popular following the improvements in recording technologies, the popularity of web-based media repositories, and the opportunity of reviewing or sharing the activity in a later moment. When reviewing a (potentially long) multimedia session, a user may not be interested in watching it linearly as a whole, but only on browsing or skimming specific fragments of interest. For tackling this requirement, the literature reports the opportunity of indexing interaction events that typically occur in these activities, such as slide transitions, speech turns and gestures. In this paper we investigate the issue of combining different types of interaction events as an aid to navigate in multimedia sessions. First, we define temporal interval-based composition operators so that the semantics of groups of annotations can be orchestrated in queries. Second, we demonstrate the operators in a web-based multimedia player that enable users to browse a multimedia session with the aid of visualizations and filters over interaction-focused annotations. In order to experiment with the model, we report a case study with multimedia information recorded by a capture environment in use.
References
[1]
J. Adcock, M. Cooper, L. Denoue, H. Pirsiavash, and L. A. Rowe. Talkminer: a lecture webcast search engine. In ACM MM '10, pages 241--250, 2010.
[2]
J. Aggarwal and M. Ryoo. Human activity analysis: A review. ACM Computing Surveys, 43 (3): 16,43, 2011.
[3]
J. F. Allen. Maintaining knowledge about temporal intervals. Commun. ACM, 26 (11): 832--843, 1983.
[4]
A. Behera, D. Lalanne, and R. Ingold. DocMIR: An automatic document-based indexing system for meeting retrieval. Multimedia Tools and Applications, 37 (2): 135--167, 2007.
[5]
D. Bulterman and L. Rutledge. SMIL 3.0: Flexible Multimedia for Web, Mobile Devices and Daisy Talking Books. Springer Publishing, 2008.
[6]
F. Cazenave, V. Quint, and C. Roisin. Timesheets.js: when SMIL meets HTML5 and CSS3. In Proceedings of the 11th ACM Symposium on Document Engineering, pages 43--52, 2011.
[7]
C. Dufour, J. C. Bartlett, and E. G. Toms. Understanding how webcasts are used as sources of information. J. Amer. Soc. Inf. Sci. Tech., 62 (2), 2011.
[8]
D. Gatica-Perez. Automatic nonverbal analysis of social interaction in small groups: A review. Image and Vision Computing, 27 (12): 1775--1787, 2009.
[9]
W. Geyer, H. Richter, and G. D. Abowd. Towards a Smarter Meeting Record-Capture and Access of Meetings Revisited. Multimedia Tools and Applications, 27 (3): 393--410, 2005.
[10]
I. Hickson and D. Hyatt. HTML5: A vocabulary and associated APIs for HTML and XHTML. W3C Working Draft, 19, 2010.
[11]
D. Jayagopi, T. Kim, A. Pentland, and D. Gatica-Perez. Privacy-sensitive recognition of group conversational context with sociometers. Multimedia Systems, 18 (1): 3--14, 2012.
[12]
V. Kalnikaite, P. Ehlen, and S. Whittaker. Markup as you talk: establishing effective memory cues while still contributing to a meeting. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, pages 349--358, 2012.
[13]
R. Kaptein and M. Marx. Focused retrieval and result aggregation with political data. Information retrieval, 13 (5): 412--433, 2010.
[14]
D. Korchagin, S. Duffner, P. Motlicek, and C. Scheffler. Multimodal Cue Detection Engine for Orchestrated Entertainment. In Proceedings of the 18th International Conference on Multimedia Modeling (MMM'12) - LNCS 7131, pages 662--670, 2012.
[15]
Y. Koyama, Y. Sawamoto, Y. Hirano, S. Kajita, K. Mase, T. Suzuki, K. Katsuyama, and K. Yamauchi. A multi-modal dialogue analysis method for medical interviews based on design of interaction corpus. Personal and Ubiquitous Computing, 14 (8): 767--778, 2010.
[16]
M. Nathan, M. Topkara, J. Lai, S. Pan, S. Wood, J. Boston, and L. Terveen. In case you missed it: benefits of attendee-shared annotations for non-attendees of remote meetings. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, pages 339--348, 2012.
[17]
A. Popescu-Belis, D. Lalanne, and H. Bourlard. Finding information in multimedia meeting records. IEEE Multimedia, 19 (2): 48--57, 2012.
[18]
J. Terken and J. Sturm. Multimodal support for social dynamics in co-located meetings. Personal Ubiquitous Comput., 14: 703--714, December 2010.
[19]
ez, Frampton, Frandsen, and Others}tur2010caloG. Tur, A. Stolcke, L. Voss, S. Peters, D. Hakkani-Tur, J. Dowding, B. Favre, R. Fernández, M. Frampton, M. Frandsen, and Others. The CALO meeting assistant system. Audio, Speech, and Language Processing, IEEE Transactions on, 18 (6): 1601--1611, 2010.
[20]
D. A. Vega-Oliveros, D. S. Martins, and M. G. C. Pimentel. Media-oriented operators for authoring interactive multimedia documents generated from capture sessions. In ACM SAC '11, volume 2, pages 1267--1272, 2011.
[21]
P. Vuorimaa, D. Bulterman, and P. Cesar. SMIL Timesheets 1.0. W3C Working Group Note, 2008.
[22]
WHATWG. The HTML5 video element. URL "http://www.whatwg.org/specs/web-apps/current-work/multipage/the-video-%element.html. Accessed in May, 2012.
[23]
S. Whittaker, S. Tucker, K. Swampillai, and R. Laban. Design and evaluation of systems to support interaction capture and retrieval. Personal and Ubiquitous Computing, 12 (3): 197--221, 2007.
[24]
Z. Yu and Y. Nakamura. Smart meeting systems: A survey of state-of-the-art and open issues. ACM Computing Surveys, 42 (2): 1--20, 2010.
[25]
Z. Yu, Z. Yu, X. Zhou, C. Becker, and Y. Nakamura. Tree-Based mining for discovering patterns of human interaction in meetings. IEEE Transactions on Knowledge and Data Engineering, 24 (4): 759--768, 2012.
Index Terms
- Browsing interaction events in recordings of small group activities via multimedia operators
Recommendations
Automatic authoring of interactive multimedia documents via media-oriented operators
When capturing multimedia records of collaborative activities (e.g. lectures, meetings, etc.), later access to the captured activity is usually provided by a linear video comprising the contents of the exchanged media. Such alternative impairs the ...
Interfaces for interactive audio-visual media browsing
MM '06: Proceedings of the 14th ACM international conference on MultimediaIn this demo, we present new interfaces for interactive navigation in continuous, time-based multimedia files, such as video recordings. In contrast to common techniques for multimedia skimming, our approaches enable users to interactively navigate ...
Comments
Information & Contributors
Information
Published In
October 2012
426 pages
ISBN:9781450317061
DOI:10.1145/2382636
- General Chairs:
- Graça Bressan,
- Regina Melo Silveira,
- Program Chairs:
- Ethan V. Munson,
- André Santanchà,
- Maria da Graèa Campos Pimentel
Copyright © 2012 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- SBC: Brazilian Computer Society
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 October 2012
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
WebMedia '12
Sponsor:
- SBC
WebMedia '12: Brazilian Symposium on Multimedia and the Web
October 15 - 18, 2012
São Paulo/SP, Brazil
Acceptance Rates
Overall Acceptance Rate 270 of 873 submissions, 31%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 184Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 14 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in