2007 Proceeding- Conference Chairs:
- Paulo Barthelmess,
- Edward C. Kaiser
Inexpensive and user friendly cameras, microphones, and other devices such as digital pens are making it increasingly easy to capture, store and process large amounts of data over a variety of media. This opportunity has been embraced by a large number of people, and resulted in the availability of high volumes of digital photos, videos, audio recordings. Additional opportunities present themselves for capture of even richer data, for example during lectures, meetings, or informal gatherings.
Even though the barriers for data acquisition have been lowered, making use of these data remains challenging. Effective use presupposes a large investment in manual organization, e.g. by careful, labor-intensive labeling of data, manual clustering (e.g. via foldering), or manual extraction and transcription of important information. As a result of the difficulties involved in finding and reusing information, particularly as the volume grows, large amounts of collected data remains unused and inaccessible. Because of that, the collection efforts tend to be abandoned, or not even implemented, given the low immediate payoff and the high cost of organization. More importantly, information that could lead to enhanced performance during learning or work situations remain untapped.
The focus of the present workshop is therefore on issues related to theory, methods and techniques for facilitating the organization, retrieval and reuse of multimodal information. The emphasis is on organization and retrieval of information related to human activity, i.e. that is generated and consumed by individuals and groups as they go about their work, learning and leisure.
This booklet includes position papers as well as technical contributions related to: User interface design and evaluation; Tagging, mining and retrieval techniques; Applications of multimodal retrieval, and Cognitive foundations of organization and search of multimodal materials.
Proceeding Downloads
Verbal behavior of the more and the less influential meeting participant
We test the strength of the relationship between the way that people behave in a discussion and their level of influence on the basis of some empirical grounds. We use the data sources that were collected from the AMI corpus for the experiments in the ...
Multimodal corpus of multi-party meetings for automatic social behavior analysis and personality traits detection
- Nadia Mana,
- Bruno Lepri,
- Paul Chippendale,
- Alessandro Cappelletti,
- Fabio Pianesi,
- Piergiorgio Svaizer,
- Massimo Zancanaro
This paper describes an automatically annotated multimodal corpus of multi-party meetings. The corpus provides for each subject involved in the experimental sessions information on her/his social behavior and personality traits, as well as audiovisual ...
Wi-roni: a gesture tangible interface for experiencing internet content in public spaces
In this paper, we describe a case study in which we explore the opportunity of gesture tangible interfaces to allow the retrieval of web content. Wi-roni provides audio content (streaming radio and podcasts), and the interface is based on capturing ...
Personalization in multimodal interfaces
This paper describes a novel view to the area of multimodal interfaces from the perspective of personalization. As a position paper it analyses properties of multimodality in relation to features of personalization. As a short research paper, it ...
Modeling temporal dependencies between observed activities
The modeling of parallel activities requires a notation which can represent the temporal dependencies as well as variations of the execution order of the activities. This paper introduces ART (Activity Relation Trees), a notation to describe temporal ...
Tagging strategies for extracting real-world events with networked sensors
In this paper, we introduce our 's-room' project as well as the tagging strategies and environment developed for the project. In the s-room, many small sensor nodes are attached to various objects. Our project aims to construct a system for ...
Multi-modal conversational analysis of poster presentations using multiple sensors
We are constructing a research environment called the "IMADE room", which can capture a variety of multi-modal human interactions. With this setting, we have designed and conducted recordings of poster sessions made by one presenter and two audiences. ...
Sunrise: towards location based clustering for assisted photo management
We present an end to end system 'Sunrise' to assist users in using location based data to tag, cluster, and find digital photos. We suggest that location tagging of photos is a common desire of users but existing manual solutions are too time consuming ...
Cross-domain matching for automatic tag extraction across redundant handwriting and speech events
In many types of natural human-human interactions people communicate important information redundantly across multiple communication modes, like saying what they handwrite during a presentation or discussion. To detect and benefit from such redundancies ...
Recommendations
Workshop on tagging, mining and retrieval of human related activity information
ICMI '07: Proceedings of the 9th international conference on Multimodal interfacesInexpensive and user friendly cameras, microphones, and other devices such as digital pens are making it increasingly easy to capture, store and process large amounts of data over a variety of media. Even though the barriers for data acquisition have ...
Tagging and folksonomies for information retrieval in Web 2.0
CNS '13: Proceedings of the 16th Communications & Networking SymposiumThe aim of this paper is to emphasize the role of tagging and folksonomies in information retrieval in Web 2.0. Also, this paper justifies the existence of tagging and folksonomies for better information retrieval in Web 2.0. In recent years, Web 2.0 ...