Article

A pattern mining method for interpretation of interaction

Authors:

Kenji MaseAuthors Info & Claims

ICMI '05: Proceedings of the 7th international conference on Multimodal interfaces

Pages 267 - 273

https://doi.org/10.1145/1088463.1088509

Published: 04 October 2005 Publication History

Get Access

Abstract

This paper proposes a novel mining method for multimodal interactions to extract important patterns of group activities. These extracted patterns can be used as machine-readable event indices in developing an interaction corpus based on a huge collection of human interaction data captured by various sensors. The event indices can be used, for example, to summarize a set of events and to search for particular events because they contain various pieces of context information. The proposed method extracts simultaneously occurring patterns of primitive events in interaction, such as gaze and speech, that in combination occur more consistently than randomly. The proposed method provides a statistically plausible definition of interaction events that is not possible through intuitive top-down definitions. We demonstrate the effectiveness of our method for the data captured in an experimental setup of a poster-exhibition scene. Several interesting patterns are extracted by the method, and we examined their interpretations.

References

[1]

Rodney A. Brooks, Michael Coen, Darren Dang, Jeremy~De Bonet, Josha Kramer, Tomas Lozano-Perez, John Mellor, Polly Pook, Chris Stauffer, Lynn Stein, Mark Torrance, and Michael Wessler. The intelligent room project. In Proceedings of the Second International Cognitive Technology Conference(CT'97), pages 271--278. IEEE, 1997.]]

Digital Library

Google Scholar

[2]

Barry Brumitt, Brian Meyers, John Krumm, Amanda Kern, and Steven Shafer. Easyliving: Technologies for intelligent environments. In Proceedings of HUC2000, pages 12--29. Springer LNCS1927, 2000.]]

Digital Library

Google Scholar

[3]

Gemma Casas-Garriga. Discovering unbounded episodes in sequential data. In PKDD, pages 83--94, 2003.]]

Crossref

Google Scholar

[4]

H.Mannila, H.Toivonen, and A.I.Verkamo. Discovery of frequent episodes in event sequences. Data Mining and Knowledge Discovery, 1(3):259--289, 1997.]]

Digital Library

Google Scholar

[5]

Cory D. Kidd, Robert Orr, Gregory D. Abowd, Christopher G. Atkeson, Irfan A. Essa, Blair MacIntyre, Elizabeth Mynatt, Thad E. Startner, and Wedny Newstetter. The aware home: A living laboratory for ubiquitous computing research. In Cobuild'99, pages 190--197. Springer LNCS1670, 2000.]]

Digital Library

Google Scholar

[6]

Hisashi Miyamori and Shunichi Iisaku. Video annotaion for content-based retrieval using human behavior analysis and domain knowledge. In FG2000, page 320. IEEE, March 2000.]]

Digital Library

Google Scholar

[7]

M.Kuramochi and G.Karypis. Frequent subgraph discovery. In Proc:ICDM'01, pages 313--320. IEEE, 2001.]]

Digital Library

Google Scholar

[8]

Alex Pentland. Smart rooms. Scientific American, 274(4):68--76, 1996.]]

Crossref

Google Scholar

[9]

Yasuyuki Sumi, Sadanori Ito, Tetsuya Matsuguchi, Sidney Fels, and Kenji Mase. Collaborative capturing and interpretation of interactions. In Pervasive 2004 Workshop on Memory and Sharing of Experiences, pages 1--7, 2004.]]

Google Scholar

[10]

Masashi Takahashi, Sadanori Ito, Yasuyuki Sumi, Megumu Tsuchikawa, Kiyoshi Kogure, Kenji Mase, and Toyoaki Nishida. A layered interpretation of human interactions captured by ubiquitous sensors. In CARPE'04, pages 32--38. ACM, October 2004.]]

Digital Library

Google Scholar

Cited By

View all

Shejale AGnagawane V(2016)An implementation of efficient techniques for tree based mining in human social dynamics2016 International Conference on Data Mining and Advanced Computing (SAPIENCE)10.1109/SAPIENCE.2016.7684138(8-16)Online publication date: Mar-2016
https://doi.org/10.1109/SAPIENCE.2016.7684138
Fariha AAhmed CLeung CSamiullah MPervin SCao L(2015)A new framework for mining frequent interaction patterns from meeting databasesEngineering Applications of Artificial Intelligence10.1016/j.engappai.2015.06.01945:C(103-118)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.1016/j.engappai.2015.06.019
Yu ZYu ZZhou XBecker CNakamura Y(2012)Tree-Based Mining for Discovering Patterns of Human Interaction in MeetingsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2010.22424:4(759-768)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1109/TKDE.2010.224
Show More Cited By

Index Terms

A pattern mining method for interpretation of interaction
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Closed frequent similar pattern mining

The concept of closed frequent similar pattern mining is introduced.Several lemmas to prune the search space are introduced and proved.A novel closed frequent similar pattern mining algorithm (CFSP-Miner), is proposed.CFSP-Miner is more efficient than ...
Constrained frequent pattern mining: a pattern-growth view

It has been well recognized that frequent pattern mining plays an essential role in many important data mining tasks. However, frequent pattern mining often generates a very large number of patterns and rules, which reduces not only the efficiency but ...
Pattern-growth methods for frequent pattern mining

Comments

Information & Contributors

Information

Published In

ICMI '05: Proceedings of the 7th international conference on Multimodal interfaces

October 2005

344 pages

ISBN:1595930280

DOI:10.1145/1088463

General Chairs:
Gianni Lazzari
ITC-irst, Trento (Italy)
,
Fabio Pianesi
ITC-irst, Trento (Italy)
,
Program Chairs:
James Crowley
I.N.P. Grenoble (France)
,
Kenji Mase
Nagoya University (Japan)
,
Sharon Oviatt
Oregon Health & Sciences University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI05

Sponsor:

ICMI05: Seventh International Conference on Multimodal Interfaces 2005

October 4 - 6, 2005

Torento, Italy

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
319
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Shejale AGnagawane V(2016)An implementation of efficient techniques for tree based mining in human social dynamics2016 International Conference on Data Mining and Advanced Computing (SAPIENCE)10.1109/SAPIENCE.2016.7684138(8-16)Online publication date: Mar-2016
https://doi.org/10.1109/SAPIENCE.2016.7684138
Fariha AAhmed CLeung CSamiullah MPervin SCao L(2015)A new framework for mining frequent interaction patterns from meeting databasesEngineering Applications of Artificial Intelligence10.1016/j.engappai.2015.06.01945:C(103-118)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.1016/j.engappai.2015.06.019
Yu ZYu ZZhou XBecker CNakamura Y(2012)Tree-Based Mining for Discovering Patterns of Human Interaction in MeetingsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2010.22424:4(759-768)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1109/TKDE.2010.224
Yu ZZhou XYu ZBecker CNakamura Y(2011)Social interaction mining in small group discussion using a smart meeting systemProceedings of the 8th international conference on Ubiquitous intelligence and computing10.5555/2035646.2035654(40-51)Online publication date: 2-Sep-2011
https://dl.acm.org/doi/10.5555/2035646.2035654
Yu ZZhou XYu ZBecker CNakamura Y(2011)Social Interaction Mining in Small Group Discussion Using a Smart Meeting SystemUbiquitous Intelligence and Computing10.1007/978-3-642-23641-9_6(40-51)Online publication date: 2011
https://doi.org/10.1007/978-3-642-23641-9_6
Koyama YSawamoto YHirano YKajita SMase KSuzuki TKatsuyama KYamauchi K(2010)A multi-modal dialogue analysis method for medical interviews based on design of interaction corpusPersonal and Ubiquitous Computing10.1007/s00779-010-0289-514:8(767-778)Online publication date: 1-Dec-2010
https://dl.acm.org/doi/10.1007/s00779-010-0289-5
Mase KSawamoto YKoyama YSuzuki TKatsuyama KCrowley JIvanov YWren CGatica-Perez DJohnston MStiefelhagen R(2009)Interaction pattern and motif mining method for doctor-patient multi-modal dialog analysisProceedings of the ICMI-MLMI '09 Workshop on Multimodal Sensor-Based Systems and Mobile Phones for Social Computing10.1145/1641389.1641395(1-4)Online publication date: 6-Nov-2009
https://dl.acm.org/doi/10.1145/1641389.1641395
Sawamoto YKoyama YHirano YKajita SMase KKatsuyama KYamauchi KMase KMassaro DTakeda KRoy DPotamianos A(2007)Extraction of important interactions in medical interviewsusing nonverbal informationProceedings of the 9th international conference on Multimodal interfaces10.1145/1322192.1322209(82-85)Online publication date: 12-Nov-2007
https://dl.acm.org/doi/10.1145/1322192.1322209
Mase KSumi YToriyama TTsuchikawa MIto SIwasawa SKogure KHagita N(2006)Ubiquitous Experience MediaIEEE MultiMedia10.1109/MMUL.2006.9413:4(20-29)Online publication date: 1-Oct-2006
https://dl.acm.org/doi/10.1109/MMUL.2006.94

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Closed frequent similar pattern mining

Constrained frequent pattern mining: a pattern-growth view

Pattern-growth methods for frequent pattern mining