research-article

InSense: Interest-Based Life Logging

Authors:

Alex (Sandy) Pentland,

Gerhard TrosterAuthors Info & Claims

IEEE MultiMedia, Volume 13, Issue 4

Pages 40 - 48

https://doi.org/10.1109/MMUL.2006.87

Published: 01 October 2006 Publication History

Abstract

Our wearable data collection system lets users collect their experiences into a continually growing and adapting multimedia diary. The system--called inSense--uses the patterns in sensor readings from a camera, microphone, and accelerometers to classify the user's activities and automatically collect multimedia clips when the user is in an "interesting" situation.

References

[1]

V. Bush, "As We May Think," The Atlantic Monthly, July 1945;

[2]

B. Rhodes and T. Starner, "Remembrance Agent: A Continuously Running Automated Information Retrieval System," Proc. 1st Int'l Conf. Practical Application of Intelligent Agents and Multi-Agent Technology, 1996, pp. 487–495.

[3]

B. Clarkson and A. Pentland, "Unsupervised Clustering of Ambulatory Audio and Video," Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, IEEE CS Press, vol. 6, 1999, pp. 3037–3040.

Digital Library

[4]

B. Clarkson, K. Mase, and A. Pentland, "The Familiar: A Living Diary and Companion," Proc. ACM Conf. Computer-Human Interaction, ACM Press, pp. 271–272.

Digital Library

[5]

J. Gemmell et al., "MyLifeBits: Fulfilling the Memex Vision," Proc. ACM Multimedia, ACM Press, 2002, pp. 235–238.

Digital Library

[6]

A. Fitzgibbon and E. Reiter, "'Memories for Life': Managing Information over a Human Lifetime," UK Computing Research Committee Grand Challenge proposal, 2003.

[7]

S. Vemuri and W. Bender, "Next-Generation Personal Memory Aids," BT Technology J., vol. 22, no. 4, 2004;

Digital Library

[8]

B. Clarkson, "Life Patterns," doctoral dissertation, Program in Media Arts and Sciences, Massachusetts Inst. of Technology, 2003.

[9]

C. Dickie et al., "Augmenting and Sharing Memory with eyeBlog," Proc. 1st ACM Workshop on Continuous Archival and Retrieval of Personal Experiences, ACM Press, 2004.

Digital Library

[10]

J. Gemmell et al., "Passive Capture and Ensuing Issues for a Personal Lifetime Store," Proc. Continuous Archival and Retrieval of Personal Experiences, ACM Press, 2004.

Digital Library

[11]

E.M. Tapia et al., "MITes: Wireless Portable Sensors for Studying Behavior," Proc. Extended Abstracts, Ubiquitous Computing, 2004.

[12]

L. Bao and S.S. Intille, "Activity Recognition from User-Annotated Acceleration Data," Pervasive Computing: Proc. 2nd Int'l Conf., 2004, pp. 1–17.

[13]

D. Wyatt, M. Philipose, and T. Choudhury, "Unsupervised Activity Recognition Using Automatically Mined Common Sense," Proc. 20th Nat'l Conf. Artificial Intelligence, 2005.

Digital Library

[14]

R. DeVaul et al., "MIThril 2003: Applications and Architecture," Proc. IEEE Int'l Semantic Web Conf., IEEE CS Press, 2003, p. 4.

Digital Library

[15]

M. Blum, "Real-Time Context Recognition," master's thesis, Dept. of Information Technology and Electrical Eng., ETH Zurich, 2005.

Cited By

Janaka NCai RZhao SHsu D(2024)Demonstrating PANDALens: Enhancing Daily Activity Documentation with AI-assisted In-Context Writing on OHMDExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648644(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3648644
Cai RJanaka NChen YWang LZhao SLiu C(2024)PANDALens: Towards AI-Assisted In-Context Writing on OHMD During TravelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642320(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642320
Gomaa WKhamis M(2023)A perspective on human activity recognition from inertial motion dataNeural Computing and Applications10.1007/s00521-023-08863-935:28(20463-20568)Online publication date: 31-Jul-2023
https://dl.acm.org/doi/10.1007/s00521-023-08863-9
Show More Cited By

Index Terms

InSense: Interest-Based Life Logging

Recommendations

A context recognition method using temperature sensors in the nostrils
ISWC '18: Proceedings of the 2018 ACM International Symposium on Wearable Computers

We can benefit from various services with context recognition using wearable sensors. In this study, we focus on the contexts acquired from sensor data in the nostrils. Nostrils can provide various contexts on breathing, nasal congestion, and higher ...
Wearable Sensing Framework for Human Activity Monitoring
WearSys '15: Proceedings of the 2015 workshop on Wearable Systems and Applications

Wearable computation is getting integrated into our daily life day by day. In this work, we propose a generic framework to continuously monitor users' daily activities. The framework proposes light computation tasks on the wearable device to reduce the ...
Power and accuracy trade-offs in sound-based context recognition systems

This paper presents an empirical design methodology to optimize a context recognition system with respect to a trade-off between power consumption and recognition performance rather than straightforward maximization of the recognition rate. As ...

Comments

Information & Contributors

Information

Published In

cover image IEEE MultiMedia

IEEE MultiMedia Volume 13, Issue 4

October 2006

93 pages

ISSN:1070-986X

Issue’s Table of Contents

Copyright © 2006.

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 October 2006

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Janaka NCai RZhao SHsu D(2024)Demonstrating PANDALens: Enhancing Daily Activity Documentation with AI-assisted In-Context Writing on OHMDExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648644(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3648644
Cai RJanaka NChen YWang LZhao SLiu C(2024)PANDALens: Towards AI-Assisted In-Context Writing on OHMD During TravelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642320(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642320
Gomaa WKhamis M(2023)A perspective on human activity recognition from inertial motion dataNeural Computing and Applications10.1007/s00521-023-08863-935:28(20463-20568)Online publication date: 31-Jul-2023
https://dl.acm.org/doi/10.1007/s00521-023-08863-9
Zhao YChang YLu YWang YDong MLv QDick RYang FLu TGu NShang L(2022)Do Smart Glasses Dream of Sentimental Visions?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172506:1(1-29)Online publication date: 29-Mar-2022
https://dl.acm.org/doi/10.1145/3517250
Kakaraparthi VMcDaniel TVenkateswara HGoldberg M(2022)PERACTIV: Personalized Activity Monitoring - Ask My HandsDistributed, Ambient and Pervasive Interactions. Smart Living, Learning, Well-being and Health, Art and Creativity10.1007/978-3-031-05431-0_18(255-272)Online publication date: 26-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-031-05431-0_18
Osman NChenu-Abente RShen QSierra CGiunchiglia F(2021)Empowering Users in Online Open CommunitiesSN Computer Science10.1007/s42979-021-00714-52:4Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1007/s42979-021-00714-5
Aiordăchioae AGherasim DMaciuc AGheran BVatavu R(2020)Addressing Inattentional Blindness with Smart Eyewear and Vibrotactile Feedback on the Finger, Wrist, and ForearmProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3432080(329-331)Online publication date: 22-Nov-2020
https://dl.acm.org/doi/10.1145/3428361.3432080
Xia QKorpela JNamioka YMaekawa T(2020)Robust Unsupervised Factory Activity Recognition with Body-worn Accelerometer Using Temporal Structure of Multiple Sensor Data MotifsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34118364:3(1-30)Online publication date: 4-Sep-2020
https://dl.acm.org/doi/10.1145/3411836
Aiordăchioae AFurtună DVatavu RPrandi CMarquez-Barja J(2020)Aggregating Life Tags for Opportunistic Crowdsensing with Mobile and Smartglasses UsersProceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good10.1145/3411170.3411237(66-71)Online publication date: 14-Sep-2020
https://dl.acm.org/doi/10.1145/3411170.3411237
Lu ZAnnett MWigdor D(2019)Vicariously Experiencing it all Without Going OutsideProceedings of the ACM on Human-Computer Interaction10.1145/33591273:CSCW(1-28)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359127
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents