research-article

Understanding re-finding behavior in naturalistic email interaction logs

Authors:

David Elsweiler,

Martin HackerAuthors Info & Claims

SIGIR '11: Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval

Pages 35 - 44

https://doi.org/10.1145/2009916.2009925

Published: 24 July 2011 Publication History

Abstract

In this paper we present a longitudinal, naturalistic study of email behavior (n=47) and describe our efforts at isolating re-finding behavior in the logs through various qualitative and quantitative analyses. The presented work underlines the methodological challenges faced with this kind of research, but demonstrates that it is possible to isolate re-finding behavior from email interaction logs with reasonable accuracy. Using the approaches developed we uncover interesting aspects of email re-finding behavior that have so far been impossible to study, such as how various features of email-clients are used in re-finding and the difficulties people encounter when using these. We explain how our findings could influence the design of email-clients and outline our thoughts on how future, more in depth analyses, can build on the work presented here to achieve a fuller understanding of email behavior and the support that people need.

References

[1]

A. Aula, N. Jhaveri, and M. Käki. Information search and reaccess strategies of experienced web users. In Proc. 14th Int'l Conf. World Wide Web, pages 583--592. ACM Press, 2005.

Digital Library

[2]

O. Bälter. Keystroke level analysis of email message organization. In Proc. SIGCHI conference on Human factors in computing systems, pages 105--112, 2000.

Digital Library

[3]

D. K. Barreau and B. Nardi. Finding and reminding: File organization from the desktop. ACM SIGCHI Bulletin, 27(3):39--43, 1995.

Digital Library

[4]

O. Bergman, R. Beyth-Marom, R. Nachmias, N. Gradovitch, and S. Whittaker. Improved search engines and navigation preference in personal information management. ACM Trans. Inf. Syst., 26(4):1--24, 2008.

Digital Library

[5]

R. Boardman and M. A. Sasse. "stuff goes into the computer and doesn't come out": a cross-tool study of personal information management. In CHI'04: Proc. SIGCHI, pages 583--590, 2004.

Digital Library

[6]

R. G. Capra and M. A. Perez-Quinones. Using web search engines to find and refind information. Computer, 38(10):36--42, 2005.

Digital Library

[7]

E. Cutrell, D. Robbins, S. Dumais, and R. Sarin. Fast, flexible filtering with phlat. In Proc. SIGCHI conference on Human Factors in computing systems, pages 261--270, 2006.

Digital Library

[8]

N. Ducheneaut and V. Bellotti. E-mail as habitat: an exploration of embedded personal information management. interactions, 8(5):30--38, 2001.

Digital Library

[9]

S. Dumais, E. Cutrell, J. Cadiz, G. Jancke, R. Sarin, and D.C. Robbins. Stuff i've seen: a system for personal information retrieval and re-use. In Proc. ACM SIGIR'03:, pages 72--79, 2003.

Digital Library

[10]

D. Elsweiler, M. Baillie, and I. Ruthven. Exploring memory in email refinding. ACM Trans. Inf. Syst., 26(4):1--36, 2008.

Digital Library

[11]

D. Elsweiler, M. Baillie, and I. Ruthven. What makes re-finding information diffcult? a study of email re-finding. In Proc. ECIR 2011, 2011.

Digital Library

[12]

D. Elsweiler, M. Hacker, and S. Mandl. Visualising pim behaviour with markov chains. In Personal Information Management Workshop at Annual Meeting of American Society for Information Science (ASIST 2009), 2009.

[13]

D. Elsweiler and I. Ruthven. Towards task-based personal information management evaluations. In Proc. ACM SIGIR conference on Research and development in information retrieval, pages 23--30, 2007.

Digital Library

[14]

W. Jones, H. Bruce, and S. Dumais. How do people get back to information on the web? how can they do it better? Proc. INTERACT, 2003.

[15]

W. Jones and J. Teevan, editors. Personal Information Management. Seattle: University of Washington Press, 2007.

[16]

T. W. Malone. How do people organize their desks?: Implications for the design of office information systems. ACM Trans. Inf. Syst., 1(1):99--112, 1983.

Digital Library

[17]

P. McCullagh and J. A. Nelder. Generalized Linear Models (Second Edition). Chapman and Hall, 1989.

[18]

B. McKenzie and A. Cockburn. An empirical analysis of web page revisitation. In Proc. of the HICSS34, 2001.

Digital Library

[19]

A. Y. Ng. Feature selection, l1 vs. l2 regularization, and rotational invariance. In Proceedings of the twenty-first international conference on Machine learning, ICML'04, pages 78--, New York, NY, USA, 2004. ACM.

Digital Library

[20]

V. L. O'Day and R. Jeffries. Orienteering in an information landscape: How information seekers get from here to there. In Proceedings of INTERCHI'93, pages 438--445, 1993.

Digital Library

[21]

M. Ringel, E. Cutrell, S. Dumais, and E. Horvitz. Milestones in time: The value of landmarks in retrieving information from personal stores. In Proc. INTERACT 2003, pages 184--191, 2003.

[22]

C. Silverstein, M. Henzinger, H. Marais, and M. Moricz. Analysis of a very large alta vista query log. Technical report, SRC, 1998. Technical Note 1998-014.

[23]

J. Teevan, E. Adar, R. Jones, and M. Potts. Information re-retrieval: Repeat queries in yahoo's logs. In Proc. SIGIR'07, 2007.

Digital Library

[24]

J. Teevan, C. Alvarado, M. S. Ackerman, and D. R. Karger. The perfect search engine is not enough: a study of orienteering behavior in directed search. In Proc. SIGCHI conference on Human factors in computing systems, pages 415--422, 2004.

Digital Library

[25]

S. K. Tyler and J. Teevan. Large scale query log analysis of re-finding. In Proc. WSDM'10, 2010.

Digital Library

[26]

R. W. White and S. M. Drucker. Investigating behavioral variability in web search. In Proc. international conference on WWW, pages 21--30, New York, NY, USA, 2007. ACM.

Digital Library

[27]

S. Whittaker, V. Bellotti, and J. Gwizdka. Personal Information Management, chapter Everything through Email, pages 167--189. Seattle: University of Washington Press., 2007.

[28]

S. Whittaker, Q. Jones, and L. Terveen. Contact management: Identifying contacts to support long term communication. In Proc. CSCW'02, pages 216--225, 2002.

Digital Library

[29]

S. Whittaker and C. Sidner. Email overload: exploring personal information management of email. In CHI'96: Proc SIGCHI conference on Human factors in computing systems, pages 276--283, 1996.

Digital Library

Cited By

Wang ZWei WFeng SMao XQiu MChen DFang R(2024)Exploiting Group-Level Behavior Pattern for Session-Based RecommendationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.328031036:1(152-166)Online publication date: Jan-2024
https://doi.org/10.1109/TKDE.2023.3280310
Brackenbury WChard KElmore AUr B(2022)Summarizing Sets of Related ML-Driven Recommendations for Improving File Management in Cloud StorageProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545704(1-11)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545704
Bhargav SSidiropoulos GKanoulas ESelcuk Candan KLiu HAkoglu LLuna Dong XTang J(2022)'It's on the tip of my tongue'Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining10.1145/3488560.3498421(48-56)Online publication date: 11-Feb-2022
https://dl.acm.org/doi/10.1145/3488560.3498421
Show More Cited By

Index Terms

Understanding re-finding behavior in naturalistic email interaction logs
1. Information systems
  1. Information retrieval

Recommendations

Information re-retrieval: repeat queries in Yahoo's logs
SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval

People often repeat Web searches, both to find new information on topics they have previously explored and to re-find information they have seen in the past. The query associated with a repeat search may differ from the initial query but can nonetheless ...
Large scale query log analysis of re-finding
WSDM '10: Proceedings of the third ACM international conference on Web search and data mining

Although Web search engines are targeted towards helping people find new information, people regularly use them to re-find Web pages they have seen before. Researchers have noted the existence of this phenomenon, but relatively little is understood ...
Characterizing Email Search using Large-scale Behavioral Logs and Surveys
WWW '17: Proceedings of the 26th International Conference on World Wide Web

As the number of email users and messages continues to grow, search is becoming more important for finding information in personal archives. In spite of its importance, email search is much less studied than web search, particularly using large-scale ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '11: Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval

July 2011

1374 pages

ISBN:9781450307574

DOI:10.1145/2009916

General Chairs:
Wei-Ying Ma
Microsoft Research Asia, China
,
Jian-Yun Nie
University of Montreal, Canada
,
Program Chairs:
Ricardo Baeza-Yates
Yahoo! Research, Spain
,
Tat-Seng Chua
National University of Singapore
,
W. Bruce Croft
University of Massachusetts, Amherst, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGIR '11

Sponsor:

SIGIR

SIGIR '11: The 34th International ACM SIGIR conference on research and development in Information Retrieval

July 24 - 28, 2011

Beijing, China

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
524
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang ZWei WFeng SMao XQiu MChen DFang R(2024)Exploiting Group-Level Behavior Pattern for Session-Based RecommendationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.328031036:1(152-166)Online publication date: Jan-2024
https://doi.org/10.1109/TKDE.2023.3280310
Brackenbury WChard KElmore AUr B(2022)Summarizing Sets of Related ML-Driven Recommendations for Improving File Management in Cloud StorageProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545704(1-11)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545704
Bhargav SSidiropoulos GKanoulas ESelcuk Candan KLiu HAkoglu LLuna Dong XTang J(2022)'It's on the tip of my tongue'Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining10.1145/3488560.3498421(48-56)Online publication date: 11-Feb-2022
https://dl.acm.org/doi/10.1145/3488560.3498421
Korzeniowski LGoczyla K(2022)Landscape of Automated Log Analysis: A Systematic Literature Review and Mapping StudyIEEE Access10.1109/ACCESS.2022.315254910(21892-21913)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3152549
Fan YTu ZLi YChen XGao HZhang LSu LJin D(2020)Personalized Context-aware Collaborative Online Activity PredictionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33698293:4(1-28)Online publication date: 14-Sep-2020
https://dl.acm.org/doi/10.1145/3369829
Ashkan AMetzler DPiwowarski BChevalier MGaussier EMaarek YNie JScholer F(2019)Revisiting Online Personal Search Metrics with the User in MindProceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3331184.3331266(625-634)Online publication date: 18-Jul-2019
https://dl.acm.org/doi/10.1145/3331184.3331266
Mackenzie JGupta KQiao FAwadallah AShokouhi M(2019)Exploring User Behavior in Email Re-Finding TasksThe World Wide Web Conference10.1145/3308558.3313450(1245-1255)Online publication date: 13-May-2019
https://dl.acm.org/doi/10.1145/3308558.3313450
Sarrafzadeh BHassan Awadallah ALin CLee CShokouhi MDumais SCulpepper JMoffat ABennett PLerman K(2019)Characterizing and Predicting Email Deferral BehaviorProceedings of the Twelfth ACM International Conference on Web Search and Data Mining10.1145/3289600.3291028(627-635)Online publication date: 30-Jan-2019
https://dl.acm.org/doi/10.1145/3289600.3291028
Zhao QBennett PFourney AThompson AWilliams STroy ADumais SCollins-Thompson KMei QDavison BLiu YYilmaz E(2018)Calendar-Aware Proactive Email RecommendationThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210001(655-664)Online publication date: 27-Jun-2018
https://dl.acm.org/doi/10.1145/3209978.3210001
Alrashed TAwadallah ADumais SShah CBelkin NByström KHuang JScholer F(2018)The Lifetime of Email MessagesProceedings of the 2018 Conference on Human Information Interaction & Retrieval10.1145/3176349.3176398(120-129)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1145/3176349.3176398
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents