Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3544548.3580847acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

CiteSee: Augmenting Citations in Scientific Papers with Persistent and Personalized Historical Context

Published: 19 April 2023 Publication History

Abstract

When reading a scholarly article, inline citations help researchers contextualize the current article and discover relevant prior work. However, it can be challenging to prioritize and make sense of the hundreds of citations encountered during literature reviews. This paper introduces CiteSee, a paper reading tool that leverages a user’s publishing, reading, and saving activities to provide personalized visual augmentations and context around citations. First, CiteSee connects the current paper to familiar contexts by surfacing known citations a user had cited or opened. Second, CiteSee helps users prioritize their exploration by highlighting relevant but unknown citations based on saving and reading history. We conducted a lab study that suggests CiteSee is significantly more effective for paper discovery than three baselines. A field deployment study shows CiteSee helps participants keep track of their explorations and leads to better situational awareness and increased paper discovery via inline citation when conducting real-world literature reviews.

Supplementary Material

MP4 File (3544548.3580847-talk-video.mp4)
Pre-recorded Video Presentation

References

[1]
2019. CHI ’19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk). Association for Computing Machinery, New York, NY, USA.
[2]
Sriram Karthik Badam, Zhicheng Liu, and Niklas Elmqvist. 2019. Elastic Documents: Coupling Text and Tables through Contextual Visualizations for Enhanced Document Reading. IEEE Transactions on Visualization and Computer Graphics 25 (2019), 661–671.
[3]
Xiaomei Bai, Mengyang Wang, Ivan Lee, Zhuo Yang, Xiangjie Kong, and Feng Xia. 2019. Scientific Paper Recommendation: A Survey. IEEE Access 7(2019), 9324–9339.
[4]
CHARLES BAZERMAN. 1985. Physicists Reading Physics: Schema-Laden Purposes and Purpose-Laden Schema. Written Communication 2, 1, 3–23.
[5]
Iz Beltagy, Kyle Lo, and Arman Cohan. 2019. SciBERT: A Pretrained Language Model for Scientific Text. In EMNLP.
[6]
Andrea Bianchi, So-Ryang Ban, and Ian Oakley. 2015. Designing a Physical Aid to Support Active Reading on Tablets. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015).
[7]
Richard E. Boyatzis. 1998. Transforming Qualitative Information: Thematic Analysis and Code Development.
[8]
Rollin Brant. 1990. Assessing Proportionality in the Proportional Odds Model for Ordinal Logistic Regression. Biometrics 46, 4 (1990), 1171–1178. http://www.jstor.org/stable/2532457
[9]
Isabel Cachola, Kyle Lo, Arman Cohan, and Daniel S. Weld. 2020. TLDR: Extreme Summarization of Scientific Documents. In FINDINGS.
[10]
Arie Cattan, Sophie Johnson, Daniel Weld, Ido Dagan, Iz Beltagy, Doug Downey, and Tom Hope. 2021. SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts. arXiv preprint arXiv:2104.08809(2021).
[11]
Joseph Chee Chang, Nathan Hahn, and Aniket Kittur. 2016. Supporting mobile sensemaking through intentionally uncertain highlighting. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 61–68.
[12]
Duen Horng Chau, Aniket Kittur, Jason I. Hong, and Christos Faloutsos. 2011. Apolo: making sense of large network data by combining rich user interaction and machine learning. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2011).
[13]
Daniel K. Y. Chen, Jean-Baptiste Chossat, and Peter B. Shull. 2019. HaptiVec: Presenting Haptic Feedback Vectors in Handheld Controllers using Embedded Tactile Pin Arrays. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (2019).
[14]
Rune Haubo B Christensen. 2018. Cumulative link models for ordinal regression with the R package ordinal. Submitted in J. Stat. Software 35 (2018).
[15]
Victoria Clarke and Virginia Braun. 2013. Successful qualitative research: A practical guide for beginners. Successful Qualitative Research(2013), 1–400.
[16]
Arman Cohan, Waleed Ammar, Madeleine van Zuylen, and Field Cady. 2019. Structural Scaffolds for Citation Intent Classification in Scientific Publications. In NAACL.
[17]
Arman Cohan, Sergey Feldman, Iz Beltagy, Doug Downey, and Daniel S. Weld. 2020. SPECTER: Document-level Representation Learning using Citation-informed Transformers. ArXiv abs/2004.07180(2020).
[18]
Lynne M. Connelly. 2013. Grounded theory.Medsurg nursing : official journal of the Academy of Medical-Surgical Nurses 22 2(2013), 124, 127.
[19]
david nicholas, peter williams, ian rowlands, and hamid r. jamali. 2010. researchers’ e-journal use and information seeking behaviour. journal of information science 36 (2010), 494 – 516.
[20]
Graham Dove and Anne-Laure Fayard. 2020. Monsters, Metaphors, and Machine Learning. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (2020).
[21]
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. UX Design Innovation: Challenges for Working with Machine Learning as a Design Material. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (2017).
[22]
Markus Eberts and Adrian Ulges. 2020. Span-based Joint Entity and Relation Extraction with Transformer Pre-training. ArXiv abs/1909.07755(2020).
[23]
James A. Evans. 2008. Electronic Publication and the Narrowing of Science and Scholarship. Science 321(2008), 395 – 399.
[24]
Marco Gori and Augusto Pucci. 2006. Research Paper Recommender Systems: A Random-Walk Based Approach. 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI’06)(2006), 778–781.
[25]
Han L Han, Junhang Yu, Raphael Bournet, Alexandre Ciorascu, Wendy E Mackay, and Michel Beaudouin-Lafon. 2022. Passages: Interacting with Text Across Documents. In CHI Conference on Human Factors in Computing Systems. 1–17.
[26]
Jiangen He, Q. Ping, Wen Lou, and Chaomei Chen. 2019. PaperPoles: Facilitating adaptive visual exploration of scientific publications by citation links. Journal of the Association for Information Science and Technology 70 (2019).
[27]
Andrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S. Weld, and Marti A. Hearst. 2021. Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (2021).
[28]
Terje Hillesund. 2010. Digital Reading Spaces: How Expert Readers handle Books, the Web and Electronic Paper. First Monday 15(2010).
[29]
Zan Huang, Wingyan Chung, Thian-Huat Ong, and Hsinchun Chen. 2002. A graph-based recommender system for digital library. In JCDL ’02.
[30]
Hyeonsu Kang, Joseph Chee Chang, Yongsung Kim, and Aniket Kittur. 2022. Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific Literature. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–15.
[31]
Hyeonsu B. Kang, Rafal Kocielnik, Andrew Head, Jiangjiang Yang, Matt Latzke, Aniket Kittur, Daniel S. Weld, Doug Downey, and Jonathan Bragg. 2022. From Who You Know to What You Read: Augmenting Scientific Recommendations with Implicit Social Networks. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2022).
[32]
Dae Hyun Kim, Enamul Hoque, Juho Kim, and Maneesh Agrawala. 2018. Facilitating Document Reading by Linking Text and Tables. Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (2018).
[33]
Donald W. King, Carol Tenopir, Songphan Choemprayong, and Lei Wu. 2009. Scholarly journal information‐seeking and reading patterns of faculty at five US universities. Learned Publishing 22(2009).
[34]
Nicholas Kong, Marti A. Hearst, and Maneesh Agrawala. 2014. Extracting references between text and charts via crowdsourcing. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2014).
[35]
Andrew Kuznetsov, Joseph Chee Chang, Nathan Hahn, Napol Rachatasumrit, Bradley Breneisen, Julina Coupland, and Aniket Kittur. 2022. Fuse: In-Situ Sensemaking Support in the Browser. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–15.
[36]
Patrice Lopez. 2009. GROBID: Combining automatic bibliographic data recognition and term extraction for scholarship publications. In International conference on theory and practice of digital libraries. Springer, 473–474.
[37]
Yi Luan, Luheng He, Mari Ostendorf, and Hannaneh Hajishirzi. 2018. Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction. In EMNLP.
[38]
Jock D. Mackinlay, Ramana Rao, and Stuart K. Card. 1995. An organic user interface for searching citation links. In CHI ’95.
[39]
Gary Marchionini. 2006. Exploratory Search: From Finding to Understanding.
[40]
Catherine C. Marshall, Morgan N. Price, Gene Golovchinsky, and Bill N. Schilit. 1999. Introducing a digital library reading appliance into a reading group. In DL ’99.
[41]
Kenton P. O’Hara. 1998. Rank Xerox Research Centre Cambridge Laboratory Towards a Typology of Reading Goals RXRC Affordances of Paper Project.
[42]
Srishti Palani, Zijian Ding, Austin Nguyen, Andrew Chuang, Stephen MacNeil, and Steven P Dow. 2021. CoNotate: Suggesting Queries Based on Notes Promotes Knowledge Discovery. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.
[43]
Srishti Palani, Yingyi Zhou, Sheldon Zhu, and Steven P Dow. 2022. InterWeave: Presenting Search Suggestions in Context Scaffolds Information Search and Synthesis. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–16.
[44]
Carole L Palmer, Lauren C Teffeau, and Carrie M Pirmann. 2009. Scholarly information practices in the online environment. Report commissioned by OCLC Research. Published online at: www. oclc. org/programs/publications/reports/2009-02. pdf (2009).
[45]
Simon Philip, Peter Bamidele Shola, and Abari Ovye John. 2014. Application of Content-Based Approach in Research Paper Recommendation System for a Digital Library. International Journal of Advanced Computer Science and Applications 5 (2014).
[46]
Peter Pirolli and Stuart K. Card. 1995. Information foraging in information access environments. In CHI ’95.
[47]
Antoine Ponsard, Francisco Escalona, and Tamara Munzner. 2016. PaperQuest: A Visualization Tool to Support Literature Review. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(2016).
[48]
Brett Powley, R. Dale, and Ilya Anisimoff. 2009. Enriching a document collection by integrating information extraction and PDF annotation. In Electronic Imaging.
[49]
Napol Rachatasumrit, Jonathan Bragg, Amy X. Zhang, and Daniel S. Weld. 2022. CiteRead: Integrating Localized Citation Contexts into Scientific Paper Reading. 27th International Conference on Intelligent User Interfaces (2022).
[50]
Napol Rachatasumrit, Gonzalo Ramos, Jina Suh, Rachel S. Ng, and Christopher Meek. 2021. ForSense: Accelerating Online Research Through Sensemaking Integration and Machine Research Support. 26th International Conference on Intelligent User Interfaces (2021).
[51]
Daniel M. Russell, Mark Stefik, Peter Pirolli, and Stuart K. Card. 1993. The cost structure of sensemaking. Proceedings of the INTERACT ’93 and CHI ’93 Conference on Human Factors in Computing Systems (1993).
[52]
Jeffrey M Rzeszotarski and Aniket Kittur. 2011. Instrumenting the crowd: using implicit behavioral measures to predict task performance. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 13–22.
[53]
Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2019. Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (2019).
[54]
Kazunari Sugiyama and Min-Yen Kan. 2010. Scholarly paper recommendation via user’s recent research interests. In JCDL ’10.
[55]
Yuqian Sun, Shigeo Yoshida, Takuji Narumi, and Michitaka Hirose. 2019. PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (2019).
[56]
Craig S. Tashman and W. Keith Edwards. 2011. Active reading and its discontents: the situations, problems and ideas of readers. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2011).
[57]
Craig S. Tashman and W. Keith Edwards. 2011. LiquidText: a flexible, multitouch environment to support active reading. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2011).
[58]
Carol Tenopir and Donald W. King. 2008. Electronic Journals and Changes in Scholarly Article Seeking and Reading Patterns. D-lib Magazine 14(2008).
[59]
Carol Tenopir, Rachel Volentine, and Donald W. King. 2012. Scholarly Reading and the Value of Academic Library Collections: Results of A Study in Six UK Universities. Insights: The UKSG Journal 25 (2012), 130–149.
[60]
Marco Valenzuela, Vu A. Ha, and Oren Etzioni. 2015. Identifying Meaningful Citations. In AAAI Workshop: Scholarly Big Data.
[61]
Francesco Vitale, Izabelle Janzen, and Joanna McGrenere. 2018. Hoarding and minimalism: Tendencies in digital data preservation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.
[62]
Chong Wang and David M. Blei. 2011. Collaborative topic modeling for recommending scientific articles. In KDD.
[63]
Feng Xia, Haifeng Liu, Ivan Lee, and Longbing Cao. 2016. Scientific Article Recommendation: Exploiting Common Author Relations and Historical Preferences. IEEE Transactions on Big Data 2 (2016), 101–G112.
[64]
Qian Yang, Alex Sciuto, John Zimmerman, Jodi Forlizzi, and Aaron Steinfeld. 2018. Investigating How Experienced UX Designers Effectively Work with Machine Learning. Proceedings of the 2018 Designing Interactive Systems Conference (2018).
[65]
Houjin Yu, Xianling Mao, Zewen Chi, Wei Wei, and Heyan Huang. 2020. A Robust and Domain-Adaptive Approach for Low-Resource Named Entity Recognition. 2020 IEEE International Conference on Knowledge Graph (ICKG) (2020), 297–304.

Cited By

View all
  • (2024)Attention is All They Need: Exploring the Media Archaeology of the Computer Vision Research PaperProceedings of the ACM on Human-Computer Interaction10.1145/36869558:CSCW2(1-25)Online publication date: 8-Nov-2024
  • (2024)The Semantic Reader ProjectCommunications of the ACM10.1145/365909667:10(50-61)Online publication date: 26-Sep-2024
  • (2024)Qlarify: Recursively Expandable Abstracts for Dynamic Information Retrieval over Scientific PapersProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676397(1-21)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. CiteSee: Augmenting Citations in Scientific Papers with Persistent and Personalized Historical Context

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
    April 2023
    14911 pages
    ISBN:9781450394215
    DOI:10.1145/3544548
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 April 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Badges

    • Best Paper

    Author Tags

    1. personalization
    2. reading interfaces
    3. scientific papers

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    CHI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI '25
    CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1,026
    • Downloads (Last 6 weeks)187
    Reflects downloads up to 12 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Attention is All They Need: Exploring the Media Archaeology of the Computer Vision Research PaperProceedings of the ACM on Human-Computer Interaction10.1145/36869558:CSCW2(1-25)Online publication date: 8-Nov-2024
    • (2024)The Semantic Reader ProjectCommunications of the ACM10.1145/365909667:10(50-61)Online publication date: 26-Sep-2024
    • (2024)Qlarify: Recursively Expandable Abstracts for Dynamic Information Retrieval over Scientific PapersProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676397(1-21)Online publication date: 13-Oct-2024
    • (2024)Patterns of Hypertext-Augmented SensemakingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676338(1-17)Online publication date: 13-Oct-2024
    • (2024)ReviewFlow: Intelligent Scaffolding to Support Academic Peer ReviewingProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645159(120-137)Online publication date: 18-Mar-2024
    • (2024)Supporting Novice Researchers to Write Literature Review using Language ModelsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650787(1-9)Online publication date: 11-May-2024
    • (2024)Integrating measures of replicability into scholarly search: Challenges and opportunitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3643043(1-18)Online publication date: 11-May-2024
    • (2024)Towards Inclusive Video Commenting: Introducing Signmaku for the Deaf and Hard-of-HearingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642287(1-18)Online publication date: 11-May-2024
    • (2024)PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected PapersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642196(1-19)Online publication date: 11-May-2024
    • (2024)Augmented Reality and Cross-Device Interaction for Seamless Integration of Physical and Digital Scientific PapersInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2388372(1-18)Online publication date: 22-Aug-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media