research-article

Throwaway Citation of Prior Work Creates Risk of Bad HCI Research

Authors:

Joe Marshall,

Conor Linehan,

Jocelyn Spence,

Stefan Rennick EgglestoneAuthors Info & Claims

CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 827 - 836

https://doi.org/10.1145/3027063.3052751

Published: 06 May 2017 Publication History

Get Access

Abstract

In CHI papers, citation of previous work is typically a shallow, throwaway action that demonstrates little critical engagement with the work cited. We present a citation context analysis of over 3000 citations from 69 papers at CHI2016, which demonstrates that only 4.8% of papers cited are presented as anything other than uncontested fact. In 43% of CHI papers sampled, we found no evidence of any critical engagement. Lack of discussion and critique of previous work can encourage the spread of misunderstandings and errors. Authors, reviewers and publication venues must all change practices to respond to this failure of scholarship.

References

[1]

Bornmann, L. and Daniel, H. What do citation counts measure? A review of studies on citing behavior. 2008.

Crossref

Google Scholar

[2]

Budd, R. and Hughes, I. The Dodo Bird Verdict-controversial, inevitable and important: a commentary on 30 years of meta-analyses. Clinical psychology & psychotherapy 16, 6, 510--22.

Crossref

Google Scholar

[3]

Cozzens, S.E. What do citations count? the rhetoric-first model. Scientometrics 15, 5--6 (1989), 437--447.

Crossref

Google Scholar

[4]

Damian, I., Tan, C.S. (Sean), Baur, T., Schöning, J., Luyten, K., and André, E. Augmenting Social Interactions. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, ACM Press (2015), 565--574.

Digital Library

Google Scholar

[5]

Garfield, E. When to Cite. Library Quarterly 66, 4 (1996), 449--458.

Crossref

Google Scholar

[6]

Gilbody, S., Littlewood, E., Hewitt, C., et al. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial. BMJ (Clinical research ed.) 351, 5 (2015), h5627.

Google Scholar

[7]

Marsden, N. and Haag, M. Stereotypes and Politics: Reflections on Personas. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, (2016), 4017--4031.

Digital Library

Google Scholar

[8]

Marshall, J. and Linehan, C. Misrepresentation of Health Research in Exertion Games Literature. CHI '17 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (in press), (2017).

Digital Library

Google Scholar

[9]

Marshall, J., Linehan, C., Spence, J., and Rennick Egglestone, S. A Little Respect: Four Case Studies of HCI's Disregard for Other Disciplines. In submission, alt.chi 2017, (2017).

Digital Library

Google Scholar

[10]

Mehrabian, a and Wiener, M. Decoding of inconsistent communications. Journal of personality and social psychology 6, 1 (1967), 109--114.

Crossref

Google Scholar

[11]

Peat, J., Elliott, E., Baur, L., and Keena, V. Scientific Writing, Easy When You Know How. 2002.

Crossref

Google Scholar

[12]

Spence, J., Frohlich, D.M., and Andrews, S. Performative experience design. CHI '13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA '13, ACM Press (2013), 2049.

Digital Library

Google Scholar

[13]

Guide to a Successful Paper or Note Submission CHI 2016. https://chi2016.acm.org/wp/guide-toa-successful-paper-or-note-submission/.

Google Scholar

Cited By

View all

Tyack AMekler E(2024)Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned ParadigmsACM Transactions on Computer-Human Interaction10.1145/367323031:3(1-74)Online publication date: 15-Jun-2024
https://dl.acm.org/doi/10.1145/3673230
Robinson RAlvarez AMekler E(2024)How to write a CHI paper (asking for a friend)Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3644051(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3644051
Rogers KSeaborn K(2023)The Systematic Review-lution: A Manifesto to Promote Rigour and Inclusivity in Research SynthesisExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3582733(1-11)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3582733
Show More Cited By

Index Terms

Throwaway Citation of Prior Work Creates Risk of Bad HCI Research
1. Human-centered computing

Recommendations

Semantic similarity-based credit attribution on citation paths: a method for allocating residual citation to and investigating depth of influence of scientific communications
Abstract
This study proposes a method for assessing the impact of scientific communication on their citation paths beyond conventional direct citations. The proposed method considers the contribution of scientific communication to their nth generation ...
A decade of in-text citation analysis based on natural language processing and machine learning techniques: an overview of empirical studies
Abstract
In-text citation analysis is one of the most frequently used methods in research evaluation. We are seeing significant growth in citation analysis through bibliometric metadata, primarily due to the availability of citation databases such as the ...
Web citation persistence over time: a retrospective study

Purpose -- By studying a large number of citations in the LIS field, this paper seeks to examine carefully the persistence status of web resources specified by their domains and type of files.Design/methodology/approach -- All 2005-2008 volumes of six ...

Comments

Information & Contributors

Information

Published In

CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2017

3954 pages

ISBN:9781450346566

DOI:10.1145/3027063

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI EA '17 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
470
Total Downloads

Downloads (Last 12 months)62
Downloads (Last 6 weeks)5

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tyack AMekler E(2024)Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned ParadigmsACM Transactions on Computer-Human Interaction10.1145/367323031:3(1-74)Online publication date: 15-Jun-2024
https://dl.acm.org/doi/10.1145/3673230
Robinson RAlvarez AMekler E(2024)How to write a CHI paper (asking for a friend)Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3644051(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3644051
Rogers KSeaborn K(2023)The Systematic Review-lution: A Manifesto to Promote Rigour and Inclusivity in Research SynthesisExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3582733(1-11)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3582733
Janzen S(2022)Advancing the Advanced Search: Improving the Web of Science User Experience with a Spreadsheet Search Query ToolHCI International 2022 Posters10.1007/978-3-031-06417-3_40(292-299)Online publication date: 16-Jun-2022
https://doi.org/10.1007/978-3-031-06417-3_40
Collective CMolina León GKirabo LWong-Villacres MKarusala NKumar NBidwell NReynolds-Cuéllar PBorah PGarg ROswal SChuanromanee TSharma V(2021)Following the Trail of Citational Justice: Critically Examining Knowledge Production in HCICompanion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3462204.3481732(360-363)Online publication date: 23-Oct-2021
https://dl.acm.org/doi/10.1145/3462204.3481732
Jürgens SCorreia NMasu RKaltenbrunner MMurer MWolf KOakley I(2021)The Body Beyond Movement: (Missed) Opportunities to Engage with Contemporary Dance in HCIProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440624(1-9)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440624
Wang LMack KMcDonnell EJain DFindlater LFroehlich J(2021)A bibliometric analysis of citation diversity in accessibility and HCI researchExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451618(1-7)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451618
Kumar NKarusala N(2021)Braving Citational Justice in Human-Computer InteractionExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3450389(1-9)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3450389
Sicart MShklovski IWakkary RAndersen KOdom WDesjardins APetersen M(2020)'Pataphysical SoftwareProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395526(1859-1871)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395526
Tyack AMekler EBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Self-Determination Theory in HCI Games Research: Current Uses and Open QuestionsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376723(1-22)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376723
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Semantic similarity-based credit attribution on citation paths: a method for allocating residual citation to and investigating depth of influence of scientific communications

A decade of in-text citation analysis based on natural language processing and machine learning techniques: an overview of empirical studies

Web citation persistence over time: a retrospective study