abstract

Transparency and Openness Promotion Guidelines for HCI

Authors:

Lewis L. Chuang,

Ulrike PfeilAuthors Info & Claims

CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: SIG04, Pages 1 - 4

https://doi.org/10.1145/3170427.3185377

Published: 20 April 2018 Publication History

Get Access

Abstract

This special interest group addresses the status quo of HCI research with regards to research practices of transparency and openness. Specifically, it discusses whether current practices are in line with the standards applied to other fields (e.g., psychology, economics, medicine). It seeks to identify current practices that are more progressive and worth communicating to other disciplines, while evaluating whether practices in other disciplines are likely to apply to HCI research constructively. Potential outcomes include: (1) a review of current HCI research policies, (2) a report on recommended practices, and (3) a replication project of key findings in HCI research.

References

[1]

CHI 2018, Montreal, Canada: Papers (Preparing and Submitting Your Paper). https://chi2018.acm.org/authors/papers/. Accessed: 2018-01--15.

Google Scholar

[2]

Open Science Collaboration and others. 2015. Estimating the reproducibility of psychological science. Science 349, 6251 (2015), aac4716.

Google Scholar

[3]

Megan L Head, Luke Holman, Rob Lanfear, Andrew T Kahn, and Michael D Jennions. 2015. The extent and consequences of p-hacking in science. PLoS biology 13, 3 (2015), e1002106.

Google Scholar

[4]

Kasper Hornbæk, Søren S Sander, Javier Andrés Bargas-Avila, and Jakob Grue Simonsen. 2014. Is once enough?: on the extent and content of replications in human-computer interaction. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3523--3532.

Digital Library

Google Scholar

[5]

Matthew Kay, Steve Haroz, Shion Guha, and Pierre Dragicevic. 2016. Special Interest Group on Transparent Statistics in HCI. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1081--1084.

Digital Library

Google Scholar

[6]

Matthew Kay, Steve Haroz, Shion Guha, Pierre Dragicevic, and Chat Wacharamanotham. 2017. Moving Transparent Statistics Forward at CHI. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 534--541.

Digital Library

Google Scholar

[7]

Peter Kraker, Derick Leony, Wolfgang Reinhardt, and Günter Beham. 2011. The case for an open science in technology enhanced learning. International Journal of Technology Enhanced Learning 3, 6 (2011), 643--654.

Digital Library

Google Scholar

[8]

Peter Murray-Rust. 2008. Open data in science. Serials Review 34, 1 (2008), 52--64.

Crossref

Google Scholar

[9]

Brian A Nosek, George Alter, George C Banks, D Borsboom, Sara D Bowman, Steven J Breckler, Stuart Buck, Christopher D Chambers, G Chin, G Christensen, and others. 2015. Promoting an open research culture. Science 348, 6242 (2015), 1422--1425.

Google Scholar

[10]

OpenUp. 2018. OpenUp Project. (2018). http://openup-h2020.eu/

Google Scholar

[11]

Max L Wilson, Wendy Mackay, Ed Chi, Michael Bernstein, Dan Russell, and Harold Thimbleby. 2011. RepliCHI-CHI should be replicating and validating results more: discuss. In CHI'11 Extended Abstracts on Human Factors in Computing Systems. ACM, 463--466.

Digital Library

Google Scholar

Cited By

View all

Wacharamanotham CYang FPu XSarma A(2023)Transparent Practices for Quantitative Empirical ResearchExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3574168(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3574168
Kosa MBowman N(2023)Replication and Extension of Video Game Demand Scale with a Turkish-Speaking Gamer PopulationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580960(1-11)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580960
Salehzadeh Niksirat KGoswami LS. B. Rao PTyler JSilacci AAliyu SAebli AWacharamanotham CCherubini M(2023)Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580848(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580848
Show More Cited By

Index Terms

Transparency and Openness Promotion Guidelines for HCI
1. Human-centered computing

Recommendations

Are You Open? A Content Analysis of Transparency and Openness Guidelines in HCI Journals
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Within the wider open science reform movement, HCI researchers are actively debating how to foster transparency in their own field. Publication venues play a crucial role in instituting open science practices, especially journals, whose procedures ...
Feminist Care in the Anthropocene: Packing and Unpacking Tensions in Posthumanist HCI
DIS '22: Proceedings of the 2022 ACM Designing Interactive Systems Conference

As posthumanist or post-anthropocentric research in HCI and design proliferates and further commits to working with more-than-humans, design research practitioners are left with many open questions and uncertainties with how to productively engage with ...
Refugees & HCI Workshop: The Role of HCI in Responding to the Refugee Crisis
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Over 21 million refugees are residing in camps, journeying through Europe or resettling in new countries [19]. The magnitude of the humanitarian crisis calls for technological innovation in addressing the challenges being faced by refugees and ...

Comments

Information & Contributors

Information

Published In

CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

3155 pages

ISBN:9781450356213

DOI:10.1145/3170427

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 April 2018

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI EA '18 Paper Acceptance Rate 1,208 of 3,955 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
253
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)2

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wacharamanotham CYang FPu XSarma A(2023)Transparent Practices for Quantitative Empirical ResearchExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3574168(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3574168
Kosa MBowman N(2023)Replication and Extension of Video Game Demand Scale with a Turkish-Speaking Gamer PopulationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580960(1-11)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580960
Salehzadeh Niksirat KGoswami LS. B. Rao PTyler JSilacci AAliyu SAebli AWacharamanotham CCherubini M(2023)Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580848(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580848
Komninos A(2022)The Value of Open Data in HCI: A Case Report from Mobile Text Entry ResearchMultimodal Technologies and Interaction10.3390/mti60900716:9(71)Online publication date: 23-Aug-2022
https://doi.org/10.3390/mti6090071
Rainey JMacfarlane SPuussaar AVlachokyriakos VBurrows RSmeddinck JBriggs PMontague K(2022)Exploring the Role of Paradata in Digitally Supported Qualitative Co-ResearchProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502103(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502103
Wacharamanotham CYang FPu XSarma APadilla L(2022)Transparent Practices for Quantitative Empirical ResearchExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503760(1-5)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503760
Kim JWohn DCha M(2022)Understanding and identifying the use of emotes in toxic chat on TwitchOnline Social Networks and Media10.1016/j.osnem.2021.10018027(100180)Online publication date: Jan-2022
https://doi.org/10.1016/j.osnem.2021.100180
Dix A(2022)Statistics for HCIundefinedOnline publication date: 8-Mar-2022
https://doi.org/null
Aeschbach LPerrig SWeder LOpwis KBrühlmann F(2021)Transparency in Measurement ReportingProceedings of the ACM on Human-Computer Interaction10.1145/34746605:CHI PLAY(1-21)Online publication date: 6-Oct-2021
https://dl.acm.org/doi/10.1145/3474660
Ballou NWarriar VDeterding SKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Are You Open? A Content Analysis of Transparency and Openness Guidelines in HCI JournalsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445584(1-10)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445584
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Are You Open? A Content Analysis of Transparency and Openness Guidelines in HCI Journals

Feminist Care in the Anthropocene: Packing and Unpacking Tensions in Posthumanist HCI

Refugees & HCI Workshop: The Role of HCI in Responding to the Refugee Crisis