abstract

Public Access

Qualitative Methods for CSCW: Challenges and Opportunities

Authors:

Jed R. Brubaker,

Michael MullerAuthors Info & Claims

CSCW '19 Companion: Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing

Pages 455 - 460

https://doi.org/10.1145/3311957.3359428

Published: 09 November 2019 Publication History

Abstract

Qualitative methods have long been an important component of CSCW research. However, it can be challenging to make qualitative work legible to a broader set of researchers, which is critical as mixed methods research becomes more common. Moreover, the shift towards larger scales of data and increasing calls for open data and more transparency pose new questions for qualitative methods in terms of data collection, analysis, reporting, and sharing. This workshop brings together researchers to discuss these challenges as well as new opportunities for qualitative methods, with goals to help build norms and best practices for (1) conducting qualitative research, (2) reporting that research, and (3) engaging and collaborating with CSCW researchers from other methodological traditions.

References

[1]

Eric P.S. Baumer, David Mimno, Shion Guha, Emily Quan, and Geri K. Gay. 2017. Comparing grounded theory and topic modeling: Extreme divergence or unlikely convergence? Journal of the Association for Information Science and Technology 68, 6: 1397--1410.

Digital Library

[2]

Theodora Bloom, Emma Ganley, and Margaret Winker. 2014. Data access for the open access literature: PLOS's data policy. PLOS Biology.

[3]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2: 77--101.

[4]

Amy Bruckman. 2014. Research Ethics and HCI. In Ways of Knowing in HCI, Wendy A. Kellogg and Judith S. Olson (eds.). Springer, 449--468.

[5]

Amy Bruckman, Kurt Luther, and Casey Fiesler. 2015. When Should We Use Real Names in Published Accounts of Internet Research? In Digital Research Confidential, Ezster Hargittai and Christian Sandvig (eds.). MIT Press, Cambridge, MA, 243--258.

[6]

Kelly Caine. 2016. Local Standards for Sample Size at CHI. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI) 981--992.

Digital Library

[7]

Kathy Charmaz. 2014. Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis (2nd ed.). SAGE Publications, London, UK.

[8]

Ronald J. Chenail. 2011. Interviewing the Investigator: Strategies for Addressing Instrumentation and Researcher Bias in Qualitative Research. The Qualitative Report 16, 1.

[9]

Lewis L. Chuang and Ulrike Pfeil. 2018. Transparency and Openness Promotion Guidelines for HCI. In Extended Abstracts on Human Factors in Computing Systems (CHI), 1--4.

Digital Library

[10]

Imelda T. Coyne. 1997. Sampling in qualitative research. Purposeful and theoretical sampling; merging or clear boundaries? Journal of Advanced Nursing 26, 3: 623--630.

[11]

Norman K. Denzin and Yvonna S. Lincoln. 2008. Strategies of Qualitative Inquiry. SAGE Publications.

[12]

Jill P Dimond, Casey Fiesler, Betsy DiSalvo, Jon Pelc, and Amy Bruckman. 2012. Qualitative Data Collection Technologies: A Comparison of Instant Messaging, Email, and Phone. In Proceedings of the ACM Conference on Supporting Group Work (GROUP).

Digital Library

[13]

Paul Dourish. 2014. Reading and interpreting ethnography. In Ways of Knowing in HCI, Judith Olson and Wendy Kellogg (eds.). Springer.

[14]

Robert Elliott, Constance T Fischer, and David L Rennie. 1999. Evolving guidelines for publication of qualitative research studies in psychology and related fields. British Journal of Clinical Psychology 38: 215--229.

[15]

Casey Fiesler and Nicholas Proferes. 2018. "Participant" Perceptions of Twitter Research Ethics. Social Media + Society 4, 1.

[16]

Casey Fiesler, Pamela Wisniewski, Jessica Pater, and Nazanin Andalibi. 2016. Ethics and Obligations for Studying Digital Communities. In Companion to the ACM Conference on Supporting Group Work (GROUP)

[17]

Casey Fiesler, Alyson Young, Tamara Peyton, Amy S. Bruckman, Mary Gray, Jeff Hancock, and Wayne Lutters. 2015. Ethics for Studying Online Sociotechnical Systems in a Big Data World. In Companion to the ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW), 289--292.

[18]

Susan Gasson. 2004. Rigor in grounded theory: An interpretive prespective on generating theory from qualitative field studies. In The Handbook of Information Systems Research, Michael Whitman and Amy Woszczynski (eds.). IGI Global.

[19]

Greg Guest, Arwen Bunce, and Laura Johnson. 2006. How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability. Field Methods 18, 1: 59--82.

[20]

Nataliya Ivankova, John W. Creswell, and Sheldon L. Stick. 2006. Using mixed-methods sequential explanatory design: From theory to practice. Field Methods 18, 1: 3--20.

[21]

Carlos Jensen, Colin Potts, and Christian Jensen. 2005. Privacy and practices of internet users: Self-reports versus observed behavior. International Journal of Human-Computer Studies 63, 1--2: 203--227.

Digital Library

[22]

Matthew Kay, Steve Haroz, Shion Guha, Pierre Dragicevic, and Chat Wacharamanotham. 2017. Moving Transparent Statistics Forward at CHI. In Extended Abstracts on Human Factors in Computing Systems (CHI), 534--541.

[23]

Klaus Krippendorff. 2004. Content Analysis: An Introduction to Its Methodology. SAGE Publications, Thousand Oaks, CA.

[24]

K. M. MacQueen, E. McLellan, K. Kay, and B. Milstein. 1998. Codebook Development for Team-Based Qualitative Analysis. Field Methods 10, 2: 31--36.

[25]

Annette Markham. 2012. Fabrication as ethical practice: Qualitative inquiry in ambiguous Internet contexts. Information Communication and Society 15, 3: 334--353.

[26]

Keavy Martin. 2012. Stories in a new skin: Approaches to Inuit literature. University of Manitoba Press.

[27]

Sophie McCall. 2011. First person plural: Aboriginal storytelling and the ethics of collaborative authorship. UBC Press.

[28]

Michael Muller. 2014. Curiosity, creativity, and surprise as analytic tools: Grounded theory method. In Ways of Knowing in HCI, Judith Olson and Wendy Kellogg (eds.). Springer.

[29]

Michael Muller, Shion Guha, Eric P.S. Baumer, David Mimno, and N. Sadat Shami. 2016. Machine Learning and Grounded Theory Method: Convergence, Divergence, and Combination. In Proceedings of the ACM Conference on Supporting Group Work (GROUP), 3--8.

[30]

Brian A. Nosek, George Alter, George C. Banks, Denny Borsboom, Sara D. Bowman, Steven J. Breckler, and Stuard Buck. 2015. Promoting an open research culture. Science 348, 6242: 1422--1425.

[31]

Kathleen H. Pine and Max Liboiron. 2015. The Politics of Measurement and Action. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 3147--3156.

[32]

Farhana Sultana. 2007. Reflexivity, positionality and participatory ethics: Negotiating fieldwork dilemmas in international fieldswork. ACME: An International E-Journal for Critical Geographies 6, 3: 374--385.

[33]

Alexander C. Tsai, Brandon A. Kohrt, Lynn T. Matthews, Theresa S. Betancourt, Jooyoung K. Lee, Andrew V. Papachristos, Sheri D. Weiser, and Shari L. Dworkin. 2016. Promises and pitfalls of data sharing in qualitative research. Social Science and Medicine 169: 191--198.

[34]

Jessica Vitak, Katie Shilton, and Z. Ashktorab. 2016. Beyond the Belmont Principles: Ethical Challenges, Practices, and Beliefs in the Online Data Research Community. In Proceedings of the ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW), 941--953.

[35]

James R. Wallace, Saba Oji, and Craig Anslow. 2017. Technologies, Methods, and Values: Changes in Empirical Research at CSCW 1990--2015. Proceedings of the ACM on Human-Computer Interaction 1, CSCW: 106: 1--18.

[36]

Pamela J. Wisniewski, Jessica Vitak, Xinru Page, Bart Knijnenburg, Yang Wang, and Casey Fiesler. 2017. In Whose Best Interest? Exploring the Real, Potential, and Imagined Ethical Concerns in Privacy-Focused Agenda. In Companion of the ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW Companion).

[37]

Himanshu Zade, Margaret Drouhard, Bonnie Chinh, Lu Gan, and Cecilia Aragon. 2018. Conceptualizing Disagreement in Qualitative Coding. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 159:1--11.

Digital Library

Cited By

Hadi Mogavi RSon JYang SWang DChoong LAlhilal AZhou PHui PNacke L(2024)The Jade Gateway to Exergaming: How Socio-Cultural Factors Shape Exergaming Among East Asian Older AdultsProceedings of the ACM on Human-Computer Interaction10.1145/36771068:CHI PLAY(1-34)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677106
Richardson DIslam MCumbo BShrestha PVarghese DBartindale TOlivier P(2024)A Design Vocabulary for Scaffolding Group Interaction Archetypes through Synchronous TelephonyProceedings of the ACM on Human-Computer Interaction10.1145/36372898:CSCW1(1-22)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637289
Fang ZEndres MZimmermann TFord DWeimer WLeach KHuang YChandra SBlincoe KTonella P(2023)A Four-Year Study of Student Contributions to OSS vs. OSS4SG with a Lightweight InterventionProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616250(3-15)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616250
Show More Cited By

Index Terms

Qualitative Methods for CSCW: Challenges and Opportunities
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Reliability and Inter-rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice

What does reliability mean for building a grounded theory? What about when writing an auto-ethnography? When is it appropriate to use measures like inter-rater reliability (IRR)? Reliability is a familiar concept in traditional scientific practice, but ...
Many Worlds of Ethics: Ethical Pluralism in CSCW
CSCW '23 Companion: Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing

Although CSCW has shown a strong interest in diversity and inclusion, the literature predominantly reflects ethics rooted in Western universalism, modernism, scientism, and Euro-centrism. Consequently, CSCW theories and practices tend to marginalize ...
FATREC Workshop on Responsible Recommendation
RecSys '17: Proceedings of the Eleventh ACM Conference on Recommender Systems

The first Workshop on Responsible Recommendation (FATREC) was held in conjunction with the 11th ACM Conference on Recommender Systems in August, 2017 in Como, Italy. This full-day workshop brought together researchers and practitioners to discuss ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '19 Companion: Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing

November 2019

562 pages

ISBN:9781450366922

DOI:10.1145/3311957

General Chairs:
Eric Gilbert
University of Michigan
,
Karrie Karahalios
University of Illinois, Urbana- Champaign

Copyright © 2019 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2019

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

National Science Foundation

Conference

CSCW '19

Sponsor:

SIGCHI

CSCW '19: Computer Supported Cooperative Work and Social Computing

November 9 - 13, 2019

TX, Austin, USA

Acceptance Rates

CSCW '19 Companion Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
1,812
Total Downloads

Downloads (Last 12 months)295
Downloads (Last 6 weeks)36

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hadi Mogavi RSon JYang SWang DChoong LAlhilal AZhou PHui PNacke L(2024)The Jade Gateway to Exergaming: How Socio-Cultural Factors Shape Exergaming Among East Asian Older AdultsProceedings of the ACM on Human-Computer Interaction10.1145/36771068:CHI PLAY(1-34)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677106
Richardson DIslam MCumbo BShrestha PVarghese DBartindale TOlivier P(2024)A Design Vocabulary for Scaffolding Group Interaction Archetypes through Synchronous TelephonyProceedings of the ACM on Human-Computer Interaction10.1145/36372898:CSCW1(1-22)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637289
Fang ZEndres MZimmermann TFord DWeimer WLeach KHuang YChandra SBlincoe KTonella P(2023)A Four-Year Study of Student Contributions to OSS vs. OSS4SG with a Lightweight InterventionProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616250(3-15)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616250
Nellore NZimmer MApostol B(2023)Updating the Topology of Twitter Research: Towards A Systematic Review of Twitter Research from 2013-2022Companion Proceedings of the 2023 ACM International Conference on Supporting Group Work10.1145/3565967.3570972(4-5)Online publication date: 8-Jan-2023
https://dl.acm.org/doi/10.1145/3565967.3570972
Bowman RNadal CMorrissey KThieme ADoherty G(2023)Using Thematic Analysis in Healthcare HCI at CHI: A Scoping ReviewProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581203(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581203
Miceli MYang TAlvarado Garcia APosada JWang SPohl MHanna A(2022)Documenting Data Production ProcessesProceedings of the ACM on Human-Computer Interaction10.1145/35556236:CSCW2(1-34)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555623
Alsoubai ASong JRazi ANaher NDe Choudhury MWisniewski P(2022)From 'Friends with Benefits' to 'Sextortion:' A Nuanced Investigation of Adolescents' Online Sexual Risk ExperiencesProceedings of the ACM on Human-Computer Interaction10.1145/35551366:CSCW2(1-32)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555136
Rainey JMacfarlane SPuussaar AVlachokyriakos VBurrows RSmeddinck JBriggs PMontague K(2022)Exploring the Role of Paradata in Digitally Supported Qualitative Co-ResearchProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502103(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502103
Gould S(2022)Consumption experiences in the research processProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502001(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502001
Cajander ÅLarusdottir MGeiser J(2022)UX professionals’ learning and usage of UX methods in agileInformation and Software Technology10.1016/j.infsof.2022.107005151:COnline publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1016/j.infsof.2022.107005
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents