research-article

“Debrief O'Clock”: Planning, Recording, and Making Sense of a Day in the Field in Design Research

Authors:

Jennyfer Lawrence Taylor,

Alessandro Soro,

Anita Lee Hong,

Margot BreretonAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 308, Pages 1 - 14

https://doi.org/10.1145/3173574.3173882

Published: 21 April 2018 Publication History

Abstract

Design research is generative, intuitive, experiential, and tactical. Documenting the design research process helps to communicate these decisions, judgements, and values that are embodied in design products. Yet, practices for documenting design research are underreported in the CHI community, particularly for immersive design research field studies. We contribute the "Debrief O'Clock" fieldnote practice for documenting design research field studies, comprising collaborative discussion sessions and the production of written research accounts. We show how the Debrief O'Clock practice emerged in the context of a Digital Community Noticeboard project with a very remote Australian Aboriginal community, and explain three key purposes of Debrief O'Clock as: 1) an early stage data recording and analysis process; 2) a tactical manoeuvre in responsive project planning; and 3) a mechanism for personal debriefing and reflexivity. We conclude with a series of open practical, ethical, and methodological questions to advance the discussion of design research documentation practices.

Supplementary Material

suppl.mov (pn2898-file5.mp4)

Supplemental video

Download
9.06 MB

References

[1]

AIATSIS. 2012. Guidelines for Ethical Research in Australian Indigenous Studies. AIATSIS, Canberra. Retrieved from http://www.aiatsis.gov.au/research/docs/GERAIS.p df

[2]

Yoko Akama and Ann Light. 2012. A Candor in Reporting: Designing Dexterously for Fire Preparedness. Proc. CHI 2012: 281--290.

Digital Library

[3]

Yaw Anokwa, Thomas N Smyth, Divya Ramachandran, Jahanzeb Sherwani, Yael Schwartzman, Rowena Luk, Melissa Ho, Neema Moraveji, and Brian DeRenzi. 2009. Stories from the Field?: Reflections on HCI4D Experiences. Information Technologies & International Development 5, 4: 101--115.

[4]

Paul Atkinson, Amanda Coffey, Sara Delamont, John Lofland, and Lyn Lofland. 2007. Handbook of Ethnography. Sage Publications, London.

[5]

Jeffrey Bardzell and Shaowen Bardzell. 2016. Humanistic HCI. Interactions 23, 20--29.

Digital Library

[6]

Jeffrey Bardzell, Shaowen Bardzell, Peter Dalsgaard, Shad Gross, and Kim Halskov. 2016. Documenting the Research Through Design Process. Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16: 96-- 107.

Digital Library

[7]

Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. In Proceedings of CHI 2010, 1301--1310.

Digital Library

[8]

Victoria Bellotti and Ian Smith. 2000. Informing the design of an information management system with iterative fieldwork. Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, DIS: 227--237.

Digital Library

[9]

Dawn Bessarab and Bridget Ng'andu. 2010. Yarning About Yarning as a Legitimate Method in Indigenous Research. International Journal of Critical Indigenous Studies 3, 1: 37--50.

[10]

Nicola J Bidwell, Thomas Reitmaier, Gary Marsden, and Susan Hansen. 2010. Designing with mobile digital storytelling in rural Africa. In Proceedings of CHI 2010, 1593--1602.

Digital Library

[11]

Herbert Blumer. 1954. What is Wrong with Social Theory? American Sociological Review 19, 1: 3--10.

[12]

V. Braun and V. Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, May 2015: 77--101.

[13]

Margot Brereton, Paul Roe, Thomas Amagula, Serena Bara, Judy Larara, and Anita Lee Hong. 2013. Growing Existing Aboriginal Designs to Guide a Cross-Cultural Design Project. In Proceedings of the 14th IFIP TC13 International Conference on Human-Computer Interaction 2013 (INTERACT '13), 323--330.

[14]

Margot Brereton, Paul Roe, and Anita Lee Hong. 2012. Evolving a relationship for cross-cultural participatory innovation. In Proceedings of Participatory Innovation Conference 2012, 1--5. Retrieved from http://eprints.qut.edu.au/48143/

[15]

Margot Brereton, Paul Roe, Ronald Schroeter, Anita Lee Hong, and Anita Lee Hong. 2014. Beyond Ethnography?: Engagement and Reciprocity as Foundations for Design Research Out Here. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 1183-- 1186.

Digital Library

[16]

Nela Brown, Peter Landin Building, and Tony Stockman. 2013. Examining the Use of Thematic Analysis as a Tool for Informing Design of New Family Communication Technologies. In Proceedings of the 27th International BCS Human Computer Interaction Conference, 21.

Digital Library

[17]

Ko-le Chen. 2017. HCI Knowledges and Situated Dissemination. In DIS '17 Proceedings of the 2017 Conference on Designing Interactive Systems Companion, 396--398.

Digital Library

[18]

Ko-Le Chen, Rachel Clarke, Teresa Almeida, Matthew Wood, and David S. Kirk. 2017. Situated Dissemination through an HCI Workplace. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, 2078--2090.

Digital Library

[19]

Teena Clerke and Nick Hopwood. 2014. Doing ethnography in teams: A case study of asymmetries in collaborative research. Springer Science & Business Media, Berlin, Heidelberg.

[20]

James Clifford. 1990. Notes on (field)notes. Fieldnotes: The Makings of Anthropology, 47--70.

[21]

Juliet Corbin and Anselm Strauss. 2008. Basics of Qualitative Research. Sage Publications Inc, Thousand Oaks, CA.

[22]

Andy Crabtree, David M Nichols, Jon O Brien, Mark Rouncefield, and Michael B Twidale. 2000. Ethnomethodologically Informed Ethnography and Information System Design. Journal of the American Society for Information Science 51, 7: 666--682.

Digital Library

[23]

Paul Dourish. 2006. Implications for design. In Proceedings of the SIGCHI conference on Human Factors in computing systems, 541--550.

Digital Library

[24]

Robert M Emerson, Rachel I. Fretz, and Linda L. Shaw. 2011. Writing Ethnographic Fieldnotes. University of Chicago Press, Chicago, Illinois, USA.

[25]

Robert M Emerson, Rachel I Fretz, and Linda L Shaw. 2001. Participant Observation and Fieldnotes. In Handbook of Ethnography. Sage Publications Inc, London, 352--369.

[26]

Susan Farrell. 2016. Field Studies. Neislen Norman Group Website. Retrieved September 19, 2017 from https://www.nngroup.com/articles/field-studies/

[27]

Haakon Faste. 2017. Intuition in Design?: Reflections on the Iterative Aesthetics of Form. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17: 3403--3413.

Digital Library

[28]

David J Flinders. 2016. In search of ethical guidance?: constructing a basis for dialogue. International Journal of Qualitative Studies in Education 5, 2: 101--115.

[29]

Christopher Frayling. 1993. Research in Art and Design. Royal College of Art Research Papers 1, 1: 1--5.

[30]

Harold Garfinkel. 1964. Studies of the Routine Grounds of Everyday Activities. Social Problems 11, 3: 225--250.

[31]

Bill Gaver, Tony Dunne, and Elena Pacenti. 1999. Cultural Probes. Interactions 6, 1: 21--29.

Digital Library

[32]

William Gaver. 2011. Making Spaces: How Design Workbooks Work. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11: 1551--1560.

Digital Library

[33]

William Gaver. 2012. What Should We Expect From Research Through Design?? In Proceedings of CHI 2012, 937--946.

Digital Library

[34]

Karen Holtzblatt and Hugh Beyer. 2015. Contextual Design: Evolved. Morgan & Claypool, San Rafael, California.

Digital Library

[35]

Hilary Hutchinson, Wendy E. Mackay, Bo Westerlund, Benjamin B Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, Nicolas Roussel, Björn Eiderbäck, and others. 2003. Technology probes: inspiring design for and with families. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '03, 5: 17--24.

Digital Library

[36]

Lilly Irani, Janet Vertesi, Paul Dourish, Kavita Philip, and Rebecca E. Grinter. 2010. Postcolonial Computing: A Lens on Design and Development. Proceedings of the 28th international conference on Human factors in computing systems - CHI '10: 1312--1320.

Digital Library

[37]

Brigitte Jordan and Austin Henderson. 1995. Interaction Analysis: Foundations and Practice. Journal of the Learning Sciences 4, 1: 39--103.

[38]

Tobie Kerridge. 2017. Turning people into workbooks. Interactions 24, 6: 6--7.

Digital Library

[39]

Vera Khovanskaya, Phoebe Sengers, Melissa Mazmanian, and Charles Derrah. 2017. Reworking the Gaps between Design and Ethnography. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems: 5373--5385.

Digital Library

[40]

Jesper Kjeldskov and Connor Graham. 2003. A Review of Mobile HCI Research Methods. In Lecture Notes in Computer Science (LNCS, volume 2795). Springer, Berlin, Heidelberg, 317--335.

[41]

Ann Light. 2015. Troubling Futures: can participatory design research provide a constitutive anthropology for the 21st century? Interaction Design and Architecture(s) Journal, 26: 81--94.

[42]

Ann Light and Yoko Akama. 2012. The Human Touch: Participatory practice and the role of facilitation in designing with communities. Proceedings of the 12th Participatory Design Conference (PDC '12): 61--70.

Digital Library

[43]

John Loftland and Lyn Loftland. 2006. Analyzing Social Settings: A Guide to Qualitative Observation and Analysis. Wadsworth/Thomson Learning, Belmont, CA.

[44]

John Van Maanen. 1988. Tales of the Field: On Writing Ethnography. Chicago University Press, Chicago, Illinois.

[45]

Matthew Miles and Michael Huberman. 1994. Qualitative Data Analysis: An Expanded Sourcebook. Sage Publications, Thousand Oaks, CA.

[46]

Cosmin Munteanu, Heather Molyneaux, Wendy Moncur, Mario Romero, Susan O'Donnell, and John Vines. 2015. Situational Ethics: Re-thinking Approaches to Formal Ethics Requirements for Human-Computer Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 105--114.

Digital Library

[47]

James Pierce, Phoebe Sengers, Tad Hirsch, Tom Jenkins, William Gaver, and Carl Disalvo. 2015. Expanding and Refining Design and Criticality in HCI. In Proceedings of CHI 2015, 2083--2092.

Digital Library

[48]

Suvi Pihkala and Helena Karasti. 2016. Reflexive Engagement: Enacting Reflexivity in Design and for ?Participation in Plural." Proceedings of the 14th Participatory Design Conference: Full Papers - Volume 1: 21--30.

Digital Library

[49]

Jenny Preece, Yvonne Rogers, and Helen Sharp. 2015. Interaction Design: Beyond HumanComputer Interaction. Wiley, West Sussex.

[50]

Toni Robertson and Jesper Simonsen. 2012. Participatory Design: An Introduction. In Routledge International Handbook of Participatory Design, J Simonsen and T Robertson (eds.). Taylor & Francis, Florence, 1--18.

[51]

Jennifer a Rode. 2011. Reflexivity in Digital Anthropology. In Proceedings of CHI 2011, 123-- 132.

Digital Library

[52]

Daniela K Rosner, Saba Kawas, Wenqi Li, Nicole Tilly, and Yi-Chen Sung. 2016. Out of time, out of place: Reflections on design workshops as a research method. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16): 1131-- 1141.

Digital Library

[53]

Roger Sanjek. 1990. Fieldnotes: The Makings of Anthropology. Cornell University Press, Ithaca, NY.

[54]

Maggi Savin-Baden and Claire Howell Major. 2013. Qualitative Research: The Essential Guide to Theory and Practice. Routledge, Abingon, UK.

[55]

Ari Schlesinger, W Keith Edwards, and Rebecca E Grinter. 2017. Intersectional HCI?: Engaging Identity through Gender, Race, and Class. In Proceedings of CHI 2017, 5412--5427.

Digital Library

[56]

Phoebe Sengers, Kirsten Boehner, Shay David, and Joseph ?Jofish" Kaye. 2005. Reflective design. Proceedings of the 4th decennial conference on Critical computing between sense and sensibility CC '05: 49.

Digital Library

[57]

Royce A. Singleton Jr, Bruce C Straits, and Margaret Miller Straits. 1993. Approaches to social research. Oxford University Press, Oxford.

[58]

Alessandro Soro, Margot Brereton, Anita Lee Hong, and Paul Roe. 2015. Bi-Cultural Content Publication on a Digital Noticeboard: A Design and Cultural Differences Case Study. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15), 217--221.

Digital Library

[59]

Alessandro Soro, Margot Brereton, Jennyfer Lawrence Taylor, Anita Lee Hong, and Paul Roe. 2017. A Cross-Cultural Noticeboard for a Remote Community: Design, Deployment, and Evaluation. In Proceedings of INTERACT 2017.

[60]

Alessandro Soro, Margot Brereton, Jennyfer Lawrence Taylor, Anita Lee Hong, and Paul Roe. 2016. Cross-Cultural Dialogical Probes. In Proceedings of the First African Conference on Human Computer Interaction (AfriCHI'16).

Digital Library

[61]

Alessandro Soro, Anita Lee Hong, Grace Shaw, Paul Roe, and Margot Brereton. 2015. A Noticeboard in "Both Worlds" Unsurprising Interfaces Supporting Easy Bi-Cultural Content Publication. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15), 2181--2186.

Digital Library

[62]

Lucy Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge University Press, Cambridge.

Digital Library

[63]

Jennyfer Lawrence Taylor, Alessandro Soro, Margot Brereton, Anita Lee Hong, and Paul Roe. 2016. Designing Evaluation Beyond Evaluating Design?: Measuring Success in Cross- - Cultural Projects. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI '16).

Digital Library

[64]

Jennyfer Lawrence Taylor, Alessandro Soro, Anita Lee Hong, Paul Roe, and Margot Brereton. 2016. Designing For Cross-Cultural Perspectives of Time. In Proceedings of AfriCHI 2016.

Digital Library

[65]

Jennyfer Lawrence Taylor, Alessandro Soro, Anita Lee Hong, Paul Roe, and Margot Brereton. 2017. "Situational When": Designing for Cross-Cultural Time Practices with an Australian Aboriginal Community. In Proceedings of CHI 2017, 6461-- 6474. Retrieved from

Digital Library

[66]

Cathy Urquhart, Hans Lehmann, and Michael D. Myers. 2010. Putting the "theory" back into grounded theory: Guidelines for grounded theory studies in information systems. Information Systems Journal 20, 4: 357--381.

[67]

Geoffrey Walford. 2009. The practice of writing ethnographic fieldnotes. Ethnography and Education 4, 2: 117--130.

[68]

Jill Woelfer and David Hendry. 2012. Homeless young people on social network sites. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12: 2825.

Digital Library

[69]

Tracee Vetting Wolf, Jennifer A Rode, Jeremy Sussman, and Wendy A Kellogg. 2006. Dispelling Design as the " Black Art " of CHI. In Proceedings of CHI 2016, 521--530.

Digital Library

[70]

John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of CHI 2007 (CHI '07), 493--502.

Digital Library

Cited By

Secher KJensen VJensen ROvergaard MChristiansen I(2024)A Case Study of Situating Energy Temporality towards Designing for Communal EnergyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685484(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685484
Rodgers SPloderer BVella KBrereton M(2024)Phenology Circles: A Method to Deepen Relations in More-Than-Human Design ProcessesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660694(1059-1073)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660694
Ambe ARoomkham SLovell DBrereton M(2023)Rethinking the Design of Human-Data Interaction through a Study of Older Adults’ WellbeingProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638451(266-279)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638451
Show More Cited By

Index Terms

“Debrief O'Clock”: Planning, Recording, and Making Sense of a Day in the Field in Design Research
1. Human-centered computing

Recommendations

Deployments of the table-non-table: A Reflection on the Relation Between Theory and Things in the Practice of Design Research
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Design-oriented research in HCI has increasingly migrated towards theoretical perspectives to understand the implications of newly crafted technology in everyday life. However, in this context, the relations between theory and understanding the things ...
Ethnographically-informed empirical studies of software practice

Over the past decade we have performed a sustained series of qualitative studies of software development practice, focusing on social factors. Using an ethnographically-informed approach, we have addressed four areas of software practice: software ...
What are the educational affordances of wearable technologies?

By providing users with hands-free access to contextually relevant knowledge, wearable technologies are poised to inspire a new generation of mobile learning design. However, in order for educators to harness the pedagogical opportunities of wearable ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Australian Research Council

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
486
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)4

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Secher KJensen VJensen ROvergaard MChristiansen I(2024)A Case Study of Situating Energy Temporality towards Designing for Communal EnergyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685484(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685484
Rodgers SPloderer BVella KBrereton M(2024)Phenology Circles: A Method to Deepen Relations in More-Than-Human Design ProcessesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660694(1059-1073)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660694
Ambe ARoomkham SLovell DBrereton M(2023)Rethinking the Design of Human-Data Interaction through a Study of Older Adults’ WellbeingProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638451(266-279)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638451
Ambe ABrown RTürkay SHarman JSoro A(2023)Multifocal Realities with Augmenting Reality: An Exploratory Study with Older Creative WritersProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638402(399-414)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638402
Saha MLindsay SVarghese DBartindale TOlivier P(2023)Benefits of Community Voice: A Framework for Understanding Inclusion of Community Voice in HCI4DProceedings of the ACM on Human-Computer Interaction10.1145/36101747:CSCW2(1-26)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610174
Ortloff AFassl MPonticello AMartius FMertens AKrombholz KSmith M(2023)Different Researchers, Different Results? Analyzing the Influence of Researcher Experience and Data Type During Qualitative Analysis of an Interview and Survey Study on Security AdviceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580766(1-21)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580766
Bayor ABrereton MSitbon LPloderer B(2023)ICT use and competencies of school children with intellectual disabilities in low-resource settings: the case of Ghana in sub-Saharan AfricaUniversal Access in the Information Society10.1007/s10209-023-01059-xOnline publication date: 28-Oct-2023
https://doi.org/10.1007/s10209-023-01059-x
An LMuñoz DPedell SSterling L(2022)Understanding Confidence of Older Adults for Embracing Mobile TechnologiesProceedings of the 34th Australian Conference on Human-Computer Interaction10.1145/3572921.3576202(38-50)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3572921.3576202
Nunes Vilaza GDoherty KMcCashin DCoyle DBardram JBarry M(2022)A Scoping Review of Ethics Across SIGCHIProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533511(137-154)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533511
Ambe ASoro AJohnson DBrereton M(2022)From Collaborative Habituation to Everyday Togetherness: A Long-Term Study of Use of the Messaging KettleACM Transactions on Computer-Human Interaction10.1145/347097329:1(1-47)Online publication date: 7-Jan-2022
https://dl.acm.org/doi/10.1145/3470973
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents