Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Socio-technical Constraints and Affordances of Virtual Collaboration - A Study of Four Online Hackathons

Published: 11 November 2022 Publication History
  • Get Citation Alerts
  • Abstract

    Hackathons and similar time-bounded events have become a popular form of collaboration in various domains. They are commonly organized as in-person events during which teams engage in intense collaboration over a short period of time to complete a project that is of interest to them. Most research to date has thus consequently focused on studying how teams collaborate in a co-located setting, pointing towards the advantages of radical co-location. The global pandemic of 2020, however, has led to many hackathons moving online, which challenges our current understanding of how they function. In this paper, we address this gap by presenting findings from a multiple-case study of 10 hackathon teams that participated in 4 hackathon events across two continents. By analyzing the collected data, we found that teams merged synchronous and asynchronous means of communication to maintain a common understanding of work progress as well as to maintain awareness of each other's tasks. Task division was self-assigned based on individual skills or interests, while leaders emerged from different strategies (e.g., participant experience, the responsibility of registering the team in an event). Some of the affordances of in-person hackathons, such as the radical co-location of team members, could be partially reproduced in teams that kept open synchronous communication channels while working (i.e., shared audio territories), in a sort of "radical virtual co-location". However, others, such as interactions with other teams, easy access to mentors, and networking with other participants, decreased. In addition, the technical constraints of the different communication tools and platforms brought technical problems and were overwhelming to participants. Our work contributes to understanding the virtual collaboration of small teams in the context of online hackathons and how technologies and event structures proposed by organizers imply this collaboration.

    References

    [1]
    Craig Anslow, John Brosz, Frank Maurer, and Mike Boyes. 2016. Datathons: an experience report of data hackathons for data science education. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education. ACM, 615--620.
    [2]
    Jeremy N Bailenson. 2021. Nonverbal overload: A theoretical argument for the causes of Zoom fatigue. Technology, Mind, and Behavior, Vol. 2, 1 (2021).
    [3]
    Sarah Beecham, John Noll, and Ita Richardson. 2014. Using agile practices to solve global software development problems--a case study. In 2014 IEEE International Conference on Global Software Engineeering Workshops. IEEE, 5--10.
    [4]
    Alberto Bertello, Marcel LAM Bogers, and Paola De Bernardi. 2021. Open innovation in the face of the COVID-19 grand challenge: insights from the Pan-European hackathon ?EUvsVirus'. R&D Management (2021).
    [5]
    Nataly Birbeck, Shaun Lawson, Kellie Morrissey, Tim Rapley, and Patrick Olivier. 2017. Self Harmony: rethinking hackathons to design and critique digital technologies for those affected by self-harm. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 146--157.
    [6]
    Katarina Braune, Pablo-David Rojas, Joscha Hofferbert, Alvaro Valera Sosa, Anastasiya Lebedev, Felix Balzer, Sylvia Thun, Sascha Lieber, Valerie Kirchberger, and Akira-Sebastian Poncette. 2021. Interdisciplinary Online Hackathons as an Approach to Combat the COVID-19 Pandemic: Case Study. Journal of medical Internet research, Vol. 23, 2 (2021), e25283.
    [7]
    Bernadette Brereton. 2020. EUvsVirus Hackathon project: A case study from a mentor's perspective. All Ireland Journal of Higher Education, Vol. 12, 2 (2020).
    [8]
    Gerard Briscoe. 2014. Digital innovation: The hackathon phenomenon. Creativeworks London, Vol. 6 (2014), 1--13.
    [9]
    Gerard Briscoe, Tarek E Virani, and Mariza Dima. 2015. Hackathons: Why Co-location? Creativeworks London Working Papers (2015).
    [10]
    Frederik Brudy, Joshua Kevin Budiman, Steven Houben, and Nicolai Marquardt. 2018. Investigating the role of an overview device in multi-device collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13.
    [11]
    Fabio Calefato, Andrea Giove, Filippo Lanubile, and Marco Losavio. 2020. A case study on tool support for collaboration in agile development. In Proceedings of the 15th International Conference on Global Software Engineering. 11--21.
    [12]
    Felix Chen, Michael Cuddy, Conor Daly, and Mia Velletri. 2020. Analyzing Community Building Among First-Year Students at WPI During the COVID-19 Pandemic in the Fall of 2020. (2020).
    [13]
    David Cobham, Kevin Jacques, Carl Gowan, Jack Laurel, Scott Ringham, et al. 2017. From appfest to entrepreneurs: using a hackathon event to seed a university student-led enterprise. In 11th annual International Technology, Education and Development Conference.
    [14]
    Kevin Crowston, James Howison, Chengetai Masango, and U Yeliz Eseryel. 2007. The role of face-to-face meetings in technology-supported self-organizing distributed teams. IEEE Transactions on professional communication, Vol. 50, 3 (2007), 185--203.
    [15]
    Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work. 107--114.
    [16]
    Travis Faas, I-ching Liu, Lynn Dombrowski, and Andrew D Miller. 2019. Jam today, jam tomorrow: Learning in online game jams. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, GROUP (2019), 1--27.
    [17]
    Fabian Fagerholm, Patrik Johnson, Alejandro Sánchez Guinea, Jay Borenstein, and Jürgen Münch. 2013. Onboarding in open source software projects: A preliminary analysis. In 2013 IEEE 8th International Conference on Global Software Engineering Workshops. IEEE, 5--10.
    [18]
    Anna Filippova, Erik Trainer, and James D Herbsleb. 2017. From diversity by numbers to diversity as process: supporting inclusiveness in software development teams with brainstorming. In Proceedings of the 39th International Conference on Software Engineering. IEEE Press, 152--163.
    [19]
    Allan Fowler. 2016. Informal stem learning in game jams, hackathons and game creation events. In Proceedings of the International Conference on Game Jams, Hackathons, and Game Creation Events. ACM, 38--41.
    [20]
    Allan Fowler, Johanna Pirker, and Ali Arya. 2020. Jamming across borders: An exploratory study. In International Conference on Game Jams, Hackathons and Game Creation Events 2020. 16--21.
    [21]
    Kiev Gama. 2017a. Crowdsourced software development in civic apps-motivations of civic hackathons participants. In International Conference on Enterprise Information Systems, Vol. 2. SCITEPRESS, 550--555.
    [22]
    Kiev Gama. 2017b. Preliminary findings on software engineering practices in civic hackathons. In 2017 IEEE/ACM 4th International Workshop on CrowdSourcing in Software Engineering (CSI-SE). IEEE, 14--20.
    [23]
    Kiev Gama, Breno Alencar, Filipe Calegario, André Neves, and Pedro Alessio. 2018. A Hackathon Methodology for Undergraduate Course Projects. In 2018 IEEE Frontiers in Education Conference (FIE). IEEE, 1--9.
    [24]
    Kiev Gama, Carlos Zimmerle, and Pedro Rossi. 2021. Online Hackathons as an Engaging Tool to Promote Group Work in Emergency Remote Learning. In Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1. 345--351.
    [25]
    James G Greeno. 1994. Gibson's affordances. (1994).
    [26]
    Tom Gross. 2013. Supporting effortless coordination: 25 years of awareness research. Computer Supported Cooperative Work (CSCW), Vol. 22, 4--6 (2013), 425--474.
    [27]
    Carl Gutwin and Saul Greenberg. 2002. A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work (CSCW), Vol. 11, 3 (2002), 411--446.
    [28]
    Sarah Hartmann, Agnes Mainka, and Wolfgang G Stock. 2018. Innovation Contests: How to Engage Citizens in Solving Urban Problems? In Enhancing Knowledge Discovery and Innovation in the Digital Era. IGI Global, 254--273.
    [29]
    Scott Henderson. 2015. Getting the most out of hackathons for social good. Volunteer Engagement 2.0: Ideas and insights changing the world (2015), 182--194.
    [30]
    James D Herbsleb and Deependra Moitra. 2001. Global software development. IEEE software, Vol. 18, 2 (2001), 16--20.
    [31]
    Rashina Hoda, James Noble, and Stuart Marshall. 2012. Self-organizing roles on agile software development teams. IEEE Transactions on Software Engineering, Vol. 39, 3 (2012), 422--444.
    [32]
    Alexis Hope, Catherine D'Ignazio, Josephine Hoy, Rebecca Michelson, Jennifer Roberts, Kate Krontiris, and Ethan Zuckerman. 2019. Hackathons as Participatory Design: Iterating Feminist Utopias. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 61.
    [33]
    Youyang Hou and Dakuo Wang. 2017. Hacking with NPOs: collaborative analytics and broker roles in civic data hackathons. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 1--16.
    [34]
    Daniela Huppenkothen, Anthony Arendt, David W Hogg, Karthik Ram, Jacob T VanderPlas, and Ariel Rokem. 2018. Hack weeks as a model for data science education and collaboration. Proceedings of the National Academy of Sciences, Vol. 115, 36 (2018), 8872--8877.
    [35]
    Ahmed Imam, Tapajit Dey, Alexander Nolte, Audris Mockus, and James D Herbsleb. 2021. The Secret Life of Hackathon Code Where does it come from and where does it go?. In 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR). IEEE, 68--79.
    [36]
    Gerald C Kane, Rich Nanda, Anh Phillips, and Jonathan Copulsky. 2021. Redesigning the Post-Pandemic Workplace. MIT Sloan Management Review, Vol. 62, 3 (2021), 12--14.
    [37]
    Hanna Kienzler and Carolyn Fontanesi. 2017. Learning through inquiry: A global health hackathon. Teaching in Higher Education, Vol. 22, 2 (2017), 129--142.
    [38]
    Sara Kiesler and Jonathon N Cummings. 2002. What do we know about proximity and distance in work groups? A legacy of research. Distributed work, Vol. 1 (2002), 57--80.
    [39]
    Marko Komssi, Danielle Pichlis, Mikko Raatikainen, Klas Kindström, and Janne J"arvinen. 2015. What are Hackathons for? IEEE Software, Vol. 32, 5 (2015), 60--67.
    [40]
    Brittany Ann Kos. 2019. Understanding Female-Focused Hackathon Participants' Collaboration Styles and Event Goals. In Proceedings of the International Conference on Game Jams, Hackathons and Game Creation Events 2019. 1--4.
    [41]
    Annakaisa Kultima. 2015. Defining Game Jam. In Foundation of Digital Gaames.
    [42]
    Hila Lifshitz-Assaf, Sarah Lebovitz, and Lior Zalmanson. 2020. Minimal and adaptive coordination: How hackathons' projects accelerate innovation without killing it. Academy of Management Journal ja (2020).
    [43]
    Thomas James Lodato and Carl DiSalvo. 2016. Issue-oriented hackathons as material participation. New Media & Society, Vol. 18, 4 (2016), 539--557.
    [44]
    Zainab Masood, Rashina Hoda, and Kelly Blincoe. 2020. How agile teams make self-assignment work: a grounded theory study. Empirical Software Engineering, Vol. 25, 6 (2020), 4962--5005.
    [45]
    Maria Angelica Medina Angarita and Alexander Nolte. 2019. Does it matter why we hack?--Exploring the impact of goal alignment in hackathons. In Proceedings of 17th European Conference on Computer-Supported Cooperative Work. European Society for Socially Embedded Technologies (EUSSET).
    [46]
    Arnab Nandi and Meris Mandernach. 2016. Hackathons as an informal learning platform. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education. ACM, 346--351.
    [47]
    Thomas Neumayr, Hans-Christian Jetter, Mirjam Augstein, Judith Friedl, and Thomas Luger. 2018. Domino: A descriptive framework for hybrid collaboration and coupling styles in partially distributed teams. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (2018), 1--24.
    [48]
    John Noll, Sarah Beecham, and Ita Richardson. 2011. Global software development and collaboration: barriers and solutions. ACM inroads, Vol. 1, 3 (2011), 66--78.
    [49]
    Alexander Nolte, Irene-Angelica Chounta, and James D Herbsleb. 2020a. What Happens to All These Hackathon Projects? - Identifying Factors to Promote Hackathon Project Continuation. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW2 (2020), 1--26.
    [50]
    Alexander Nolte, Linda Bailey Hayden, and James D Herbsleb. 2020b. How to Support Newcomers in Scientific Hackathons-An Action Research Study on Expert Mentoring. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW1 (2020), 1--23.
    [51]
    Alexander Nolte, Ei Pa Pa Pe-Than, Abasi-amefon Obot Affia, Chalalai Chaihirunkarn, Anna Filippova, Arun Kalyanasundaram, Maria Angelica Medina Angarita, Erik Trainer, and James D Herbsleb. 2020c. How to organize a hackathon--A planning kit. arXiv preprint arXiv:2008.08025 (2020).
    [52]
    Gary Olson and Judith Olson. 2003. Mitigating the effects of distance on collaborative intellectual work. Economics of Innovation and New Technology, Vol. 12, 1 (2003), 27--42.
    [53]
    Gary M Olson and Judith S Olson. 2000. Distance matters. Human-computer interaction, Vol. 15, 2--3 (2000), 139--178.
    [54]
    Wanda J Orlikowski. 2002. Knowing in practice: Enacting a collective capability in distributed organizing. Organization science, Vol. 13, 3 (2002), 249--273.
    [55]
    Lavinia Paganini and Kiev Gama. 2020. Engaging Women's Participation in Hackathons: A Qualitative Study with Participants of a Female-focused Hackathon. In International Conference on Game Jams, Hackathons and Game Creation Events 2020. 8--15.
    [56]
    Ei Pa Pa Pe-Than and James D Herbsleb. 2019. Understanding Hackathons for Science: Collaboration, Affordances, and Outcomes. In International Conference on Information. Springer, 27--37.
    [57]
    Ei Pa Pa Pe-Than, Alexander Nolte, Anna Filippova, Christian Bird, Steve Scallen, and James D Herbsleb. 2019. Designing Corporate Hackathons With a Purpose: The Future of Software Development. IEEE Software, Vol. 36, 1 (2019), 15--22.
    [58]
    Ei Pa Pa Pe-Than, Alexander Nolte, Anna Filippova, Chris Bird, Steve Scallen, and James D. Herbsleb. 2020. Corporate Hackathons, How and Why? A Multiple Case Study of Motivation, Projects Proposal and Selection, Goal Setting, Coordination, and Outcomes. Human-Computer Interaction (2020).
    [59]
    Jari Porras, Antti Knutas, Jouni Ikonen, Ari Happonen, Jayden Khakurel, and Antti Herala. 2019. Code camps and hackathons in education-literature review and lessons learned. In Proceedings of the 52nd Hawaii International Conference on System Sciences.
    [60]
    Emily Porter, Chris Bopp, Elizabeth Gerber, and Amy Voida. 2017. Reappropriating Hackathons: The Production Work of the CHI4Good Day of Service. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 810--814.
    [61]
    Jeaime Powell, Linda Bailey Hayden, Amy Cannon, Boyd Wilson, and Alexander Nolte. 2021. Organizing online hackathons for newcomers to a scientific community--Lessons learned from two events. In Sixth Annual International Conference on Game Jams, Hackathons, and Game Creation Events. 78--82.
    [62]
    Annika Richterich. 2019. Hacking events: Project development practices and technology use at hackathons. Convergence, Vol. 25, 5--6 (2019), 1000--1026.
    [63]
    Bard Rosell, Shiven Kumar, and John Shepherd. 2014. Unleashing innovation through internal hackathons. In Innovations in Technology Conference (InnoTek), 2014 IEEE. IEEE, 1--8.
    [64]
    Per Runeson and Martin Höst. 2009. Guidelines for conducting and reporting case study research in software engineering. Empirical software engineering, Vol. 14, 2 (2009), 131--164.
    [65]
    Patricia M Sias and Daniel J Cahill. 1998. From coworkers to friends: The development of peer friendships in the workplace. Western Journal of Communication (includes Communication Reports), Vol. 62, 3 (1998), 273--299.
    [66]
    Kate Starbird and Leysia Palen. 2011. " Voluntweeters" self-organizing by digital volunteers in times of crisis. In Proceedings of the SIGCHI conference on human factors in computing systems. 1071--1080.
    [67]
    Arlin Stoltzfus, Michael Rosenberg, Hilmar Lapp, Aidan Budd, Karen Cranston, Enrico Pontelli, Shann Oliver, and Rutger A Vos. 2017. Community and code: Nine lessons from nine NESCent hackathons. F1000Research, Vol. 6 (2017).
    [68]
    Viktoria Stray, Nils Brede Moe, and Mehdi Noroozi. 2019. Slack Me If You Can! Using Enterprise Social Networking Tools in Virtual Agile Teams. In 2019 ACM/IEEE 14th International Conference on Global Software Engineering (ICGSE). IEEE, 111--121.
    [69]
    Nick Taylor and Loraine Clarke. 2018. Everybody's Hacking: Participation and the Mainstreaming of Hackathons. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 172.
    [70]
    Nick Taylor, Loraine Clarke, Martin Skelly, and Sara Nevay. 2018. Strategies for Engaging Communities in Creating Physical Civic Technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 507.
    [71]
    Stephanie Teasley, Lisa Covi, Mayuram S Krishnan, and Judith S Olson. 2000. How does radical collocation help a team succeed?. In Proceedings of the 2000 ACM conference on Computer supported cooperative work. 339--346.
    [72]
    Serdar Temiz. 2021. Open Innovation via Crowdsourcing: A Digital Only Hackathon Case Study from Sweden. Journal of Open Innovation: Technology, Market, and Complexity, Vol. 7, 1 (2021), 39.
    [73]
    Erik H Trainer, Chalalai Chaihirunkarn, Arun Kalyanasundaram, and James D Herbsleb. 2014. Community code engagements: summer of code & hackathons for community building in scientific software. In Proceedings of the 18th International Conference on Supporting Group Work. 111--121.
    [74]
    Erik H Trainer, Arun Kalyanasundaram, Chalalai Chaihirunkarn, and James D Herbsleb. 2016. How to hackathon: Socio-technical tradeoffs in brief, intensive collocation. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1118--1130.
    [75]
    Silvia Vermicelli, Livio Cricelli, and Michele Grimaldi. 2020. How can crowdsourcing help tackle the COVID-19 pandemic? An explorative overview of innovative collaborative practices. R&D Management (2020).
    [76]
    April Yi Wang, Anant Mittal, Christopher Brooks, and Steve Oney. 2019. How data scientists use computational notebooks for real-time collaboration. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--30.
    [77]
    Robert K Yin. 2017. Case study research and applications: Design and methods. Sage publications.
    [78]
    Zhan Zhang and Aleksandra Sarcevic. 2018. Coordination mechanisms for self-organized work in an emergency communication center. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (2018), 1--21.

    Cited By

    View all
    • (2024)The Personas of Cloud CAD Collaboration: A Case Study of a Team of CAD ProfessionalsIEEE Transactions on Engineering Management10.1109/TEM.2024.340917871(11225-11237)Online publication date: 2024
    • (2024)How do we learn in and from Hackathons? A systematic literature reviewEducation and Information Technologies10.1007/s10639-024-12668-1Online publication date: 13-Apr-2024
    • (2023)Editorial: Re-inventing project-based learning: Hackathons, datathons, devcamps as learning expeditionsFrontiers in Education10.3389/feduc.2023.11822648Online publication date: 28-Mar-2023
    • Show More Cited By

    Index Terms

    1. Socio-technical Constraints and Affordances of Virtual Collaboration - A Study of Four Online Hackathons

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Human-Computer Interaction
      Proceedings of the ACM on Human-Computer Interaction  Volume 6, Issue CSCW2
      CSCW
      November 2022
      8205 pages
      EISSN:2573-0142
      DOI:10.1145/3571154
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 11 November 2022
      Published in PACMHCI Volume 6, Issue CSCW2

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. online hackathons
      2. time-bounded collaborative events

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)94
      • Downloads (Last 6 weeks)14
      Reflects downloads up to 12 Aug 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)The Personas of Cloud CAD Collaboration: A Case Study of a Team of CAD ProfessionalsIEEE Transactions on Engineering Management10.1109/TEM.2024.340917871(11225-11237)Online publication date: 2024
      • (2024)How do we learn in and from Hackathons? A systematic literature reviewEducation and Information Technologies10.1007/s10639-024-12668-1Online publication date: 13-Apr-2024
      • (2023)Editorial: Re-inventing project-based learning: Hackathons, datathons, devcamps as learning expeditionsFrontiers in Education10.3389/feduc.2023.11822648Online publication date: 28-Mar-2023
      • (2023)A hackathon as a tool to enhance research and practice on electronic health record systems’ interoperability for chronic disease management and preventionFrontiers in Digital Health10.3389/fdgth.2023.12757115Online publication date: 14-Nov-2023
      • (2023)Evaluating student satisfaction with online hackathon for IT projectsEurasia Journal of Mathematics, Science and Technology Education10.29333/ejmste/1360819:10(em2338)Online publication date: 2023
      • (2023)The use of extracurricular hackathons to promote and enhance students’ academic and employability skillsInternational Journal of Educational Research Open10.1016/j.ijedro.2023.1003075(100307)Online publication date: Dec-2023

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media