Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3313831.3376825acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

The Next Generation of Human-Drone Partnerships: Co-Designing an Emergency Response System

Published: 23 April 2020 Publication History

Abstract

The use of semi-autonomous Unmanned Aerial Vehicles (UAV) to support emergency response scenarios, such as fire surveillance and search and rescue, offers the potential for huge societal benefits. However, designing an effective solution in this complex domain represents a "wicked design" problem, requiring a careful balance between trade-offs associated with drone autonomy versus human control, mission functionality versus safety, and the diverse needs of different stakeholders. This paper focuses on designing for situational awareness (SA) using a scenario-driven, participatory design process. We developed SA cards describing six common design-problems, known as SA demons, and three new demons of importance to our domain. We then used these SA cards to equip domain experts with SA knowledge so that they could more fully engage in the design process. We designed a potentially reusable solution for achieving SA in multi-stakeholder, multi-UAV, emergency response applications.

Supplementary Material

ZIP File (pn9226aux.zip)
Auxiliary material includes: 1. A readme file with a more detailed explanation of each file. 2. Field Notes and Analysis - Field Notes from design sessions (pdf) - A list of candidate themes that emerged from the inductive coding, along with their groupings following the card sorting activity. (pdf) -Analysis of design contributions extracted from field notes (pdf) 3. Screenshots and Wireframes - DroneRescue Prototype Screenshots from Angular app (jpg) - Wireframe prototypes (pdf) 4. Videos - The videos show raw river footage with image recognition. (mp4) - Please note that if this paper is accepted we will provide videos of our team working with firefighters (their uniforms and the map reveal our location and affiliation).
MP4 File (paper696pv.mp4)
Preview video
MP4 File (a696-agrawal-presentation.mp4)

References

[1]
P. J. Antsaklis, K. M. Passino, and S. J. Wang. 1991. An introduction to autonomous control systems. IEEE Control Systems Magazine 11, 4 (June 1991), 5--13.
[2]
ArduPilot. 2019. http://ardupilot.org. (2019). [Online; accessed 01-September-2019].
[3]
R.C. Atkinson and R.M. Shiffrin. 1968. Human Memory: A Proposed System and its Control Processes. Psychology of Learning and Motivation, Vol. 2. Academic Press, 89 -- 195.
[4]
Francesco N Biondi, Monika Lohani, Rachel Hopman, Sydney Mills, Joel M Cooper, and David L Strayer. 2018. 80 MPH and out-of-the-loop: Effects of real-world semi-automated driving on driver workload and arousal. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 62. SAGE Publications, 1878--1882.
[5]
Susanne Bødker and Morten Kyng. 2018. Participatory Design That Matters -- Facing the Big Issues. ACM Trans. Comput.-Hum. Interact. 25, 1, Article 4 (2018), 4:1--4:31 pages.
[6]
Henning Breuer, Frank Heidmann, Mitsuji Matsumoto, Ulrich Raape, and Monika Wnuk. 2009. Interaction Design for Situation Awareness-Eyetracking and Heuristics for Control Centers.
[7]
Jane Cleland-Huang and Michael Vierhauser. 2018. Discovering, Analyzing, and Managing Safety Stories in Agile Projects. In 26th IEEE International Requirements Engineering Conference. 262--273.
[8]
Jane Cleland-Huang, Michael Vierhauser, and Sean Bayley. 2018. Dronology: an incubator for cyber-physical systems research. In Proceedings of the 40th International Conference on Software Engineering: New Ideas and Emerging Results. 109--112.
[9]
Alistair Cockburn. 2000. Writing Effective Use Cases (1st ed.). Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
[10]
Nancy J. Cook. 2007. Stories of Modern Technology Failures and Cognitive Engineering Successes. CRC Press, 2007.
[11]
Richard Coyne. 2005. Wicked problems revisited. Design Studies 26, 1 (2005), 5 -- 17.
[12]
Giuseppe D'Aniello, Vincenzo Loia, and Francesco Orciuoli. 2017. Adaptive Goal Selection for improving Situation Awareness: the Fleet Management case study. Procedia Computer Science 109 (2017), 529 -- 536. 8th International Conference on Ambient Systems, Networks and Technologies, ANT-2017 and the 7th International Conference on Sustainable Energy Information Technology.
[13]
F.E. Emery and E.L. Trist. 1960. Socio-technical systems. In In: Churchman, C.W., Verhulst, M. (Eds.), Management Science Models and Techniques, Vol. 9. Pergamon, 83--97.
[14]
Mica R. Endsley. 2011. Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition (2nd ed.). CRC Press, Inc., Boca Raton, FL, USA.
[15]
Mica R Endsley. 2017. Autonomous driving systems: A preliminary naturalistic study of the Tesla Model S. Journal of Cognitive Engineering and Decision Making 11, 3 (2017), 225--238.
[16]
K. Fellah and M. Guiatni. 2019. Tactile Display Design for Flight Envelope Protection and Situational Awareness. IEEE Transactions on Haptics 12, 1 (Jan 2019), 87--98.
[17]
Jennifer Fereday and Eimear Muir-Cochrane. 2006. Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive coding and theme development. International journal of qualitative methods 5, 1 (2006), 80--92.
[18]
Naveen Gautam, Ratna Babu Chinnam, and Nanua Singh. 2007. Design reuse framework: A perspective for lean development. Int. J. Product Development Int. J. Product Development 4 (01 2007), 485--507.
[19]
Matthew C. Gombolay, Anna Bair, Cindy Huang, and Julie A. Shah. 2017. Computational design of mixed-initiative human-robot teaming that considers human factors: situational awareness, workload, and workflow preferences. I. J. Robotics Res. 36, 5--7 (2017), 597--617.
[20]
Colin M. Gray. 2016. "It's More of a Mindset Than a Method": UX Practitioners' Conception of Design Methods. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 4044--4055.
[21]
Sofja Hotomski and Martin Glinz. 2018. A Qualitative Study on using GuideGen to Keep Requirements and Acceptance Tests Aligned. In 26th IEEE International Requirements Engineering Conference. 29--39.
[22]
Hermann Kaindl. 2000. A design process based on a model combining scenarios with goals and functions. IEEE Trans. Systems, Man, and Cybernetics, Part A 30, 5 (2000), 537--551.
[23]
Leah Kaufman and Brad Weed. 1998. Too much of a good thing?: Identifying and resolving bloat in the user interface. In CHI 98 Conference Summary on Human Factors in Computing Systems. 207--208.
[24]
Md. Nafz Hasan Khan and Carman Neustaedter. 2019. Exploring Drones to Assist Firefghters During Emergencies. In 1st International Workshop on Human-Drone Interaction. Ecole Nationale de l'Aviation Civile [ENAC], Glasgow, United Kingdom. https://hal.archives-ouvertes.fr/hal-02128386
[25]
L.T. Kohn, J.M. Corrigan, and M.s. Donaldson. 1999. To err is human, Building a safety health system. Washington, DC: National Academy Press (1999).
[26]
Clayton Lewis and John Rieman. 2006. Task-centered user interface design: A practical introduction.
[27]
H. Lukosch, T. van Ruijven, and A. Verbraeck. 2012. The participatory design of a simulation training game. In Proceedings of the 2012 Winter Simulation Conference (WSC). 1--11.
[28]
Owen McAree, Jonathan M. Aitken, and Sandor M. Veres. 2017. Towards artificial situation awareness by autonomous vehicles. IFAC-PapersOnLine 50, 1 (2017), 7038 -- 7043. 20th IFAC World Congress.
[29]
Jason S. Mccarley and Christopher D. Wickens. Human factors concerns in UAV fight. Technical Report.
[30]
Joanna McGrenere, Ronald M. Baecker, and Kellogg S. Booth. 2002. An Evaluation of a Multiple Interface Design Solution for Bloated Software. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 164--170.
[31]
Brenna McNally, Mona Leigh Guha, Matthew Louis Mauriello, and Allison Druin. 2016. Children's Perspectives on Ethical Issues Surrounding Their Past Involvement on a Participatory Design Team. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 3595--3606.
[32]
George A. Miller. 1956. Human memory and the storage of information. IRE Trans. Information Theory 2, 3 (1956), 129--137.
[33]
Shane T Mueller and Gary Klein. 2011. Improving users' mental models of intelligent software tools. IEEE Intelligent Systems 26, 2 (2011), 77--83.
[34]
D.C. Nagel. 1998. Human error in aviation Operations. Human factors in Aviation, E.L.Weiner and E.C.Nagel (Eds) 19890047069, 34 (1998), 263--303.
[35]
Jakob Nielsen and Rolf Molich. 1990. Heuristic evaluation of user interfaces. In Proceedings of the Conference on Human Factors in Computing Systems, CHI 1990. 249--256.
[36]
Donald A. Norman. 2002. The Design of Everyday Things. Basic Books, Inc., New York, NY, USA.
[37]
Natália Oliveira, Fabio Jorge, Jessica De Souza, Valdir Junior, and Leonardo Botega. 2016. Development of a User Interface for the Enrichment of Situational Awareness in Emergency Management Systems. Vol. 491. 173--184.
[38]
E Onal, C Craddock, and Mica Endsley. 2013. From Theory to Practice: How Designing for Situation Awareness Can Transform Confusing, Overloaded Shovel Operator Interfaces, Reduce Costs, and Increase Safety.
[39]
A. Parush, G. Mastoras, A. Bhandari, K. Momtahan, K. Day, B. Weitzman, B. Sohmer, A. Cwinn, S.J. Hamstra, and L. Calder". 2017. Can teamwork and situational awareness (SA) in ED resuscitations be improved with a technological cognitive aid? Design and a pilot study of a team situation display. Journal of Biomedical Informatics 76 (2017), 154 -- 161.
[40]
Colin Potts. 1995. Using Schematic Scenarios to Understand User Needs. In Proceedings of the 1st Conference on Designing Interactive Systems: Processes, Practices, Methods and Techniques, DIS '95. 247--256.
[41]
Raj Prasanna, Lili Yang, and Mlcolm King. 2009. Situation awareness oriented user interface design for fre emergency response. Journal of Emergency Management 7 (03 2009), 65--74.
[42]
Joseph Redmon and Ali Farhadi. 2018. YOLOv3: An Incremental Improvement. CoRR abs/1804.02767 (2018). http://arxiv.org/abs/1804.02767
[43]
Nicolas Regis, Frédéric Dehais, Emmanuel Rachelson, Charles Thooris, Sergio Pizziol, Mickaël Causse, and Catherine Tessier. 2014. Formal Detection of Attentional Tunneling in Human Operator-Automation Interactions. IEEE Trans. Human-Machine Systems 44, 3 (2014), 326--336.
[44]
Debbie Richards. 2000. The reuse of knowledge: a user-centred approach. Int. J. Hum.-Comput. Stud. 52, 3 (2000), 553--579.
[45]
Horst W. J. Rittel and Melvin M. Webber. 1973. Dilemmas in a general theory of planning. In Policy Sciences, Vol. 4. 155--169.
[46]
John Rushby. 2001. Modeling the human in human factors. In International Conference on Computer Safety, Reliability, and Security. Springer, 86--91.
[47]
Filippo Santoni de Sio and Jeroen van den Hoven. 2018. Meaningful Human Control over Autonomous Systems: A Philosophical Account. Frontiers in Robotics and AI 5 (2018), 15.
[48]
Douglas Schuler and Aki Namioka (Eds.). 1993. Participatory Design: Principles and Practices. L. Erlbaum Associates Inc., Hillsdale, NJ, USA.
[49]
J. Shi, J. Wan, H. Yan, and H. Suo. 2011. A survey of Cyber-Physical Systems. In 2011 International Conference on Wireless Communications and Signal Processing (WCSP). 1--6.
[50]
Tim Claudius Stratmann and Susanne Boll. 2016. Demon Hunt - The Role of Endsley's Demons of Situation Awareness in Maritime Accidents. In Human-Centered and Error-Resilient Systems Development, Cristian Bogdan, Jan Gulliksen, Stefan Sauer, Peter Forbrig, Marco Winckler, Chris Johnson, Philippe Palanque, Regina Bernhaupt, and Filip Kis (Eds.). Springer International Publishing, Cham, 203--212.
[51]
Deborah Tatar. 2007. The Design Tensions Framework. Hum.-Comput. Interact. 22, 4 (Nov. 2007), 413--451. http://dl.acm.org/citation.cfm?id=1466607.1466609
[52]
David R Thomas. 2006. A general inductive approach for analyzing qualitative evaluation data. American journal of evaluation 27, 2 (2006), 237--246.
[53]
Saurabh Tiwari and Atul Gupta. 2015. A Systematic Literature Review of Use Case Specifications Research. Inf. Softw. Technol. 67, C (Nov. 2015), 128--158.
[54]
Axel van Lamsweerde, Robert Darimont, and Emmanuel Letier. 1998. Managing Conflicts in Goal-Driven Requirements Engineering. IEEE Trans. Software Eng. 24, 11 (1998), 908--926.
[55]
Guy H. Walker, Neville A. Stanton, Paul M. Salmon, and Daniel P. Jenkins. 2008. A review of sociotechnical systems theory: a classic concept for new command and control paradigms. Theoretical Issues in Ergonomics Science 9, 6 (2008), 479--499.
[56]
Christopher D Wickens and Amy L Alexander. 2009. Attentional tunneling and task management in synthetic vision displays. The International Journal of Aviation Psychology 19, 2 (2009), 182--199.

Cited By

View all
  • (2024)Human–machine Teaming with Small Unmanned Aerial Systems in a MAPE-K EnvironmentACM Transactions on Autonomous and Adaptive Systems10.1145/361800119:1(1-35)Online publication date: 14-Feb-2024
  • (2024)HIFuzz: Human Interaction Fuzzing for Small Unmanned Aerial VehiclesProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642958(1-14)Online publication date: 11-May-2024
  • (2024)Firefighters' Perceptions on Collaboration and Interaction with Autonomous Drones: Results of a Field TrialProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642061(1-19)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. The Next Generation of Human-Drone Partnerships: Co-Designing an Emergency Response System

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
      April 2020
      10688 pages
      ISBN:9781450367080
      DOI:10.1145/3313831
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 April 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Honorable Mention

      Author Tags

      1. emergency response
      2. human-CPS interactions
      3. participatory design
      4. situational awareness
      5. unmanned aerial vehicles

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      CHI '20
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)268
      • Downloads (Last 6 weeks)16
      Reflects downloads up to 18 Aug 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Human–machine Teaming with Small Unmanned Aerial Systems in a MAPE-K EnvironmentACM Transactions on Autonomous and Adaptive Systems10.1145/361800119:1(1-35)Online publication date: 14-Feb-2024
      • (2024)HIFuzz: Human Interaction Fuzzing for Small Unmanned Aerial VehiclesProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642958(1-14)Online publication date: 11-May-2024
      • (2024)Firefighters' Perceptions on Collaboration and Interaction with Autonomous Drones: Results of a Field TrialProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642061(1-19)Online publication date: 11-May-2024
      • (2024)NOMAD: A Natural, Occluded, Multi-scale Aerial Dataset, for Emergency Response Scenarios2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00839(8569-8580)Online publication date: 3-Jan-2024
      • (2023)Real-Time Human Motion Tracking by Tello EDU DroneSensors10.3390/s2302089723:2(897)Online publication date: 12-Jan-2023
      • (2023)The Use of Decision Support in Search and Rescue: A Systematic Literature ReviewISPRS International Journal of Geo-Information10.3390/ijgi1205018212:5(182)Online publication date: 25-Apr-2023
      • (2023)Go with the Flow: Estimating Wind Using Uncrewed AircraftDrones10.3390/drones70905647:9(564)Online publication date: 1-Sep-2023
      • (2023)Championing Design Knowledge in Human-Drone Interaction ResearchProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623927(365-368)Online publication date: 4-Dec-2023
      • (2023)Wisp: Drones as Companions for BreathingProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572740(1-16)Online publication date: 26-Feb-2023
      • (2023)Challenges and Requirements in Multi-Drone InterfacesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585673(1-9)Online publication date: 19-Apr-2023
      • Show More Cited By

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media