discussion

Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity

Authors:

David D. Woods,

Jeffrey M. Bradshaw,

Robert R. Hoffman,

Paul J. FeltovichAuthors Info & Claims

IEEE Intelligent Systems, Volume 19, Issue 6

Pages 91 - 95

https://doi.org/10.1109/MIS.2004.74

Published: 01 November 2004 Publication History

Abstract

The authors propose 10 challenges for making automation components into effective "team players" when they interact with people in significant ways. Their analysis is based on some of the principles of human-centered computing that they have developed individually and jointly over the years, and is adapted from a more comprehensive examination of common ground and coordination.

References

[1]

G. Klein et al., "Common Ground and Coordination in Joint Activity," to be published in Organizational Simulation, W.R. Rouse and K.B. Boff, eds., John Wiley & Sons, 2005.

[2]

H. Clark, Using Language, Cambridge Univ. Press, 1996.

[3]

K. Christoffersen and D.D. Woods, "How to Make Automated Systems Team Players," Advances in Human Performance and Cognitive Eng. Research, vol. 2, 2002, pp. 1–12.

[4]

H.H. Clark and S.E. Brennan, "Grounding in Communication," Perspectives on Socially Shared Cognition, L.B. Resnick, J.M. Levine, and S.D. Teasley, eds., Am. Psychological Assoc., 1991.

[5]

J.F. Allen and G. Ferguson, "Human-Machine Collaborative Planning," Proc. NASA Planning and Scheduling Workshop, NASA, 2002.

[6]

J.M. Bradshaw et al., "Dimensions of Adjustable Autonomy and Mixed-Initiative Interaction," Agents and Computational Autonomy: Potential, Risks, and Solutions, M. Nickles, M. Rovatsos, and G. Weiss, eds., LNCS 2969, Springer-Verlag, 2004, pp. 17–39.

[7]

M. Tambe et al., "Teamwork in Cyberspace: Using TEAMCORE to Make Agents Team-Ready," Proc. AAAI Spring Symp. Agents in Cyberspace, AAAI Press, 1999, pp. 136–141.

[8]

P.R. Cohen and H.J. Levesque, "Teamwork," Nous, vol. 25, 1991, pp. 487–512.

[9]

J.M. Bradshaw et al., "Making Agents Acceptable to People," Intelligent Technologies for Information Analysis: Advances in Agents, Data Mining, and Statistical Learning, N. Zhong and J. Liu, eds., Springer-Verlag, 2004, pp. 361–400.

[10]

G. Klein, The Power of Intuition, Currency Book/Doubleday, 2004.

[11]

K. Myers and D. Morley, "Directing Agents," Agent Autonomy, H. Hexmoor, C. Castelfranchi, and R. Falcone, eds., Kluwer Academic Publishers, 2003, pp. 143–162.

[12]

D.D. Woods and N. Sarter, "Learning from Automation Surprises and Going Sour Accidents," Cognitive Engineering in the Aviation Domain, N. Sarter and R. Amalberti, eds., Lawrence Erlbaum, 2000, pp. 327–254.

[13]

P.J. Feltovich et al., "Social Order and Adaptability in Animal and Human Cultures as Analogues for Agent Communities: Toward a Policy-Based Approach," Engineering Societies in the Agents World IV, LNAI 3071, Springer-Verlag, 2004, pp. 21–48.

[14]

D.A. Norman, "The 'Problem' with Automation: Inappropriate Feedback and Interaction, Not Over-Automation," Philosophical Trans. Royal Soc. London, vol. 327, 1990, pp. 585–593.

[15]

R.R. Hoffman and D.D. Woods, The Theory of Complex Cognitive Systems, tech. report, Inst. for Human and Machine Cognition, Pensacola, Fla., 2004.

[16]

C.E. Billings, Aviation Automation: The Search for a Human-Centered Approach, Lawrence Erlbaum, 1996.

[17]

D.D. Woods, "Steering the Reverberations of Technology Change on Fields of Practice: Laws That Govern Cognitive Work," Proc. 24th Ann. Meeting Cognitive Science Soc., Lawrence Erlbaum, 2002, pp. 14–17;

[18]

J.M. Bradshaw et al., "Teamwork-Centered Autonomy for Extended Human-Agent Interaction in Space Applications," Proc. AAAI Spring Symp. Interaction between Humans and Autonomous Systems over Extended Operation, AAAI Press, 2004, pp. 136–140.

[19]

N. Sarter and D.D. Woods, "Team Play with a Powerful and Independent Agent: A Full Mission Simulation," Human Factors, vol. 42, 2000, pp. 390–402.

[20]

C.-Y. Ho et al., "Not Now: Supporting Attention Management by Indicating the Modality and Urgency of Pending Tasks," to be published in Human Factors.

Cited By

Maguire LNolan L(2025)Realizing the Benefits of Human–Machine Teaming for Safe Software OperationsIEEE Software10.1109/MS.2024.348076842:1(120-126)Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1109/MS.2024.3480768
Guan CXue KFan CChen FZhang LYuan LQian CYu Y(2025)Open and real-world human-AI coordination by heterogeneous training with communicationFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-024-3797-619:4Online publication date: 1-Apr-2025
https://dl.acm.org/doi/10.1007/s11704-024-3797-6
Natarajan MXue Cvan Waveren SFeigh KGombolay MDastani MSichman JAlechina NDignum V(2024)Mixed-Initiative Human-Robot Teaming under Suboptimality with Online Bayesian AdaptationProceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems10.5555/3635637.3663005(1454-1462)Online publication date: 6-May-2024
https://dl.acm.org/doi/10.5555/3635637.3663005
Show More Cited By

Recommendations

Joint Activity Testbed: Blocks World for Teams (BW4T)
ESAW '09: Proceedings of the 10th International Workshop on Engineering Societies in the Agents World X

This demonstration will be the presentation of a new testbed for joint activity. The domain for this demonstration will be similar to the classic AI planning problem of Blocks World (BW) extended into what we are calling Blocks World for Teams (BW4T). ...
The fundamental principle of coactive design: interdependence must shape autonomy
COIN@AAMAS'10: Proceedings of the 6th international conference on Coordination, organizations, institutions, and norms in agent systems

This article presents the fundamental principle of Coactive Design, a new approach being developed to address the increasingly sophisticated roles for both people and agents in mixed human-agent systems. The fundamental principle of Coactive Design is ...
Wearable Sensing Framework for Human Activity Monitoring
WearSys '15: Proceedings of the 2015 workshop on Wearable Systems and Applications

Wearable computation is getting integrated into our daily life day by day. In this work, we propose a generic framework to continuously monitor users' daily activities. The framework proposes light computation tasks on the wearable device to reduce the ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Intelligent Systems

IEEE Intelligent Systems Volume 19, Issue 6

November 2004

93 pages

ISSN:1541-1672

Issue’s Table of Contents

Copyright © 2006.

Publisher

IEEE Educational Activities Department

United States

Publication History

Published: 01 November 2004

Author Tags

Qualifiers

Discussion

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

101
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Maguire LNolan L(2025)Realizing the Benefits of Human–Machine Teaming for Safe Software OperationsIEEE Software10.1109/MS.2024.348076842:1(120-126)Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1109/MS.2024.3480768
Guan CXue KFan CChen FZhang LYuan LQian CYu Y(2025)Open and real-world human-AI coordination by heterogeneous training with communicationFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-024-3797-619:4Online publication date: 1-Apr-2025
https://dl.acm.org/doi/10.1007/s11704-024-3797-6
Natarajan MXue Cvan Waveren SFeigh KGombolay MDastani MSichman JAlechina NDignum V(2024)Mixed-Initiative Human-Robot Teaming under Suboptimality with Online Bayesian AdaptationProceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems10.5555/3635637.3663005(1454-1462)Online publication date: 6-May-2024
https://dl.acm.org/doi/10.5555/3635637.3663005
Dell'Anna DMurukannaiah PDudzik BGrossi DJonker COertel CYolum PDastani MSichman JAlechina NDignum V(2024)Toward a Quality Model for Hybrid Intelligence TeamsProceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems10.5555/3635637.3662893(434-443)Online publication date: 6-May-2024
https://dl.acm.org/doi/10.5555/3635637.3662893
Denno P(2024)Cognitive work in future manufacturing systemsJournal of Integrated Design & Process Science10.3233/JID-23003527:2(71-82)Online publication date: 19-Mar-2024
https://dl.acm.org/doi/10.3233/JID-230035
de Jong SWester JSchrills TS. Secher KF. Griggio Cvan Berkel N(2024)Assessing Cognitive and Social Awareness among Group Members in AI-assisted CollaborationProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701582(338-350)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701582
Stampf AColley MKnuth ATasci CRukzio E(2024)Examining Psychological Conflict-Handling Strategies for Highly Automated Vehicles to Resolve Legal User-Vehicle ConflictsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785118:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678511
Stampf AColley MGirst BRukzio E(2024)Exploring Passenger-Automated Vehicle Negotiation Utilizing Large Language Models for Natural InteractionProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675725(350-362)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675725
Sadeghian SUhde AHassenzahl M(2024)The Soul of Work: Evaluation of Job Meaningfulness and Accountability in Human-AI CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/36374078:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637407
Chapman RDross CMatthews SMoy Y(2024)Co-Developing Programs and Their Proof of CorrectnessCommunications of the ACM10.1145/362472867:3(84-94)Online publication date: 22-Feb-2024
https://dl.acm.org/doi/10.1145/3624728
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents