Article

Building strong semi-autonomous systems

Author:

Shlomo ZilbersteinAuthors Info & Claims

AAAI'15: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence

Pages 4088 - 4092

Published: 25 January 2015 Publication History

Abstract

The vision of populating the world with autonomous systems that reduce human labor and improve safety is gradually becoming a reality. Autonomous systems have changed the way space exploration is conducted and are beginning to transform everyday life with a range of household products. In many areas, however, there are considerable barriers to the deployment of fully autonomous systems. We refer to systems that require some degree of human intervention in order to complete a task as semi-autonomous systems. We examine the broad rationale for semi-autonomy and define basic properties of such systems. Accounting for the human in the loop presents a considerable challenge for current planning techniques. We examine various design choices in the development of semi-autonomous systems and their implications on planning and execution. Finally, we discuss fruitful research directions for advancing the science of semi-autonomy.

References

[1]

Amato, C.; Bernstein, D. S.; and Zilberstein, S. 2010. Optimizing fixed-size stochastic controllers for POMDPs and decentralized POMDPs. Autonomous Agents and Multi-Agent Systems 21(3):293-320.

[2]

Anderson, S. J.; Peters, S. C.; Iagnemma, K. D.; and Pilutti, T. E. 2009. A unified approach to semi-autonomous control of passenger vehicles in hazard avoidance scenarios. In Proc. of the IEEE Int'l Conference on Systems, Man and Cybernetics, 2032-2037.

[3]

Arkin, R. C. 2009. Ethical robots in warfare. IEEE Technology and Society Magazine 28(1):30-33.

[4]

Bechar, A., and Edan, Y. 2003. Human-robot collaboration for improved target recognition of agricultural robots. Industrial Robot: An International Journal 30(5):432-436.

[5]

Bernstein, D. S.; Givan, R.; Immerman, N.; and Zilberstein, S. 2002. The complexity of decentralized control of Markov decision processes. Mathematics of Operations Research 27:819-840.

[6]

Bernstein, D. S.; Amato, C.; Hansen, E. A.; and Zilberstein, S. 2009. Policy iteration for decentralized control of Markov decision processes. Journal of Artificial Intelligence Research 34:89-132.

[7]

Borowsky, A.; Horrey, W. J.; Liang, Y.; Garabet, A.; Simmons, L.; and Fisher, D. L. 2013. The effects of momentary visual disruption on hazard anticipation. In Proc. of Seventh Int'l Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design.

[8]

Bradshaw, J. M.; Jung, H.; Kulkarni, S.; Johnson, M.; Feltovich, P.; Allen, J.; Bunch, L.; Chambers, N.; Galescu, L.; Jeffers, R.; Suri, N.; Taysom, W.; and Uszok, A. 2005. Kaa: policy-based explorations of a richer model for adjustable autonomy. In Proc. of the Fourth Int'l Joint Conference on Autonomous Agents and Multiagent Systems, 214-221.

[9]

Bresina, J.; Jónsson, A.; Morris, P.; and Rajan, K. 2005. Mixed-initiative activity planning for Mars rovers. In Proc. of the Nineteenth Int'l Joint Conference on Artificial Intelligence, 1709-1710.

[10]

Burstein, M., and McDermott, D. 1996. Issues in the development of human-computer mixed-initiative planning. In Gorayska, B., and Mey, J. L., eds., Cognitive Technology. Elsevier. 285-303.

[11]

Chaffins, G. 2008. Robotrac is at home down on the farm. Nerd-Beach.

[12]

Cohen, R.; Jung, H.; Fleming, M. W.; and Cheng, M. Y. 2011. A user modeling approach for reasoning about interaction sensitive to bother and its application to hospital decision scenarios. User Modeling and User-Adapted Interaction 21(4-5):441-484.

[13]

Côté, N.; Canu, A.; Bouzid, M.; and Mouaddib, A.-I. 2012. Humans-robots sliding collaboration control in complex environments with adjustable autonomy. In Proc. of Intelligent Agent Technology, 146-153.

[14]

Côté, N.; Bouzid, M.; and Mouaddib, A.-I. 2013. Integrating human recommendations in the decision process of autonomous agents. In Proc. of Intelligent Agent Technology, 195-200.

[15]

Crandall, J. W.; Goodrich, M. A.; Olsen, Jr., D. R.; and Nielsen, C. W. 2005. Validating human-robot interaction schemes in multitasking environments. IEEE Transactions on Systems, Man and Cybernetics, Part A 35(4):438-449.

[16]

Dorais, G. A.; Bonasso, R. P.; Kortenkamp, D.; Pell, B.; and Schreckenghost, D. 1999. Adjustable autonomy for human-centered autonomous systems. In IJCAI Workshop on Adjustable Autonomy Systems, 16-35.

[17]

Doyle, R. J. 2003. Autonomy needs and trends in deep space exploration. Intelligent Systems for Aeronautics 4(1):4-12.

[18]

Durfee, E. H. 1995. Blissful ignorance: Knowing just enough to coordinate well. In Proc. of the First Int'l Joint Conference on Autonomous Agents and Multiagent Systems, 406-413.

[19]

Fernández, J. L.; Simmons, R.; Sanches, R.; and Diéguez, A. R. 2001. A robust stochastic supervision architecture for an indoor mobile robot. In Proc. of the Int'l Conference on Field and Service Robotics, 269-274.

[20]

Fong, T.; Nourbakhsh, I.; and Dautenhahn, K. 2003. A survey of socially interactive robots. Robotics and Autonomous Systems 143-166.

[21]

Freedman, R. G.; Jung, H.-T.; and Zilberstein, S. 2014. Plan and activity recognition from a topic modeling perspective. In Proc. of the Int'l Conference on Automated Planning and Scheduling, 360- 364.

[22]

Frost, C. R. 2010. Challenges and opportunities for autonomous systems in space. In Proc. of the National Academy of Engineerings U.S. Frontiers of Engineering Symposium.

[23]

Ghallab, M.; Nau, D.; and Traverso, P. 2004. Automated Planning: Theory and Practice. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.

[24]

Goldberg, K.; Chen, B.; Solomon, R.; Bui, S.; Farzin, B.; Heitler, J.; Poon, D.; and Smith, G. 2000. Collaborative teleoperation via the Internet. In IEEE Int'l Conference on Robotics and Automation, 2019-2024.

[25]

Gomez, R.; Samuel, S.; Roman Gerardino, L.; Romoser, M. R. E.; and Fisher, D. L. 2011. Do advance yield markings increase safe driver behaviors at unsignalized, marked midblock crosswalks: A simulator study. Transportation Research Record 2264:27-33.

[26]

Goodrich, M. A.; Olsen, Jr., D. R.; Crandall, J. W.; and Palmer, T. J. 2001. Experiments in adjustable autonomy. In IEEE Int'l Conference on Systems, Man and Cybernetics, 1624-1629.

[27]

Grosz, B. J., and Kraus, S. 1996. Collaborative plans for complex group action. Artificial Intelligence 86:269-357.

[28]

Hüttenrauch, H., and Severinson Eklundh, K. 2006. Beyond usability evaluation: Analysis of human-robot interaction at a major robotics competition. Interaction Studies 7(3):455-477.

[29]

Ishikawa, N., and Suzuki, K. 1997. Development of a human and robot collaborative system for inspecting patrol of nuclear power plants. In Robot and Human Communication, 118-123.

[30]

Jensen, R. M.; Veloso, M. M.; and Bryant, R. E. 2004. Fault tolerant planning: Toward probabilistic uncertainty models in symbolic non-deterministic planning. In Proc. of the Fourteenth Int'l Conference on Automated Planning and Scheduling, 335-344.

[31]

Jung, C. R., and Kelber, C. R. 2004. A lane departure warning system based on a linear-parabolic lane model. In Proc. of IEEE Intelligent Vehicles Symposium, 891-895.

[32]

Longjard, C.; Kumsawat, P.; Attakitmongkol, K.; and Srikaew, A. 2007. Automatic lane detection and navigation using pattern matching mode. In Proc. of the Seventh WSEAS Int'l Conference on Signal, Speech and Image Processing, 44-49.

[33]

Markoff, J. 2012. Collision in the making between self-driving cars and how the world works. New York Times.

[34]

Marschak, J. 1955. Elements for a theory of teams. Management Science 1:127-137.

[35]

Marsland, S.; Nehmzow, U.; and Duckett, T. 2001. Learning to select distinctive landmarks for mobile robot navigation. Robotics and Autonomous Systems 37:241-260.

[36]

Mouaddib, A.-I.; Zilberstein, S.; Beynier, A.; and Jeanpierre, L. 2010. A decision-theoretic approach to cooperative control and adjustable autonomy. In Proc. of the Nineteenth European Conference on Artificial Intelligence, 971-972.

[37]

Muscettola, N.; Nayak, P. P.; Pell, B.; and Williams, B. C. 1998. Remote agent: to boldly go where no AI system has gone before. Artificial Intelligence 103(1-2):5-47.

[38]

Muttart, J. W., and Fisher, D. L. 2013. Comparing response behaviors of newly licensed drivers to exemplary drivers at high risk curves and turning locations. In Proc. of Seventh Int'l Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design.

[39]

Nilsson, N. J. 1984. Shakey the robot. Technical Note 323, AI Center, SRI International.

[40]

Pell, B.; Bernard, D. E.; Chien, S.; Gat, E.; Muscettola, N.; Nayak, P. P.; Wagner, M. D.; and Williams, B. C. 1996. Remote agent prototype for spacecraft autonomy. In Proc. of the SPIE Conference on Space Sciencecraft Control and Tracking in the New Millennium, 74-90.

[41]

Pineda, L.; Lu, Y.; Zilberstein, S.; and Goldman, C. V. 2013. Fault-tolerant planning under uncertainty. In Proc. of the Twenty-Third Int'l Joint Conference on Artificial Intelligence, 2350-2356.

[42]

Pradhan, A. K.; Hammel, K. R.; DeRamus, R.; Pollatsek, A.; Noyce, D. A.; and Fisher, D. L. 2005. The use of eye movements to evaluate the effects of driver age on risk perception in an advanced driving simulator. Human Factors 47:840-852.

[43]

Rosenthal, S., and Veloso, M. M. 2012. Mobile robot planning to seek help with spatially-situated tasks. In Proc. of the Twenty-Sixth AAAI Conference on Artificial Intelligence.

[44]

Rosenthal, S.; Veloso, M. M.; and Dey, A. K. 2012a. Acquiring accurate human responses to robots' questions. Int'l Journal of Social Robotics 4(2):117-129.

[45]

Rosenthal, S.; Veloso, M. M.; and Dey, A. K. 2012b. Is someone in this office available to help me? - proactively seeking help from spatially-situated humans. Journal of Intelligent and Robotic Systems 66(1-2):205-221.

[46]

Seuken, S., and Zilberstein, S. 2008. Formal models and algorithms for decentralized decision making under uncertainty. Autonomous Agents and Multi-Agent Systems 17(2):190-250.

[47]

Shiomi, M.; Sakamoto, D.; Kanda, T.; Ishi, C. T.; Ishiguro, H.; and Hagita, N. 2008. A semi-autonomous communication robot: a field trial at a train station. In Proc. of the 3rd ACM/IEEE Int'l Conference on Human Robot Interaction, 303-310. New York, NY, USA: ACM.

[48]

Thomson, I. 2012. Google promises autonomous cars for all within five years. The Register, http://www.theregister.co.uk/2012/09/25/googleautomaticcarslegal/.

[49]

Tsitsiklis, J. N., and Athans, M. 1985. On the complexity of decentralized decision making and detection problems. IEEE Transactions on Automatic Control 30(2):440-446.

[50]

White, J. B. 2013. Nissan expects to market self-driving cars by 2020. The Wall Street Journal.

[51]

Woodyard, C. 2010. GM takes its EN-V two-wheeler out for a spin. USA Today.

[52]

Wray, K. H.; Zilberstein, S.; and Mouaddib, A.-I. 2015. Multi-objective MDPs with conditional lexicographic reward preferences. In Proc. of the 29th Conference on Artificial Intelligence.

[53]

Yanco, H. A.; Drury, J. L.; and Scholtz, J. 2004. Beyond usability evaluation: Analysis of human-robot interaction at a major robotics competition. Human-Computer Interaction 19(1-2):117-149.

Cited By

Gavidia-Calderon CKordoni ABennaceur ALevine MNuseibeh B(2024)The IDEA of Us: An Identity-Aware Architecture for Autonomous SystemsACM Transactions on Software Engineering and Methodology10.1145/3654439Online publication date: 28-Mar-2024
https://dl.acm.org/doi/10.1145/3654439
Mahmud SSaisubramanian SZilberstein SElkind E(2023)Explanation-guided reward alignmentProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/53(473-482)Online publication date: 19-Aug-2023
https://dl.acm.org/doi/10.24963/ijcai.2023/53
Jahan FSun WNiyaz QAlam M(2019)Security Modeling of Autonomous SystemsACM Computing Surveys10.1145/333779152:5(1-34)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3337791
Show More Cited By

Recommendations

Interactive Teleoperation Interface for Semi-autonomous Control of Robot Arms
CRV '14: Proceedings of the 2014 Canadian Conference on Computer and Robot Vision

We propose and develop an interactive semi-autonomous control of robot arms. Our system controls two interactions: (1) A user can naturally control a robot arm by a direct linkage to the arm motion from the tracked human skeleton. (2) An autonomous ...
Semi-autonomous operation of tracked vehicles on rough terrain using autonomous control of active flippers
IROS'09: Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems

For tracked vehicles moving over rough terrain, it is important to avoid rollovers and rapid motion. To realize smooth locomotion on rough terrain, some tracked vehicles are equipped with "active flippers." Such flippers increase the traversability and ...
Haptic Steering Interfaces for Semi-Autonomous Vehicles

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

AAAI'15: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence

January 2015

4331 pages

ISBN:0262511290

Sponsors

Association for the Advancement of Artificial Intelligence

Publisher

AAAI Press

Publication History

Published: 25 January 2015

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gavidia-Calderon CKordoni ABennaceur ALevine MNuseibeh B(2024)The IDEA of Us: An Identity-Aware Architecture for Autonomous SystemsACM Transactions on Software Engineering and Methodology10.1145/3654439Online publication date: 28-Mar-2024
https://dl.acm.org/doi/10.1145/3654439
Mahmud SSaisubramanian SZilberstein SElkind E(2023)Explanation-guided reward alignmentProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/53(473-482)Online publication date: 19-Aug-2023
https://dl.acm.org/doi/10.24963/ijcai.2023/53
Jahan FSun WNiyaz QAlam M(2019)Security Modeling of Autonomous SystemsACM Computing Surveys10.1145/333779152:5(1-34)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3337791
Mostafa SAhmad MMustapha A(2019)Adjustable autonomyArtificial Intelligence Review10.1007/s10462-017-9560-851:2(149-186)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1007/s10462-017-9560-8
Zhang JBareinboim EAndre EKoenig SDastani MSukthankar G(2018)Characterizing the Limits of Autonomous SystemsProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3238107(2165-2167)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3238107
Altshuler NSarne DAndre EKoenig SDastani MSukthankar G(2018)Modeling Assistant's Autonomy Constraints as a Means for Improving Autonomous Assistant-Agent DesignProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3237919(1468-1476)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3237919
Vanhée LBorit MSantos JAndre EKoenig SDastani MSukthankar G(2018)Autonomous Fishing Vessels Roving the SeasProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3237875(1193-1197)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3237875
Brondani Jde Freitas ESilva L(2017)A task-oriented and parameterized (semi) autonomous navigation framework for the development of simulation systemsProcedia Computer Science10.1016/j.procs.2017.08.161112:C(534-543)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1016/j.procs.2017.08.161
Amir OKamar EKolobov AGrosz B(2016)Interactive teaching strategies for agent trainingProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3060621.3060733(804-811)Online publication date: 9-Jul-2016
https://dl.acm.org/doi/10.5555/3060621.3060733
Wray KPineda LZilberstein S(2016)Hierarchical approach to transfer of control in semi-autonomous systemsProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3060621.3060694(517-523)Online publication date: 9-Jul-2016
https://dl.acm.org/doi/10.5555/3060621.3060694
Show More Cited By

View Options

View options

Figures

Tables

Media

View Table of Conten