Abstract
Time delay is an inherent technical feature that cannot be eliminated during space robot teleoperation and can significantly impact operator workload. In this paper, based on predictive display technology, we investigate the change of operator workload during teleoperation by image prediction graphical interface and virtual reality prediction graphical interface. By constructing a virtual simulation experiment platform for a remote operation system, 20 participants were tested and analyzed in a fetch-place experiment; TAM, NASA-TLX, and AB-directed questionnaires were distributed for subjective measurements to understand the personal perceptions and visual preferences of the participants on their workloads, and to investigate the applicability of the predictive display technology to reduce the operator’s cognitive load. The results showed that the subjective and objective performance of the virtual reality predictive graphical interface (VR-PGI) was higher than that of the image predictive graphical interface (I-PGI) in the fetch-place operation scenario. It was found that the operator’s workload did not change significantly with the increase of spatial time delay in the predictive graphical interface, which proved the practicality of applying the predictive graphical interface to the spatial teleoperation scenario.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, X., Cao, J.: Dual-arm collaborative robot technology. Autom. Panor. 328(10), 84–90 (2020)
Chen, J., Huang, W., Song, A.: Dynamic model of human operator in force telepresence system based on virtual reality technology. J. Trans. Technol. 15(1), 230–236 (2001)
Arcara, P., Melchiorri, C.: Control schemes for teleoperation with time delay: a comparative study. Robot. Auton. Syst. 38(1), 49–64 (2002)
Sweller, J.: Cognitive load theory. Psychol. Learn. Motiv. 2011(55), 37–76 (2011)
Bejczy, A.K., Kim, W.S., Venema, S.C.: The phantom robot: predictive displays for teleoperation with time delay. In: International Conference on Robotics and Automation, Cincinnati, OH, USA, pp. 546–551 (1990)
Chou, W., Meng, C., Chen, J., Li, S.: Robot-assisted remote operating system for space science experiments. China Space Sci. Technol. 2003(06), 10–16 (2003)
Sheridan, T.B.: Human supervisory control of robot systems. In: 1986 IEEE International Conference, pp. 808–812 (1986)
Hirzinger, G., Landzettel, K., Dietrich, J.: Sensor-based space robotics - ROTEX and its telerobotic features. In: IEEE Transactions on Robotics and Automation, Graz, Austri, pp. 649–663 (1993)
Freund, E., Rossmann, J.: A new telepresence approach through the combination of virtual reality and robot control techniques. SPIE’s Int. Tech. Gr. Newsl. (2001)
Dybvik, H., Loland, M., Gerstenberg, A., Slattsveen, K.B., Steinert, M.: A low-cost predictive display for teleoperation: investigating effects on human performance and workload. Int. J. Hum. Comput. Stud. 145(1), 10–15 (2021)
Deying, G.: Optimization Management of Cognitive Load in Multimedia Learning. Southwest University, Chongqing (2009)
Kalyuga, S.: Expertise reversal effect and its implications for learner-tailored instruction. Educ. Psychol. Rev. 19(4), 509–539 (2007)
Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12(2), 257–285 (1988)
Gombolay, M., Bair, A., Huang, C., Shah, J.: Computational design of mixed-initiative human–robot teaming that considers human factors: situational awareness, workload, and workflow preferences. Int. J. Robot. Res. 36, 597–617 (2017)
Parasuraman, R., Sheridan, T.B., Wickens, C.D.: Situation awareness, mental workload, and trust in automation: viable, empirically supported cognitive engineering constructs. J. Cognit. Eng. Decis. Mak. 2(2), 140–160 (2008)
Jia, Y., Xi, N., Liu, S., et al.: Quality of teleoperator adaptive control for teleroboticoperations. Int. J. Robot. Res. 33(14), 1765–1781 (2014)
Li, Y., Liu, S., Xi, N., et al.: A study of the relationship between brain states and skill level of teleoperator. In: 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 390–395 (2013)
Schmidlin, E.A., Jones, K.S.: Do tele-operators learn to better judge whether a robot can passthrough an aperture? Hum. Factors 58(2), 360–369 (2016)
Loft, S., Sanderson, P., Neal, A., et al.: Modeling and predicting mental workload in en route air traffic control: critical review and broader implications. Hum. Factors 49(3), 376–399 (2007)
Brookings, J.B., Wilson, G.F., Swain, C.R.: Psychophysiological responses to changes in workload during simulated air traffic control. Biol. Psychol. 42(3), 361–377 (1996)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)
Kramer, A.F.: Physiological metrics of mental workload: a review of recent progress. Physiol. Metr. Ment. Workload Rev. Recent Prog. 279–328 (1991)
Steinfeld, A., Fong, T., Kaber, D., et al.: Common metrics for human-robot interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, New York, pp. 33–40 (2006)
Clarke, M.A., Schuetzler, R.M., Windle, J.R., et al.: Usability and cognitive load in the design of a personal health record. Health Policy Technol. 9(2), 218–224 (2020)
You, Q.: Research and Application of Virtual Reality Oriented Digital Interface Usability. Guizhou University, Guiyang (2020)
Davis, F.D.: A technology Acceptance Model for Empirically Testing New end-User Information Systems: Theoryand Results. Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, pp. 40–64 (1986)
Funding
The Funding Agency is CHINA VIDEO INDUSTRY ASSOCIATION (CVIA), and the grant number is ZSXKT2023002.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yan, J., Sun, J., Tang, T., Chen, Z. (2023). Visual Design for Predictive Display in Spatial Time-Delay Environments Considering Workload. In: Marcus, A., Rosenzweig, E., Soares, M.M. (eds) Design, User Experience, and Usability. HCII 2023. Lecture Notes in Computer Science, vol 14031. Springer, Cham. https://doi.org/10.1007/978-3-031-35696-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-031-35696-4_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35695-7
Online ISBN: 978-3-031-35696-4
eBook Packages: Computer ScienceComputer Science (R0)