Toward human-centered intelligent assistance system in manufacturing: : challenges and potentials for operator 5.0
Authors: 
Christian Bechinie, Setareh Zafari, Lukas Kroeninger, Jaison Puthenkalam, Manfred TscheligiAuthors Info & Claims
Christian Bechinie, Setareh Zafari, Lukas Kroeninger, Jaison Puthenkalam, Manfred TscheligiAuthors Info & ClaimsAbstract
The human-centered view emphasizes various aspects including usability, acceptance, and understandability, as they emerge in the interaction between humans and intelligent systems. For intelligent assistance systems to provide long-term added value in working environments, it is of major importance to develop a positive user experience. However, a positive user experience does not appear by itself but must be systematically investigated and designed. In this paper, we focus on the role of operator 5.0 in manufacturing and provide an overview of the main challenges and potentials related to working with intelligent systems. Drawing upon state-of-the-art literature and findings from industry (context and expert interviews and user experience workshops), this paper investigates the main discontinuous production processes (i.e., process monitoring, process optimization, process maintenance) that will undergo a series of changes due to integration of cutting-edge technologies (such as Digital Twins, Extended Reality, and Artificial Intelligence). It then identifies requirements and discusses key challenges for the realization of human-centered assistance systems. By highlighting underexplored research questions and potential improvements in industrial settings, this paper provides researchers and practitioners to establish a holistic understanding of the user experience along the industry 5.0 journey
References
[1]
Dimitris Mourtzis, John Angelopoulos and, Niklos Panopoulos, Operator 5.0: A survey on enabling technologies and a framework for digital manufacturing based on extended reality, Journal of Machine Engineering (2022).
[2]
Tim Miller, Explanation in artificial intelligence: Insights from the social sciences, Artificial intelligence (2019) 1–38.
[3]
Maija Breque, Lars De Nul and Athanasios Petridis. Industry 5.0: Towards a sustainable, humancentric and resilient European industry, European Commission, Directorate-General for Research and Innovation (2021).
[4]
Marina Crnjac Zizic, Marko Mladineo, Nikola Gjeldum, Luka Celent, From industry 4.0 towards industry 5.0: A review and analysis of paradigm shift for the people, organization and technology, Energies 15 (14) (2022) 5221.
[5]
Tariq Masood, Johanna Egger, Augmented reality in support of Industry 4.0—implementation challenges and success factors, Robotics and Computer-Integrated Manufacturing 58 (2019) 181–195.
[6]
Eija Kaasinen, Anu-Hanna Anttila, Päivi Heikkilä, Jari Laarni, Hanna Koskinen, Antti Väätänen, Smooth and resilient human-machine teamwork as an industry 5.0 design challenge, Sustainability 14 (5) (2022) 2773.
[7]
Jochen Deuse, Rene Woestmann, Vanessa Weßkamp, David Wagstyl, Christoph Rieger, Digital Work in smart production systems: changes and challenges in manufacturing planning and operations, New Digital Work: Digital Sovereignty at the Workplace, Springer International Publishing, 2023, pp. 31–50.
[8]
David Romero, Johan Stahre, Towards the Resilient Operator 5.0: The Future of Work in Smart Resilient Manufacturing Systems, Procedia CIRP 104 (2021) 1089–1094.
[9]
ISO 9241-210, Ergonomics of human-system interaction, Part 210: Human-centred design process for interactive (2008).
[10]
Jiewu Leng, Weinan Sha, Baicun Wang, Pai Zheng, Cunbo Zhuang, Qiang Liu, Lihui Wang, Industry 5.0: Prospect and retrospect, Journal of Manufacturing Systems 65 (2022) 279–295.
[11]
Daryl Powell, Maria Chiara Magnanini, Marcello Colledani, Odd Myklebust, Advancing zero defect manufacturing: A state-of-the-art perspective and future research directions, Computers in Industry 136 (2022).
[12]
Alexander Maedche, Christine Legner, Alexander Benlian, Benedikt Berger, Henner Gimpel, Thomas Hess, Matthias Söllner, AI-based digital assistants: Opportunities, threats, and research perspectives, Business & Information Systems Engineering 61 (2019) 535–544.
[13]
Joel Alves, Tania M. Lima, Pedro D. Gasper, The sociodemographic challenge in human-centred production systems-a systematic literature review, Theoretical Issues in Ergonomics Science (2022) 1–23.
[14]
Mamoona Humayun, Industrial Revolution 5.0 and the role of cutting edge technologies, International Journal of Advanced Computer Science and Applications 12 (12) (2021) 605–615.
[15]
Alexander Richter, Peter Heinrich, Alexander Stocker, Gerhard Schwabe, Digital work design The interplay of human and computer in future work practices as an interdisciplinary (grand) challenge, Business & Information Systems Engineering 60 (2018) 259–264.
[16]
Marie-Pierre Pacaux-Lemoine, Damien Trentesaux, Gabriel Z. Rey, Patrick Millot, Designing intelligent manufacturing systems through Human-Machine Cooperation principles: a human-centered approach, Computers & Industrial Engineering 111 (2017) 581–595.
[17]
Mark P. Taylor, Peter Boxall, John J.J. Chen, Xu Xun, Liew Angela, Adeniji Adebayo, Operator 4.0 or Maker 1.0? Exploring the implications of Industrie 4.0 for innovation, safety and quality of work in small economies and enterprises, Computers & industrial engineering 139 (2020).
[18]
Joze M. Rožanec, Inna Novalija, Patrik Zajec, Klemen Kenda, Hooman Tavakoli Ghinani, Sungho Suh, John Soldatos, Human-centric artificial intelligence architecture for industry 5.0 applications, International Journal of Production Research (2022) 1–26.
[19]
Peter Papcun, Erik Kajati, Jiri Koziorek, Human machine interface in concept of industry 4.0, in: World Symposium on Digital Intelligence for Systems and Machines, 2019.
[20]
Ricardo J. Rabelo, Saulo P. Zambiasi, David Romero, Softbots 4.0: Supporting Cyber-Physical Social Systems in Smart Production Management, International Journal of Industrial Engineering & Management 14 (1) (2023).
[21]
Bastian Pokorni, Jan Zwerina, Moritz Hämmerle, Human-centered design approach for manufacturing assistance systems based on design sprints, Procedia CIRP 91 (2020) 312–318.
[22]
Bzhwen A. Kadir, Ole Broberg, Human-centered design of work systems in the transition to industry 4.0, Applied ergonomics 92 (2021).
[23]
Christopher Stockinger, Lucas Polanski-Schräder, Ilka Subtil, The effect of information level of digital worker guidance systems on assembly performance, user experience and strain, Applied Ergonomics 106 (2023).
[24]
Jie-Ye. Mao, Karel Vredenburg, Paul W. Smith, Tom Carey, The state of user-centered design practice, Communications of the ACM 48 (3) (2005) 105–109.
[25]
Honorine Harlé, Sophie Hooge, Pascal Le Masson, Kevin Levillain, Benoit Weil, Guillaume Bulin, Thierry Ménard, Innovative design on the shop floor of the Saint-Nazaire Airbus factory., Research in Engineering Design 33 (1) (2022) 69–86.
[26]
Paul K. Wan, Torbjorn L. Leirmo, Human-centric zero-defect manufacturing: State-of-the-art review, perspectives, and challenges, Computers in Industry 144 (2023).
[27]
Ulrich Beez, Lukas Kaupp, Tilman Deuschel, Bernhard G. Humm, Fabienne Schumann, Jürgen Bock, Jens Hülsmann, Context-aware documentation in the smart factory, Semantic applications: Methodology, technology, corporate use, 2018, pp. 163–180.
[28]
Bas van Oudenhoven, Predictive maintenance for industry 5.0: behavioural inquiries from a work system perspective, International Journal of Production Research (2022) 1–20.
[29]
Jun Zhu, Sok K. Ong, Andrew Y.C. Nee, An authorable context-aware augmented reality system to assist the maintenance technicians, International Journal of Advanced Manufacturing Technology 66 (2013) 1699–1714.
[30]
Christina Schmidbauer, Setareh Zafari, Bernd Hader, Sebastian Schlund, An Empirical Study on Workers' Preferences in Human-Robot Task Assignment in Industrial Assembly System, IEEE Transactions on Human-Machine Systems 53 (2) (2023) 293–302.
[31]
Bin Han, Hans D. Schotten, Multi-Sensory HMI to Enable Digital Twins with Human-in-Loop: A 6G Vision of Future Industry, arXiv preprint (2021).
[32]
Ying Zhang, Adrian R.L. Travis, The Use of Multi-sensory Feedback to Improve the Usability of a Virtual Assembly Environment, Interactive Technologies and Sociotechnical Systems, VSMM 2006. Lecture Notes in Computer Science, Springer, Berlin, 2006.
[33]
Paulo G. De Barros, Robert W. Lindeman, Multi-sensory urban search-and-rescue robotics: improving the operator's omnidirectional perception, Frontiers in Robotics and AI (2014).
[34]
Mica R. Endsley, Measurement of situation awareness in dynamic systems, Human factors 37 (1) (1995) 65–84.
[35]
Fabio Sgarbossa, Eric H. Grosse, Patrick Neumann, Daria Battini, Christoph H. Glock, Human factors in production and logistics systems of the future, Annual Reviews in Control 49 (2020) 295–305.
[36]
Sarath Sreedharan, Siddharth Srivastava, Subbarao Kambhampati, Using state abstractions to compute personalized contrastive explanations for AI agent behavior, Artificial Intelligence 301 (2021).
[37]
Imran Ahmed, Gwanggil Jeon, Francesco Piccialli, From artificial intelligence to explainable artificial intelligence in industry 4.0: a survey on what, how, and where, IEEE Transactions on Industrial Informatics 18 (8) (2022) 5031–5042.
[38]
Vaibhav Kadam, Satish Kumar, Arunkumar Bongale, Seema Wazarkar, Pooja Kamat, Shruti Patil, Enhancing surface fault detection using machine learning for 3D printed products, Applied System Innovation 4 (2) (2021) 34.
[39]
Uros Urbas, Rok Vrabic, Nikola Vukašinović, Displaying product manufacturing information in augmented reality for inspection, Procedia CIRP 81 (2019) 832–837.
[40]
Liming Zhao, Fangfang Li, Yi Zhang, Xiaodong Xu, Hong Xiao, Yang Feng, A deep-learning-based 3D defect quantitative inspection system in CC products surface, Sensors 20 (4) (2020) 980.
[41]
Aamir Khan, Carmelo Mineo, Gordon Dobie, Charles Macleod, Gareth Pierce, Vision guided robotic inspection for parts in manufacturing and remanufacturing industry, Journal of Remanufacturing 11 (2021) 49–70.
[42]
Swarit A. Singh, Kaushal A. Desai, Automated surface defect detection framework using machine vision and convolutional neural networks, Journal of Intelligent Manufacturing 34 (4) (2023) 1995–2011.
[43]
Evan Pezent, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, Nick Colonnese, Tasbi: Multisensory squeeze and vibrotactile wrist haptics for augmented and virtual reality, in: IEEE World Haptics Conference (WHC), 2019.
[44]
Sang H. Yoon, Siyuan Ma, Woo S. Lee, Shantanu Thakurdesai, Di. Sun, Flavio P. Ribeiro, James D. Holbery, HapSense: A soft haptic I/O device with uninterrupted dual functionalities of force sensing and vibrotactile actuation, in: 32nd Annual ACM Symposium on User Interface Software and Technology, 2019.
[45]
Zhongda Sun, Minglu Zhu, Xuechuan Shan, Chengkuo Lee, Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions, Nature Communications 13 (1) (2022) 5224.
[46]
Sergio Di Martino, Vincenzo N. Vitale, An Haptic Interface for Industrial High-Precision Manufacturing Tasks, in: International Conference on Advanced Visual Interfaces, 2020.
[47]
Julia N. Czerniak, Christopher Brandl, Alexander Mertens, Designing human-machine interaction concepts for machine tool controls regarding ergonomic requirements, IFAC-PapersOnLine 50 (1) (2017) 1378–1383.
[48]
Ainhoa Apraiz, Ganix Lasa, Maitane Mazmela, Evaluation of User Experience in Human-Robot Interaction: A Systematic Literature Review, International Journal of Social Robotics (2023) 1–24.
[49]
Laura Cattaneo, Monica Rossi, Elisa Negri, Daryl Powell, Sergio Terzi, Lean thinking in the digital era, in: Product Lifecycle Management and the Industry of the Future: 14th IFIP WG 5.1 International Conference, PLM 2017, 2017.
[50]
Caroline Adam, Carmen Aringer Walch, Klaus Bengler, Digitalization in manufacturing - employees, do you want to work there?, Advances in Intelligent Systems and Computing, Springer, 2019, pp. 267–275.
[51]
Donghee Shin, Bu Zhong, Frank A. Biocca, Beyond user experience: What constitutes algorithmic experiences?, International Journal of Information Management 52 (2020).
[52]
Christian Jandl, Setareh Zafari, Florian Taurer, Martina Hartner-Tiefenthaler, Sebastian Schlund, Location-based monitoring in production environments: does transparency help to increase the acceptance of monitoring?, Production & Manufacturing Research 11 (1) (2023).
[53]
Yuqian Lu, Hao Zheng, Saahil Chand, Wanging Xia, Zengkun Liu, Xun Xu, Jinsong Bao, Outlook on human-centric manufacturing towards Industry 5.0, Journal of Manufacturing Systems 62 (2022) 612–627.
[54]
Damien Trentesaux, Patrick Millot, A human-centred design to break the myth of the “magic human” in intelligent manufacturing systems, Service orientation in holonic and multi-agent manufacturing (2016) 103–113.
Recommendations
Human Digital Twin in the context of Industry 5.0
Highlights- Carrying out a comprehensive survey on Human Digital Twin in the context of Industry 5.0.
AbstractHuman-centricity, a core value of Industry 5.0, places humans in the center of production. It leads to the prioritization of human needs, spanning from health and safety to self-actualization and personal growth. The concept of the ...
Designing intelligent manufacturing systems through Human-Machine Cooperation principles
Models to design and evaluate the performance of Human-Machine Systems are presented.A human-centered approach is proposed to design human-aware Intelligent Manufacturing Systems.The first results of the experiments relating to the usefulness of a human-...
Developing a Research Agenda for Human-Centered Data Science
CSCW '16 Companion: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing CompanionThe study and analysis of large and complex data sets offer a wealth of insights in a variety of applications. Computational approaches provide researchers access to broad assemblages of data, but the insights extracted may lack the rich detail that ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024.
Publisher
Elsevier Science Publishers B. V.
Netherlands
Publication History
Published: 01 January 2024
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 29 Jan 2025