Teaching Assembly Tasks to Robots Using a 3D Simulation Environment
Article No.: 18, Pages 1 - 8
Abstract
Today, many factories use robots for intensive and repetitive work. Programming these robots is typically costly and time-consuming, and requires specialized expertise, hardware or non-expert employees interacting with expensive robots. In this paper, a new approach for teaching assembly tasks to robots is proposed. The user demonstrates the assembly task using a web browser in 3D and then simulates the robotic execution to promptly assess the outcome of the teaching process. A within-subjects user testing study compared the proposed simulation-based approach against a state-of-the-art computer vision-based approach. Participants were asked to teach a real-world LCD TV assembly task to a robot using both approaches. Results showed that users of the proposed simulation-based system had significantly lower time on task values and were significantly more likely to prefer it compared to the computer vision-based system. No significant difference was observed in task success rates and SUS scores.
References
[1]
J. Aleotti, S. Caselli, and M. Reggiani. 2003. Toward programming of assembly tasks by demonstration in virtual environments. In The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003., 309–314.
[2]
Brenna D. Argall, Sonia Chernova, Manuela Veloso, and Brett Browning. 2009. A survey of robot learning from demonstration. Robotics and Autonomous Systems 57 (5), 469–483.
[3]
Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS Scores mean: adding an adjective rating scale. J. Usability Stud. 4 (3), 114–123.
[4]
John Brooke. 1996. SUS: a “quick and dirty” usability scale. In Usability Evaluation in Industry, P. W. Jordan, B Thomas, B. A. Weerdmeester and A. L. McClelland (eds.). Taylor and Francis, London.
[5]
S. Calinon, F. Guenter, and A. Billard. 2006. On learning the statistical representation of a task and generalizing it to various contexts. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006., 2978–2983.
[6]
Sylvain Calinon and Aude G. Billard. 2007. What is the teacher's role in robot programming by demonstration?: Toward benchmarks for improved learning. Interaction Studies 8 (3), 441–464.
[7]
Sonia Chernova and Andrea L. Thomaz. 2014. Robot learning from human teachers. Springer International Publishing, Cham.
[8]
Felipe Codevilla, Matthias Miiller, Antonio López, Vladlen Koltun, and Alexey Dosovitskiy. 2018. End-to-end driving via conditional imitation learning. In 2018 IEEE International Conference on Robotics and Automation (ICRA), IEEE Press, Brisbane, Australia, 4693–4700.
[9]
Jacob Cohen. 1992. A power primer. Psychological Bulletin 112 (1), 155–159.
[10]
Rüdiger Dillmann. 2004. Teaching and learning of robot tasks via observation of human performance. Robotics and Autonomous Systems 47 (2), 109–116.
[11]
Fotios Dimeas, Filippos Fotiadis, Dimitrios Papageorgiou, Antonis Sidiropoulos, and Zoe Doulgeri. 2019. Towards progressive automation of repetitive tasks through physical human-robot interaction. In Human Friendly Robotics (Springer Proceedings in Advanced Robotics), Springer International Publishing, Cham, 151–163.
[12]
Andy P Field. 2013. Discovering statistics using IBM SPSS statistics (4th ed.). SAGE, London.
[13]
Xiao Gao, João Silvério, Sylvain Calinon, Miao Li, and Xiaohui Xiao. 2022. Bilateral teleoperation with object-adaptive mapping. Complex & Intelligent Systems 8 (4), 2983–2990.
[14]
Cheng Guo and Ehud Sharlin. 2008. Exploring the use of tangible user interfaces for human-robot interaction: a comparative study. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’08), ACM, New York, NY, USA, 121–130.
[15]
Mathias Haage, Grigoris Piperagkas, Christos Papadopoulos, Ioannis Mariolis, Jacek Malec, Yasemin Bekiroglu, Mikael Hedelind, and Dimitrios Tzovaras. 2017. Teaching assembly by demonstration using advanced human robot interaction and a knowledge integration framework. Procedia Manufacturing 11, 164–173.
[16]
S. J. Hu, J. Ko, L. Weyand, H. A. ElMaraghy, T. K. Lien, Y. Koren, H. Bley, G. Chryssolouris, N. Nasr, and M. Shpitalni. 2011. Assembly system design and operations for product variety. CIRP Annals 60 (2), 715–733.
[17]
Jacques Kaiser, Svenja Melbaum, J. Camilo Vasquez Tieck, Arne Roennau, Martin V. Butz, and Rudiger Dillmann. 2018. Learning to reproduce visually similar movements by minimizing event-based prediction error. In 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob), 260–267.
[18]
Christos Katsanos, Nikolaos Tselios, and Michalis Xenos. 2012. Perceived usability evaluation of learning management systems: a first step towards standardization of the System Usability Scale in Greek. In Proceedings of the16th Panhellenic Conference on Informatics (PCI 2012), 302–307.
[19]
Seungsu Kim, ChangHwan Kim, Bumjae You, and Sangrok Oh. 2009. Stable whole-body motion generation for humanoid robots to imitate human motions. In 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2518–2524.
[20]
J. Krüger, T. K. Lien, and A. Verl. 2009. Cooperation of human and machines in assembly lines. CIRP Annals 58 (2), 628–646.
[21]
Alexandros Liapis, Evanthia Faliagka, Christos Katsanos, Christos Antonopoulos, and Nikolaos Voros. 2021. Detection of subtle stress episodes during UX evaluation: Assessing the performance of the WESAD bio-signals dataset. In Human-Computer Interaction – INTERACT 2021 (Lecture Notes in Computer Science), Springer International Publishing, Cham, 238–247.
[22]
Alexandros Liapis, Nikos Karousos, Christos Katsanos, and Michalis Xenos. 2014. Evaluating user's emotional experience in HCI: the PhysiOBS approach. In Human-Computer Interaction. Advanced Interaction Modalities and Techniques (Lecture Notes in Computer Science), Springer Verlag, 758–767.
[23]
Alexandros Liapis, Christos Katsanos, Nikos Karousos, Michalis Xenos, and Theofanis Orphanoudakis. 2021. User experience evaluation: A validation study of a tool-based approach for automatic stress detection using physiological signals. International Journal of Human–Computer Interaction 37 (5), 470–483.
[24]
Alexandros Liapis, Christos Katsanos, Dimitris Sotiropoulos, Michalis Xenos, and Nikos Karousos. 2015. Recognizing emotions in human computer interaction: Studying stress using skin conductance. In Human-Computer Interaction – INTERACT 2015 (Lecture Notes in Computer Science), Springer Berlin Heidelberg, 255–262.
[25]
Konstantina Orfanou, Nikolaos Tselios, and Christos Katsanos. 2015. Perceived usability evaluation of learning management systems: Empirical evaluation of the System Usability Scale. The International Review of Research in Open and Distributed Learning 16 (2), 227–246.
[26]
Sarah Osentoski, Graylin Jay, Christopher Crick, Benjamin Pitzer, Charles DuHadway, and Odest Chadwicke Jenkins. 2011. Robots as web services: Reproducible experimentation and application development using rosjs. In 2011 IEEE International Conference on Robotics and Automation, 6078–6083.
[27]
Mikhail Ostanin, Stanislav Mikhel, Alexey Evlampiev, Valeria Skvortsova, and Alexandr Klimchik. 2020. Human-robot interaction for robotic manipulator programming in Mixed Reality. In 2020 IEEE International Conference on Robotics and Automation (ICRA), 2805–2811.
[28]
Zengxi Pan, Joseph Polden, Nathan Larkin, Stephen Van Duin, and John Norrish. 2012. Recent progress on programming methods for industrial robots. Robotics and Computer-Integrated Manufacturing 28 (2), 87–94.
[29]
Luka Peternel and Jan Babič. 2013. Humanoid robot posture-control learning in real-time based on human sensorimotor learning ability. In 2013 IEEE International Conference on Robotics and Automation, 5329–5334.
[30]
Harish Ravichandar, Athanasios S. Polydoros, Sonia Chernova, and Aude Billard. 2020. Recent advances in robot learning from demonstration. Annual Review of Control, Robotics, and Autonomous Systems 3 (1), 297–330.
[31]
Joe Saunders, Chrystopher L. Nehaniv, and Kerstin Dautenhahn. 2006. Teaching robots by moulding behavior and scaffolding the environment. In Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction (HRI ’06), ACM, New York, NY, USA, 118–125.
[32]
Eric L. Sauser, Brenna D. Argall, Giorgio Metta, and Aude G. Billard. 2012. Iterative learning of grasp adaptation through human corrections. Robotics and Autonomous Systems 60 (1), 55–71.
[33]
Alexander Skoglund, Boyko Iliev, and Rainer Palm. 2010. Programming-by-Demonstration of reaching motions—A next-state-planner approach. Robotics and Autonomous Systems 58 (5), 607–621.
[34]
David Vogt, Simon Stepputtis, Steve Grehl, Bernhard Jung, and Heni Ben Amor. 2017. A system for learning continuous human-robot interactions from human-human demonstrations. In 2017 IEEE International Conference on Robotics and Automation (ICRA), 2882–2889.
[35]
Gu Ye and Ron Alterovitz. 2017. Demonstration-guided motion planning. In Robotics Research: The 15th International Symposium ISRR, Springer, 291–307.
Index Terms
- Teaching Assembly Tasks to Robots Using a 3D Simulation Environment
Recommendations
Design and Simulation of Autonomous Mobile Robots Obstacle Avoidance System
LNCS on Transactions on Edutainment XIII - Volume 10092Autonomous mobile robot is a completely unknown or partially unknown, of its complex environment, which requires the ability to avoid obstacles in order to move safely and avoid the collisions while navigating. To solve this problem, it opted to propose ...
Simplified Robot Programming Framework for a Gearbox Assembly Application
Social RoboticsAbstractIn this paper, we are presenting a framework for multi-modal human-robot interaction (HRI), where complex robotic tasks can be programmed using a skill-based approach and intuitive HRI modalities. This approach is demonstrated using a gearbox ...
Engaging robots: easing complex human-robot teamwork using backchanneling
CSCW '13: Proceedings of the 2013 conference on Computer supported cooperative workPeople are increasingly working with robots in teams and recent research has focused on how human-robot teams function, but little attention has yet been paid to the role of social signaling behavior in human-robot teams. In a controlled experiment, we ...
Comments
Information & Contributors
Information
Published In
September 2023
218 pages
ISBN:9798400708886
DOI:10.1145/3609987
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 September 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
CHIGREECE 2023
CHIGREECE 2023: 2nd International Conference of the ACM Greek SIGCHI Chapter
September 27 - 28, 2023
Athens, Greece
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 228Total Downloads
- Downloads (Last 12 months)187
- Downloads (Last 6 weeks)35
Reflects downloads up to 11 Jan 2025
Other Metrics
Citations
Cited By
View allView Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in