research-article

Learning waste Recycling by playing with a Social Robot

Authors:

Giovanna Castellano,

Berardina De Carolis,

Nicola Macchiarulo,

Veronica RossanoAuthors Info & Claims

2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)

Pages 3805 - 3810

https://doi.org/10.1109/SMC.2019.8914455

Published: 01 October 2019 Publication History

Abstract

In this paper we investigate the use of a social robot as an interface to a serious game aiming to train kids in how to recycle materials correctly. Serious games are mostly used to induce motivations and engagement in users and support knowledge transfer during playing. They are especially effective when the goal of the game concerns behavior change. In addition, social robots have been used effectively in educational settings to engage children in the learning process. Following this trend, we designed a serious game in which the social robot Pepper plays with a child to teach him to correctly recycle the materials. To endow the robot with the capability of detecting and classifying the waste material we developed an image recognition module based on a Convolutional Neural Network. Preliminary experimental results show that the implementation of a serious game about recycling into the Pepper robot improves its social behavior. The use of real objects as waste items during the game turns out to be a successful approach not only for perceived learning effectiveness but also for engagement of the children.

References

[1]

M. Papastergiou, Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation, Comput. Educ., vol. 52, no. 1, pp. 1–12, 2009.

Digital Library

[2]

R. Garris, R. Ahlers, R., J.E., Driskell: Games, Motivation and Learning: A Research and Practice Model, Sage publication, 33(4), 441–466 (2002).

[3]

Ranchhod, A., Gurău, C., Loukis, E., & Trivedi, R. (2014). Evaluating the educational effectiveness of simulation games: A value generation model. Information Sciences, 264, 75–90.

Digital Library

[4]

Katsaliaki, K., & Mustafee, N. (2012, December). A survey of serious games on sustainable development. in Proceedings of the Winter Simulation Conference (p. 136). Winter Simulation Conference.

[5]

Lessel, P., Altmeyer, M., & Krüger, A. (2015, April). Analysis of recycling capabilities of individuals and crowds to encourage and educate people to separate their garbage playfully. in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 1095–1104). ACM.

[6]

V. Rossano, T. Roselli, G. Calvano, “A Serious Game to Promote Environmental Attitude”. in International Conference on Smart Education and Smart E-Learning, Springer, Cham., pp. 48–55, 2017.

[7]

V. Rossano, T. Roselli, G. Calvano, “Multimedia technologies to foster ecological skills”. in International Conference on Advanced Learning Technologies - ICALT2017.- IEEE Computer Science, pp. 128–130, 2017.

[8]

Stanitsas, M., Kirytopoulos, K. & Vareilles, E. 2019, “Facilitating sustainability transition through serious games: A systematic literature review”, Journal of Cleaner Production, 208(20 January 2019), 924–936.

[9]

Crookall, D. (2013). Climate change and simulation/gaming: Learning for survival. September 2013 Simulation & Gaming 44(2-3):195–228.

[10]

D.G. Oblinger, “The next generation of educational engagement”, J. Interact. Media Educ., no. 8, pp. 1–18, 2004.

[11]

T. Malone, M.R. Lepper, “Making learning fun: a taxonomy of intrinsic motivations for learning”, in Snow R., Farr M.J. (eds.), Aptitude, Learning, and Instruction. Conative and Affective Process Analyses, vol. 3, Hillsdale, NJ, 1987.

[12]

J. Piaget and B. Inhelder, The psychology of the child, vol. 5001 (Basic Books (AZ), 1969).

[13]

Harel, I. E., & Papert, S. E. (1991). Constructionism. Ablex Publishing.

[14]

Marshall, C. (2017). Montessori education: a review of the evidence base. npj Science of Learning, 2(1), 11.

[15]

D. R. Michael, S. L. Chen, Serious Games: Games That Educate, Train, and Inform (1er ed.). Muska & Lipman/Premier-Trade, 2005.

[16]

Ali, M., Shatabda, S., & Ahmed, M. (2017, December). Impact of learning analytics on product marketing with serious games in Bangladesh. in 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC) (pp. 576–579). IEEE.

[17]

Di Bitonto, P., Roselli, T., Rossano, V., Frezza, E., & Piccinno, E. (2012, August). An educational game to learn type 1 diabetes management. in DMS (pp. 139–143).

[18]

Ee, R. W. X., Yap, K. Z., & Yap, K. Y. L. (2018). Herbopolis–A mobile serious game to educate players on herbal medicines. Complementary therapies in medicine, 39, 68–79.

[19]

Bonnechère, B. (2017). Serious games in physical rehabilitation: From theory to practice. Springer.

[20]

M. Alqaderi, Ahmad B. Rad. (2018) A Multi-Modal Person Recognition System for Social Robots. Applied Sciences 8(3):387.

[21]

D. R. Faria, M. Vieira, F. C. Faria, C. Premebida, “Affective facial expressions recognition for human-robot interaction”, RO-MAN’17: IEEE International Symposium on Robot and Human Interactive Communication, 2017.

[22]

Broekens, J.; Heerink, M.; Rosendal, H. Assistive social robots in elderly care: review. Gerontechnology 2009, 8, 94–103.

[23]

G. Palestra, B. De Carolis, F. Esposito. 2017. Proceedings of the Workshop on Artificial Intelligence with Application in Health co-located with the 16th International Conference of the Italian Association for Artificial Intelligence (AI*IA 2017), Bari, Italy, November 14, 2017.

[24]

Mubin, O.; Stevens, C.J.; Shahid, S.; Al Mahmud, A.; Dong, J.J. A review of the applicability of robots in education. J. Technol. Educ. Learn. 2013, 1. 209–0015.

[25]

Saerbeck, M.; Schut, T.; Bartneck, C.; Janse, M.D. Expressive robots in education: Varying the degree of social supportive behavior of a robotic tutor. in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM 2010), Atlanta, GA, USA, 10–15 April 2010; pp. 1613–1622.

[26]

Leite, I.; Martinho, C.; Paiva, A. Social robots for long-term interaction: A survey. Int. J. Soc. Robot. 2013, 5, 291–308.

[27]

M. I. Ahmad, O. Mubin, J. Orlando, A Systematic Review of Adaptivity in Human-Robot Interaction, Multimodal Technologies and Interaction, 2017, 3(14), 1–25.

[28]

B. De Carolis, N. Macchiarulo, G. Palestra. Soft Biometrics for Social Adaptive Robots. in Proceedings of IEA/AIE 2019. Granz (in press).

[29]

T. Schodde, Kirsten Bergmann, S. Kopp. 2017. Adaptive Robot Language Tutoring Based on Bayesian Knowledge Tracing and Predictive Decision-Making. in Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI ’17). ACM, New York, NY, USA, 128–136.

[30]

J. Kennedy, P. Baxter, E. Senft, and T. Belpaeme. Higher nonverbal immediacy leads to greater learning gains in child-robot tutoring interactions. in International Conference on Social Robotics, pages 327–336. Springer, 2015.

[31]

Ramachandran, A., Huang, C. M., Gartland, E., & Scassellati, B. (2018, February). Thinking Aloud with a Tutoring Robot to Enhance Learning. in Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (pp. 59–68). ACM.

[32]

Pennazio, V. (2017). Social robotics to help children with autism in their interactions through imitation. Research on Education and Media, 9(1), 10–16.

[33]

Hocine N, Gouaich A (2013) Difficulty and scenario adaptation: an approach to customize therapeutic games. In: Serious games for healthcare: applications and implications, 1st edn. IGI Global, Hershey, PA, p 30.

[34]

Wainer J, Dautenhahn K, Robins B, Amirabdollahian F (2013) A pilot study with a novel setup for collaborative play of the humanoid robot KASPAR with children with autism. Int J Soc Robot 6(1):45–65.

[35]

Sanghvi J, Castellano G, Leite I, Pereira A, McOwan PW, Paiva A (2011) Automatic analysis of affective postures and body motion to detect engagement with a game companion. In: Proc. of the 6th Int. conference on human–robot interaction—HRI ’11, pp 305.

[36]

Y. Jiang, M. Lim, C. Zheng, and A. Saxena, “Learning to place new objects in a scene,” The International Journal of Robotics Research, vol. 31, no. 9, pp. 1021–1043, 2012.

Digital Library

[37]

S. Miller, J. Van Den Berg, M. Fritz, T. Darrell, K. Goldberg, and P. Abbeel, “A geometric approach to robotic laundry folding,” The International Journal of Robotics Research, vol. 31, no. 2, pp. 249–267, 2012.

Digital Library

[38]

Y. Li, X. Hu, D. Xu, Y. Yue, E. Grinspun, and P. Allen, “Multi-sensor.

[39]

surface analysis for robotic ironing,” arXiv preprint arXiv:1602.04918, 2016.

[40]

Y. LeCun, Y. Bengio et al., “Convolutional networks for images, speech, and time series,” The handbook of brain theory and neural networks, vol. 3361, no. 10, p. 1995, 1995.

Digital Library

[41]

A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in neural information processing systems, 2012, pp. 1097–1105.

Digital Library

[42]

J. Long, E. Shelhamer, and T. Darrell, “Fully convolutional networks for semantic segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3431–3440.

Digital Library

[43]

J. C. Burguillo, “Using game theory and competition-based learning to stimulate student motivation and performance.” Computers & education, 55(2), 2010, pp. 566–575.

Digital Library

[44]

K. Simonyan, A. Zisserman, “Very Deep Convolutional Networks for Large-Scale Image Recognition”, International Conference on Learning Representations, 2015.

[45]

J. Deng, W. Dong, R. Socher, L. J. Li, K. Li, L. Fei-Fei, “Imagenet: A large-scale hierarchical image database”, Computer Vision and Pattern Recognition 2009. CVPR 2009. IEEE Conference on, pp. 248–255, June 2009.

[46]

Diederik P. Kingma and Jimmy Lei Ba. Adam: a Method for Stochastic Optimization. International Conference on Learning Representations, pages 1–13, 2015.

[47]

J. Schmidhuber, “Deep learning in neural networks: An overview”, Neural Networks, vol. 61, pp. 85–117, 2015.

Digital Library

Cited By

Yu XHoggenmüller MTomitsch M(2024)Encouraging Bystander Assistance for Urban Robots: Introducing Playful Robot Help-Seeking as a StrategyProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661505(2514-2529)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661505
Albar RGauthier AVasalou A(2024)A Playful Path to Sustainability: Synthesizing design strategies for children's environmental sustainability learning through gameful interventionsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655797(201-217)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655797
Oralbayeva NAmirova ATelisheva ZZhanatkyzy AAimysheva ASandygulova ACastellano GRiek LCakmak MLeite I(2023)Montessori-based Design of Long-term Child-Robot Interaction for Alphabet LearningCompanion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3580175(691-695)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3580175
Show More Cited By

Index Terms

Learning waste Recycling by playing with a Social Robot

Index terms have been assigned to the content through auto-classification.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)

October 2019

4424 pages

Copyright © 2019.

Publisher

IEEE Press

Publication History

Published: 01 October 2019

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yu XHoggenmüller MTomitsch M(2024)Encouraging Bystander Assistance for Urban Robots: Introducing Playful Robot Help-Seeking as a StrategyProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661505(2514-2529)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661505
Albar RGauthier AVasalou A(2024)A Playful Path to Sustainability: Synthesizing design strategies for children's environmental sustainability learning through gameful interventionsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655797(201-217)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655797
Oralbayeva NAmirova ATelisheva ZZhanatkyzy AAimysheva ASandygulova ACastellano GRiek LCakmak MLeite I(2023)Montessori-based Design of Long-term Child-Robot Interaction for Alphabet LearningCompanion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3580175(691-695)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3580175
Seaborn KFrank A(2022)What Pronouns for Pepper? A Critical Review of Gender/ing in ResearchProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501996(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501996

View Options

View options

Media

Figures

Other

Tables

View Table of Contents