research-article

Usability of the PAL Objectives Dashboard for Children's Diabetes Self-Management Education

Authors:

Elettra Oleari,

Francesco Sardu,

Mark A. NeerincxAuthors Info & Claims

ICSLT '19: Proceedings of the 5th International Conference on e-Society, e-Learning and e-Technologies

Pages 22 - 28

https://doi.org/10.1145/3312714.3312736

Published: 10 January 2019 Publication History

Abstract

Children will only benefit from educational technologies and e-coaches when they understand the long-term consequences and are (intrinsically) motivated to use these support systems. This paper presents an Objective Dashboard that integrates educational achievements, goals and tasks with gamification features (such as challenges, scores and rewards) to advance the interests and engagements of children with type 1 diabetes when using the Personal Assistant for a healthy Lifestyle (PAL) system. By linking in-app activities (e.g., play a quiz or keep a diary) to relevant educational achievements, and to skills and knowledge required in daily life, we aim to increase intrinsic motivation and thereby usage. We designed a dashboard displaying personalised achievements, learning goals and tasks in the domain of diabetes self-management education. We used common user interface design patterns such as layering, colouring, and iconic presentation to organise complex information and reinforce the relations between concepts. Subsequently, we conducted a usability evaluation with twelve children, on the basis of which we refined our design. We found that, colouring and layering were to some extent effective, however, iconic representations were insufficient. Therefore, we recommend to provide short, descriptive labels at any time.

References

[1]

D. H. Schunk and B. J. Zimmerman. Motivation and Self-Regulated Learning: Theory, Research, and Applications. Routledge, 2008.

[2]

Aidan Jones, Kuster Dennis, Christina Anne Basedow, PatrAscia Alves-oliveira, Sofia Serholt, Helen Hastie, Lee J. Corrigan, Wolmet Barendregt, Arvid Kappas, Ana Paiva, and Ginevra Castellano. Empathic Robotic Tutors for Personalised Learning: A Multidisciplinary Approach. In Soc. Robot., volume 1-9388, pages 285--295, Paris, 2015. Springer.

[3]

Daniel Leyzberg, Samuel Spaulding, and Brian Scassellati. Personalizing robot tutors to individuals' learning differences. Proc. 2014 ACM/IEEE Int. Conf. Human-robot Interact. - HRI '14, (August):423--430, 2014.

Digital Library

[4]

Olivier A. Blanson Henkemans, Bert P.B. Bierman, Joris Janssen, Mark A. Neerincx, Rosemarijn Looije, Hanneke van der Bosch, and Jeanine A.M. van der Giessen. Using a robot to personalise health education for children with diabetes type 1: A pilot study. Patient Education and Counseling, 92(2):174--181, 2013.

[5]

B.R. Schadenberg, M.A. Neerincx, F. Cnossen, and R. Looije. Personalising game difficulty to keep children motivated to play with a social robot: A Bayesian approach. Cognitive Systems Research, 43:222--231, 2017.

Digital Library

[6]

Iolanda Leite, Carlos Martinho, and Ana Paiva. Social robots for long-term interaction: a survey. International Journal of Social Robotics, 5(2):291--308, 2013.

[7]

James Kariuki Njenga and Louis Cyril Henry Fourie. The myths about e-learning in higher education. British journal of educational technology, 41(2):199--212, 2010.

[8]

Luis De-Marcos, Adrian Dominguez, Joseba Saenz-de Navarrete, and Carmen Pagés. An empirical study comparing gamification and social networking on e-learning. Computers & Education, 75:82{91, 2014.

[9]

Edwin A Locke and Gary P Latham. Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. Am. Psychol., 57(9):705--717, 2002.

[10]

Carole Ames. Classrooms: Goals, structures, and student motivation., 1992.

[11]

Paul Black and Dylan Wiliam. Assessment and Classroom Learning Assessment and Classroom Learning, volume 5. 2006.

[12]

Miriam Cabrita, Harm op den Akker, Reinoud Achterkamp, Hermie J Hermens, and Miriam MR Vollenbroek-Hutten. Automated personalized goal-setting in an activity coaching application. In SENSORNETS, pages 389--396, 2014.

[13]

Kris MY Law, Victor CS Lee, and Yuen-Tak Yu. Learning motivation in e-learning facilitated computer programming courses. Computers & Education, 55(1):218--228, 2010.

Digital Library

[14]

S. Rollnick, W. R. Miller, and C. C. Butler. Motivational Interviewing in Health Care: Helping Patients Change Behavior. The Guilford Press, New York, 2008.

[15]

Edward L. Deci, Robert J. Vallerand, Luc G. Pelletier, and Richard M. Ryan. Motivation and education: The self-determination perspective. Educational Psychologist, 26(3-4):325--346, 1991.

[16]

Richard M. Ryan and Edward L. Deci. Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25(1):54--67, 2000.

[17]

Sebastian Deterding, Dan Dixon, Rilla Khaled, and Lennart Nacke. From game design elements to gamefulness: defining gamification. In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments, pages 9--15. ACM, 2011.

Digital Library

[18]

Juho Hamari, Jonna Koivisto, and Harri Sarsa. Does gamification work? A literature review of empirical studies on gamification. In 2014 47th Hawaii international conference on system sciences (HICSS), pages 3025{3034. IEEE, 2014.

Digital Library

[19]

Jonna Koivisto and Juho Hamari. Demographic differences in perceived benefits from gamification. Computers in Human Behavior, 35:179--188, 2014.

[20]

Richard M Ryan and Edward L Deci. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American psychologist, 55(1):68, 2000.

[21]

Judith F Bryan and Edwin A Locke. Goal setting as a means of increasing motivation. Journal of applied psychology, 51(3):274, 1967.

[22]

Minjung Koo and Ayelet Fishbach. Dynamics of self-regulation: How (un) accomplished goal actions affect motivation. Journal of personality and social psychology, 94(2):183, 2008.

[23]

R. Kleinrahm, F. Keller, K. Lutz, M. Kolch, and J. Fegert. Assessing change in the behavior of children and adolescents in youth welfare institutions using goal attainment scaling. Child and Adolescent Psychiatry and Mental Health, 7(33), 2013.

[24]

Edwin A Locke and Gary P Latham. New directions in goal-setting theory. Current directions in psychological science, 15(5):265--268, 2006.

[25]

L. S. Vygotsky. Mind in society: The development of higher psychological processes. Harvard university press, 1980.

[26]

Hans-Ulrich Krieger, Rifca Peters, Bernd Kiefer, Michael A. Van Bekkum, Frank Kaptein, and Mark A. Neerincx. The Federated Ontology of the PAL Project Interfacing Ontologies and Integrating Time-Dependent Data. In 8th Int. Jt. Conf. Knowl. Eng. Ontol. Dev. SciTePress, 2016.

[27]

Rifca Peters, Joost Broekens, and Mark A. Neerincx. Guidelines for tree-based learning goal structuring. In Proceedings of the 22Nd International Conference on Intelligent User Interfaces, IUI '17, pages 401--405, New York, NY, USA, 2017. ACM.

Digital Library

[28]

Martijn Van Welie, Gerrit C Van der Veer, and Anton Eliens. An ontology for task world models. In Design, Specification and Verification of Interactive Systems', 98, pages 57--70. Springer, 1998.

[29]

Mark A Neerincx, Frank Kaptein, Michael A Van Bekkum, Hans-Ulrich Krieger, Bernd Kiefer, Rifca Peters, Joost Broekens, Yiannis Demiris, and Maya Sapelli. Ontologies for social, cognitive and affective agent-based support of child's diabetes self-management, 2016.

[30]

Jenny Preece, Yvonne Rogers, and Helen Sharp. Interaction design: beyond human-computer interaction. John Wiley & Sons, 2015.

Digital Library

[31]

William Lidwell, Kritina Holden, and Jill Butler. Universal principles of design, revised and updated: 125 ways to enhance usability, influence perception, increase appeal, make better design decisions, and teach through design. Rockport, 2010.

[32]

Jacob Nielsen. Nielsen Norman group - children's websites: Usability issues in designing for young people, September 2010.

[33]

Jakob Nielsen. Usability Engineering. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1993.

[34]

Jacob Nielsen. Nielsen Norman group - introduction to usability, January 2012.

[35]

Mads Soegaard. Usability: A part of the user experience, January 2018.

[36]

Shuli Gilutz and J Nielsen. Usability of websites for children: 70 design guidelines. 01-2002.

[37]

Mohammadi Akheela Khanum and Munesh Chandra Trivedi. Take care: A study on usability evaluation methods for children. CoRR, abs/1212.0647, 2012.

[38]

Rabail Tahir and Fahim Arif. Framework for evaluation the usability of mobile educational applications for children. Society of Digital Information and Wireless Communications, pages 156--70, 2014.

[39]

Azham Hussain and Elaine Ferneley. Usability metric for mobile application: A goal question metric (gqm) approach. In Proceedings of the 10th International Conference on Information Integration and Web-based Applications & Services, iiWAS '08, pages 567--570, New York, NY, USA, 2008. ACM.

Digital Library

[40]

van Solingen Rini, Basili Vic, Caldiera Gianluigi, and Rombach H. Dieter. Goal Question Metric (GQM) Approach. American Cancer Society, 2002.

[41]

Nigel Bevan. Practical issues in usability measurement interactions, 13(6):42{43, November 2006.

Digital Library

[42]

Jacob Nielsen. Nielsen Norman group - 10 usability heuristics for user interface design, January 1995

Cited By

Rijgersberg-Peters Rvan Vught WBroekens JNeerincx M(2024)Goal Ontology for Personalized Learning and Its Implementation in Child's Health Self-Management SupportIEEE Transactions on Learning Technologies10.1109/TLT.2023.332689217(903-918)Online publication date: 2024
https://doi.org/10.1109/TLT.2023.3326892
Saad MZia ARaza MKundi MHaleem M(2022)A Comprehensive Analysis of Healthcare Websites Usability Features, Testing Techniques and IssuesIEEE Access10.1109/ACCESS.2022.319337810(97701-97718)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3193378
Aguilar CHuidobro C(2022)Gamification and Usability in Educational Contexts: A Systematic ReviewTelematics and Computing10.1007/978-3-031-18082-8_24(374-384)Online publication date: 30-Oct-2022
https://doi.org/10.1007/978-3-031-18082-8_24
Show More Cited By

Index Terms

Usability of the PAL Objectives Dashboard for Children's Diabetes Self-Management Education
1. Applied computing
  1. Education
    1. E-learning
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. HCI design and evaluation methods
      1. Usability testing
  2. Visualization
    1. Visualization design and evaluation methods

Recommendations

Guidelines for Tree-based Collaborative Goal Setting
IUI '17: Proceedings of the 22nd International Conference on Intelligent User Interfaces

Educational technology needs a model of learning goals to support motivation, learning gain, tailoring of the learning process, and sharing of the personal goals between different types of users (i.e., learner and educator) and the system. This paper ...
Integrating gamification and instructional design to enhance usability of online learning
Abstract
The current study investigates the interaction of Gamification, and Instructional Design to enhance the Usability of e-Learning in higher education programs. The study also examines the mediating role of Instructional design. Data were collected ...
Improving Learning Outcomes for Higher Education Through Smart Technology

The ever-decreasing time between the doubling of knowledge creates a problem for education concerning how to handle information overload. To address this issue, educators must learn to make learning more effective and more efficient. Currently, there is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICSLT '19: Proceedings of the 5th International Conference on e-Society, e-Learning and e-Technologies

January 2019

132 pages

ISBN:9781450362351

DOI:10.1145/3312714

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 January 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Horizon 2020

Conference

ICSLT 2019

ICSLT 2019: 2019 the 5th International Conference on e-Society, e-Learning and e-Technologies

January 10 - 12, 2019

Vienna, Austria

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
237
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)3

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rijgersberg-Peters Rvan Vught WBroekens JNeerincx M(2024)Goal Ontology for Personalized Learning and Its Implementation in Child's Health Self-Management SupportIEEE Transactions on Learning Technologies10.1109/TLT.2023.332689217(903-918)Online publication date: 2024
https://doi.org/10.1109/TLT.2023.3326892
Saad MZia ARaza MKundi MHaleem M(2022)A Comprehensive Analysis of Healthcare Websites Usability Features, Testing Techniques and IssuesIEEE Access10.1109/ACCESS.2022.319337810(97701-97718)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3193378
Aguilar CHuidobro C(2022)Gamification and Usability in Educational Contexts: A Systematic ReviewTelematics and Computing10.1007/978-3-031-18082-8_24(374-384)Online publication date: 30-Oct-2022
https://doi.org/10.1007/978-3-031-18082-8_24
Dixon EPiper ALazar AKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)“Taking care of myself as long as I can”: How People with Dementia Configure Self-Management SystemsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445225(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445225

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents