-
Interactive environments for training children's curiosity through the practice of metacognitive skills: a pilot study
Authors:
Rania Abdelghani,
Edith Law,
Chloé Desvaux,
Pierre-Yves Oudeyer,
Hélène Sauzéon
Abstract:
Curiosity-driven learning has shown significant positive effects on students' learning experiences and outcomes. But despite this importance, reports show that children lack this skill, especially in formal educational settings. To address this challenge, we propose an 8-session workshop that aims to enhance children's curiosity through training a set of specific metacognitive skills we hypothesiz…
▽ More
Curiosity-driven learning has shown significant positive effects on students' learning experiences and outcomes. But despite this importance, reports show that children lack this skill, especially in formal educational settings. To address this challenge, we propose an 8-session workshop that aims to enhance children's curiosity through training a set of specific metacognitive skills we hypothesize are involved in its process. Our workshop contains animated videos presenting declarative knowledge about curiosity and the said metacognitive skills as well as practice sessions to apply these skills during a reading-comprehension task, using a web platform designed for this study (e.g. expressing uncertainty, formulating questions, etc). We conduct a pilot study with 15 primary school students, aged between 8 and 10. Our first results show a positive impact on children's metacognitive efficiency and their ability to express their curiosity through question-asking behaviors.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Learning by Teaching: Key Challenges and Design Implications
Authors:
Amy Debbané,
Ken Jen Lee,
Jarvis Tse,
Edith Law
Abstract:
Benefits of learning by teaching (LbT) have been highlighted by previous studies from a pedagogical lens, as well as through computer-supported systems. However, the challenges that university students face in technology-mediated LbT$\unicode{x2013}$whether it be teaching oneself, teaching a peer, or teaching an agent$\unicode{x2013}$are not well understood. Furthermore, there is a gap in knowledg…
▽ More
Benefits of learning by teaching (LbT) have been highlighted by previous studies from a pedagogical lens, as well as through computer-supported systems. However, the challenges that university students face in technology-mediated LbT$\unicode{x2013}$whether it be teaching oneself, teaching a peer, or teaching an agent$\unicode{x2013}$are not well understood. Furthermore, there is a gap in knowledge on the challenges that students encounter throughout the process of teaching (content selection, preparation, teaching, receiving and giving feedback, and reflection) despite its importance to the design of LbT platforms. Thus, we conducted a study with 24 university students where they taught content they had not fully grasped, without guidance, and participated in a semi-structured interview. Results demonstrate that participants encountered the following challenges: psychological barriers relating to self and others, and lack of know-how. Furthermore, we illuminate design implications required to overcome these challenges and benefit from LbT without requiring prior training in pedagogy.
△ Less
Submitted 17 October, 2023;
originally announced October 2023.
-
"We need to do more ... I need to do more": Augmenting Digital Media Consumption via Critical Reflection to Increase Compassion and Promote Prosocial Attitudes and Behaviors
Authors:
Ken Jen Lee,
Adrian Davila,
Hanlin Cheng,
Joslin Goh,
Elizabeth Nilsen,
Edith Law
Abstract:
Much HCI research on prompting prosocial behaviors focuses on methods for increasing empathy. However, increased empathy may have unintended negative consequences. Our work offers an alternative solution that encourages critical reflection for nurturing compassion, which involves motivation and action to help others. In a between-subject experiment, participants (N=60) viewed a climate change docu…
▽ More
Much HCI research on prompting prosocial behaviors focuses on methods for increasing empathy. However, increased empathy may have unintended negative consequences. Our work offers an alternative solution that encourages critical reflection for nurturing compassion, which involves motivation and action to help others. In a between-subject experiment, participants (N=60) viewed a climate change documentary while receiving no prompts (CON), reflective prompts to focus on their emotions (RE) or surprises (RS). State compassion, critical reflection, and motivation to act or learn were measured at the end of the session (post-video) and two weeks later (follow-up). Despite participants' condition not affecting compassion, critical reflection was positively correlated with post-video state compassion. RE and RS participants demonstrated deeper reflection and reported higher motivation to learn post-video, and more prosocial behavioral changes during follow-up. RS participants reported better follow-up recall than RE participants. We conclude by discussing implications on designing technology to support compassion and longer-term critical reflection.
△ Less
Submitted 7 May, 2023;
originally announced May 2023.
-
Value Reflection: Motivation, Examples and The Role of Technology
Authors:
Ken Jen Lee,
Edith Law
Abstract:
Findings from existing research provide possible evidence that values are an important construct that should be part of the self-reflection process. However, many questions about value reflection remain unexplored. As such, this position paper aims to provide an overview of relevant research and frameworks, example studies on value reflection pursued by the authors, and design aspects that might b…
▽ More
Findings from existing research provide possible evidence that values are an important construct that should be part of the self-reflection process. However, many questions about value reflection remain unexplored. As such, this position paper aims to provide an overview of relevant research and frameworks, example studies on value reflection pursued by the authors, and design aspects that might both improve value reflection processes and provide a brief mapping of where and how technology could be of help.
△ Less
Submitted 7 May, 2023;
originally announced May 2023.
-
Towards a More Inclusive Metaverse via Designing Tools That Support Collaborative Virtual World Building by Users With and Without Disabilities
Authors:
Ken Jen Lee,
Edith Law
Abstract:
Research has found social VR to bring various benefits to users with and without disabilities. Given the success of social VR applications that support user-created worlds, it is important to consider how we can empower users in building inclusive virtual worlds by investigating how tools for world building can be built to better support collaborations between users with and without disabilities.…
▽ More
Research has found social VR to bring various benefits to users with and without disabilities. Given the success of social VR applications that support user-created worlds, it is important to consider how we can empower users in building inclusive virtual worlds by investigating how tools for world building can be built to better support collaborations between users with and without disabilities. As such, this position paper provides a brief discussion of existing research into important factors that should be considered during such collaborations, and possible future research directions.
△ Less
Submitted 7 May, 2023;
originally announced May 2023.
-
CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling
Authors:
Sangho Suh,
Jian Zhao,
Edith Law
Abstract:
Recent work demonstrated how we can design and use coding strips, a form of comic strips with corresponding code, to enhance teaching and learning in programming. However, creating coding strips is a creative, time-consuming process. Creators have to generate stories from code (code->story) and design comics from stories (story->comic). We contribute CodeToon, a comic authoring tool that facilitat…
▽ More
Recent work demonstrated how we can design and use coding strips, a form of comic strips with corresponding code, to enhance teaching and learning in programming. However, creating coding strips is a creative, time-consuming process. Creators have to generate stories from code (code->story) and design comics from stories (story->comic). We contribute CodeToon, a comic authoring tool that facilitates this code-driven storytelling process with two mechanisms: (1) story ideation from code using metaphor and (2) automatic comic generation from the story. We conducted a two-part user study that evaluates the tool and the comics generated by participants to test whether CodeToon facilitates the authoring process and helps generate quality comics. Our results show that CodeToon helps users create accurate, informative, and useful coding strips in a significantly shorter time. Overall, this work contributes methods and design guidelines for code-driven storytelling and opens up opportunities for using art to support computer science education.
△ Less
Submitted 27 August, 2022;
originally announced August 2022.
-
Conversational agents for fostering curiosity-driven learning in children
Authors:
Rania Abdelghani,
Pierre-Yves Oudeyer,
Edith Law,
Catherine de Vulpillières,
Hélène Sauzéon
Abstract:
Curiosity is an important factor that favors independent and individualized learning in children. Research suggests that it is also a competence that can be fostered by training specific metacognitive skills and information-searching behaviors. In this light, we develop a conversational agent that helps children generate curiosity-driven questions, and encourages their use to lead autonomous explo…
▽ More
Curiosity is an important factor that favors independent and individualized learning in children. Research suggests that it is also a competence that can be fostered by training specific metacognitive skills and information-searching behaviors. In this light, we develop a conversational agent that helps children generate curiosity-driven questions, and encourages their use to lead autonomous explorations and gain new knowledge. The study was conducted with 51 primary school students who interacted with either a neutral agent or an incentive agent that helped curiosity-driven questioning by offering specific semantic cues. Results showed a significant increase in the number and the quality of the questions generated with the incentive agent. This interaction also resulted in longer explorations and stronger learning progress. Together, our results suggest that the more our agent is able to train children's curiosity-related metacognitive skills, the better they can maintain their information-searching behaviors and the more new knowledge they are likely to acquire.
△ Less
Submitted 12 April, 2022; v1 submitted 7 April, 2022;
originally announced April 2022.
-
Natural Language Communication with a Teachable Agent
Authors:
Rachel Love,
Edith Law,
Philip R. Cohen,
Dana Kulić
Abstract:
Conversational teachable agents offer a promising platform to support learning, both in the classroom and in remote settings. In this context, the agent takes the role of the novice, while the student takes on the role of teacher. This framing is significant for its ability to elicit the Protégé effect in the student-teacher, a pedagogical phenomenon known to increase engagement in the teaching ta…
▽ More
Conversational teachable agents offer a promising platform to support learning, both in the classroom and in remote settings. In this context, the agent takes the role of the novice, while the student takes on the role of teacher. This framing is significant for its ability to elicit the Protégé effect in the student-teacher, a pedagogical phenomenon known to increase engagement in the teaching task, and also improve cognitive outcomes. In prior work, teachable agents often take a passive role in the learning interaction, and there are few studies in which the agent and student engage in natural language dialogue during the teaching task. This work investigates the effect of teaching modality when interacting with a virtual agent, via the web-based teaching platform, the Curiosity Notebook. A method of teaching the agent by selecting sentences from source material is compared to a method paraphrasing the source material and typing text input to teach. A user study has been conducted to measure the effect teaching modality on the learning outcomes and engagement of the participants. The results indicate that teaching via paraphrasing and text input has a positive effect on learning outcomes for the material covered, and also on aspects of affective engagement. Furthermore, increased paraphrasing effort, as measured by the similarity between the source material and the material the teacher conveyed to the robot, improves learning outcomes for participants.
△ Less
Submitted 16 March, 2022;
originally announced March 2022.
-
Identifying Functions and Behaviours of Social Robots during Learning Activities: Teachers' Perspective
Authors:
Jessy Ceha,
Edith Law,
Dana Kulić,
Pierre-Yves Oudeyer,
Didier Roy
Abstract:
With advances in artificial intelligence, research is increasingly exploring the potential functions that social robots can play in education. As teachers are a critical stakeholder in the use and application of educational technologies, we conducted a study to understand teachers' perspectives on how a social robot could support a variety of learning activities in the classroom. Through interview…
▽ More
With advances in artificial intelligence, research is increasingly exploring the potential functions that social robots can play in education. As teachers are a critical stakeholder in the use and application of educational technologies, we conducted a study to understand teachers' perspectives on how a social robot could support a variety of learning activities in the classroom. Through interviews, robot puppeteering, and group brainstorming sessions with five elementary and middle school teachers from a local school in Canada, we take a socio-technical perspective to conceptualize possible robot functions and behaviours, and the effects they may have on the current way learning activities are designed, planned, and executed. Overall, the teachers responded positively to the idea of introducing a social robot as a technological tool for learning activities, envisioning differences in usage for teacher-robot and student-robot interactions. Further, Engeström's Activity System Model -- a framework for analyzing human needs, tasks, and outcomes -- illustrated a number of tensions associated with learning activities in the classroom. We discuss the fine-grained robot functions and behaviours conceived by teachers, and how they address the current tensions -- providing suggestions for improving the design of social robots for learning activities.
△ Less
Submitted 30 October, 2021;
originally announced November 2021.
-
Exploring Individual and Collaborative Storytelling in an Introductory Creative Coding Class
Authors:
Sangho Suh,
Ken Jen Lee,
Celine Latulipe,
Jian Zhao,
Edith Law
Abstract:
Teaching programming through storytelling is a popular pedagogical approach and an active area of research. However, most previous work in this area focused on K-12 students using block-based programming. Little, if any, work has examined the approach with university students using text-based programming. This experience report fills this gap. Specifically, we report our experience administering t…
▽ More
Teaching programming through storytelling is a popular pedagogical approach and an active area of research. However, most previous work in this area focused on K-12 students using block-based programming. Little, if any, work has examined the approach with university students using text-based programming. This experience report fills this gap. Specifically, we report our experience administering three storytelling assignments -- two individual and one collaborative -- in an introductory computer science class with 49 undergraduate students using $\textit{p5.js}$, a text-based programming library for creative coding. Our work contributes an understanding of students' experiences with the three authoring processes and a set of recommendations to improve the administration of and experience with individual and collaborative storytelling with text-based programming.
△ Less
Submitted 29 September, 2021;
originally announced October 2021.
-
Using Comics to Introduce and Reinforce Programming Concepts in CS1
Authors:
Sangho Suh,
Celine Latulipe,
Ken Jen Lee,
Bernadette Cheng,
Edith Law
Abstract:
Recent work investigated the potential of comics to support the teaching and learning of programming concepts and suggested several ways $coding$ $strips$, a form of comic strip with its corresponding code, can be used. Building on this work, we tested the recommended use cases of $coding$ $strip$ in an undergraduate introductory computer science course at a large comprehensive university. At the…
▽ More
Recent work investigated the potential of comics to support the teaching and learning of programming concepts and suggested several ways $coding$ $strips$, a form of comic strip with its corresponding code, can be used. Building on this work, we tested the recommended use cases of $coding$ $strip$ in an undergraduate introductory computer science course at a large comprehensive university. At the end of the course, we surveyed students to assess their experience and found they benefited in various ways. Our work contributes a demonstration of the various ways comics can be used in introductory CS courses and an initial understanding of benefits and challenges with using comics in computing education gleaned from an analysis of students' survey responses and code submissions.
△ Less
Submitted 27 September, 2021; v1 submitted 27 September, 2021;
originally announced September 2021.
-
Rethinking Immersive Virtual Reality and Empathy
Authors:
Ken Jen Lee,
Edith Law
Abstract:
In this position paper, we aim to spark more discussions surrounding the use of empathy as the intended outcome of many studies on immersive virtual reality experiences. As a construct, empathy has many significant flaws that may lead to unintended and negative outcomes, going against our original goal of employing these technologies for the betterment of society. We highlight the possible advanta…
▽ More
In this position paper, we aim to spark more discussions surrounding the use of empathy as the intended outcome of many studies on immersive virtual reality experiences. As a construct, empathy has many significant flaws that may lead to unintended and negative outcomes, going against our original goal of employing these technologies for the betterment of society. We highlight the possible advantages of designing for rational compassion instead, and propose alternative research directions and outcome measurements for immersive virtual reality that urgently warrant our attention.
△ Less
Submitted 8 September, 2021;
originally announced September 2021.
-
Can a Humorous Conversational Agent Enhance Learning Experience and Outcomes?
Authors:
Jessy Ceha,
Ken Jen Lee,
Elizabeth Nilsen,
Joslin Goh,
Edith Law
Abstract:
Previous studies have highlighted the benefits of pedagogical conversational agents using socially-oriented conversation with students. In this work, we examine the effects of a conversational agent's use of affiliative and self-defeating humour -- considered conducive to social well-being and enhancing interpersonal relationships -- on learners' perception of the agent and attitudes towards the t…
▽ More
Previous studies have highlighted the benefits of pedagogical conversational agents using socially-oriented conversation with students. In this work, we examine the effects of a conversational agent's use of affiliative and self-defeating humour -- considered conducive to social well-being and enhancing interpersonal relationships -- on learners' perception of the agent and attitudes towards the task. Using a between-subjects protocol, 58 participants taught a conversational agent about rock classification using a learning-by-teaching platform, the Curiosity Notebook. While all agents were curious and enthusiastic, the style of humour was manipulated such that the agent either expressed an affiliative style, a self-defeating style, or no humour. Results demonstrate that affiliative humour can significantly increase motivation and effort, while self-defeating humour, although enhancing effort, negatively impacts enjoyment. Findings further highlight the importance of understanding learner characteristics when using humour.
△ Less
Submitted 25 August, 2021;
originally announced August 2021.
-
Curiosity Notebook: The Design of a Research Platform for Learning by Teaching
Authors:
Ken Jen Lee,
Apoorva Chauhan,
Joslin Goh,
Elizabeth Nilsen,
Edith Law
Abstract:
While learning by teaching is a popular pedagogical technique, it is a learning phenomenon that is difficult to study due to variability in the tutor-tutee pairings and learning environments. In this paper, we introduce the Curiosity Notebook, a web-based research infrastructure for studying learning by teaching via the use of a teachable agent. We describe and provide rationale for the set of fea…
▽ More
While learning by teaching is a popular pedagogical technique, it is a learning phenomenon that is difficult to study due to variability in the tutor-tutee pairings and learning environments. In this paper, we introduce the Curiosity Notebook, a web-based research infrastructure for studying learning by teaching via the use of a teachable agent. We describe and provide rationale for the set of features that are essential for such a research infrastructure, outline how these features have evolved over two design iterations of the Curiosity Notebook and through two studies -- a 4-week field study with 12 elementary school students interacting with a NAO robot and an hour-long online observational study with 41 university students interacting with an agent -- demonstrate the utility of our platform for making observations of learning-by-teaching phenomena in diverse learning environments. Based on these findings, we conclude the paper by reflecting on our design evolution and envisioning future iterations of the Curiosity Notebook.
△ Less
Submitted 22 August, 2021;
originally announced August 2021.
-
Towards Teachable Conversational Agents
Authors:
Nalin Chhibber,
Edith Law
Abstract:
The traditional process of building interactive machine learning systems can be viewed as a teacher-learner interaction scenario where the machine-learners are trained by one or more human-teachers. In this work, we explore the idea of using a conversational interface to investigate the interaction between human-teachers and interactive machine-learners. Specifically, we examine whether teachable…
▽ More
The traditional process of building interactive machine learning systems can be viewed as a teacher-learner interaction scenario where the machine-learners are trained by one or more human-teachers. In this work, we explore the idea of using a conversational interface to investigate the interaction between human-teachers and interactive machine-learners. Specifically, we examine whether teachable AI agents can reliably learn from human-teachers through conversational interactions, and how this learning compare with traditional supervised learning algorithms. Results validate the concept of teachable conversational agents and highlight the factors relevant for the development of machine learning systems that intend to learn from conversational interactions.
△ Less
Submitted 20 February, 2021;
originally announced February 2021.
-
Autonomous Vehicle Visual Signals for Pedestrians: Experiments and Design Recommendations
Authors:
Henry Chen,
Robin Cohen,
Kerstin Dautenhahn,
Edith Law,
Krzysztof Czarnecki
Abstract:
Autonomous Vehicles (AV) will transform transportation, but also the interaction between vehicles and pedestrians. In the absence of a driver, it is not clear how an AV can communicate its intention to pedestrians. One option is to use visual signals. To advance their design, we conduct four human-participant experiments and evaluate six representative AV visual signals for visibility, intuitivene…
▽ More
Autonomous Vehicles (AV) will transform transportation, but also the interaction between vehicles and pedestrians. In the absence of a driver, it is not clear how an AV can communicate its intention to pedestrians. One option is to use visual signals. To advance their design, we conduct four human-participant experiments and evaluate six representative AV visual signals for visibility, intuitiveness, persuasiveness, and usability at pedestrian crossings. Based on the results, we distill twelve practical design recommendations for AV visual signals, with focus on signal pattern design and placement. Moreover, the paper advances the methodology for experimental evaluation of visual signals, including lab, closed-course, and public road tests using an autonomous vehicle. In addition, the paper also reports insights on pedestrian crosswalk behaviours and the impacts of pedestrian trust towards AVs on the behaviors. We hope that this work will constitute valuable input to the ongoing development of international standards for AV lamps, and thus help mature automated driving in general.
△ Less
Submitted 10 October, 2020;
originally announced October 2020.
-
Exploring Context-Aware Conversational Agents in Software Development
Authors:
Glaucia Melo,
Edith Law,
Paulo Alencar,
Don Cowan
Abstract:
Software development is a complex endeavor that depends on a wide variety of contextual factors involving a large amount of distributed information. This knowledge could include: technology-related tasks, software operating environments and stakeholder requirements. A major roadblock to using this knowledge in software development is that most of this information is implicit and captured in the de…
▽ More
Software development is a complex endeavor that depends on a wide variety of contextual factors involving a large amount of distributed information. This knowledge could include: technology-related tasks, software operating environments and stakeholder requirements. A major roadblock to using this knowledge in software development is that most of this information is implicit and captured in the developers' minds (tacit) or spread through volumes of documentation. Developers, as they work often have to maintain mental models of these tasks as they produce the software. As a result, context can be easily lost or forgotten and developers often use trial-and-error approaches while finishing the project. This study aims at analyzing whether supporting software developers with a chatbot during task execution can improve the overall development experience. The chatbot can assist the developers in executing different tasks based on implicit contextual information. We propose an implementation to explore the viability of using textual chatbots to assist developers automatically and proactively with software development project activities that recur.
△ Less
Submitted 3 June, 2020;
originally announced June 2020.
-
Pedagogical Agents for Fostering Question-Asking Skills in Children
Authors:
Mehdi Alaimi,
Edith Law,
Kevin Daniel Pantasdo,
Pierre-Yves Oudeyer,
Helene Sauzeon
Abstract:
Question asking is an important tool for constructing academic knowledge, and a self-reinforcing driver of curiosity. However, research has found that question asking is infrequent in the classroom and children's questions are often superficial, lacking deep reasoning. In this work, we developed a pedagogical agent that encourages children to ask divergent-thinking questions, a more complex form o…
▽ More
Question asking is an important tool for constructing academic knowledge, and a self-reinforcing driver of curiosity. However, research has found that question asking is infrequent in the classroom and children's questions are often superficial, lacking deep reasoning. In this work, we developed a pedagogical agent that encourages children to ask divergent-thinking questions, a more complex form of questions that is associated with curiosity. We conducted a study with 95 fifth grade students, who interacted with an agent that encourages either convergent-thinking or divergent-thinking questions. Results showed that both interventions increased the number of divergent-thinking questions and the fluency of question asking, while they did not significantly alter children's perception of curiosity despite their high intrinsic motivation scores. In addition, children's curiosity trait has a mediating effect on question asking under the divergent-thinking agent, suggesting that question-asking interventions must be personalized to each student based on their tendency to be curious.
△ Less
Submitted 7 April, 2020;
originally announced April 2020.
-
Using Conversational Agents To Support Learning By Teaching
Authors:
Nalin Chhibber,
Edith Law
Abstract:
Conversational agents are becoming increasingly popular for supporting and facilitating learning. Conventional pedagogical agents are designed to play the role of human teachers by giving instructions to the students. In this paper, we investigate the use of conversational agents to support the 'learning-by-teaching' paradigm where the agent receives instructions from students. In particular, we i…
▽ More
Conversational agents are becoming increasingly popular for supporting and facilitating learning. Conventional pedagogical agents are designed to play the role of human teachers by giving instructions to the students. In this paper, we investigate the use of conversational agents to support the 'learning-by-teaching' paradigm where the agent receives instructions from students. In particular, we introduce Curiosity Notebook: an educational application that harvests conversational interventions to facilitate students' learning. Recognizing such interventions can not only help in engaging students within learning interactions, but also provide a deeper insight into the intricacies involved in designing conversational agents for educational purposes.
△ Less
Submitted 29 September, 2019;
originally announced September 2019.
-
Human Perception of Surprise: A User Study
Authors:
Nalin Chhibber,
Rohail Syed,
Mengqiu Teng,
Joslin Goh,
Kevyn Collins-Thompson,
Edith Law
Abstract:
Understanding how to engage users is a critical question in many applications. Previous research has shown that unexpected or astonishing events can attract user attention, leading to positive outcomes such as engagement and learning. In this work, we investigate the similarity and differences in how people and algorithms rank the surprisingness of facts. Our crowdsourcing study, involving 106 par…
▽ More
Understanding how to engage users is a critical question in many applications. Previous research has shown that unexpected or astonishing events can attract user attention, leading to positive outcomes such as engagement and learning. In this work, we investigate the similarity and differences in how people and algorithms rank the surprisingness of facts. Our crowdsourcing study, involving 106 participants, shows that computational models of surprise can be used to artificially induce surprise in humans.
△ Less
Submitted 16 July, 2018;
originally announced July 2018.
