Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3172944.3172987acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article

Webcam-based Attention Tracking in Online Learning: A Feasibility Study

Published: 05 March 2018 Publication History

Abstract

A main weakness of the open online learning movement is retention: a small minority of learners (on average 5-10%, in extreme cases <1%) that start a so-called Massive Open Online Course (MOOC) complete it successfully. There are many reasons why learners are unsuccessful, among the most important ones is the lack of self-regulation: learners are often not able to self-regulate their learning behavior. Designing tools that provide learners with a greater awareness of their learning is vital to the future success of MOOC environments. Detecting learners' loss of focus during learning is particularly important, as this can allow us to intervene and return the learners' attention to the learning materials. One technological affordance to detect such loss of focus are webcams---ubiquitous pieces of hardware available in almost all laptops today. In recent years, researchers have begun to exploit eye tracking and gaze data generated from webcams as part of complex machine learning solutions to detect inattention or loss of focus. Those approaches however tend to have a high detection lag, can be inaccurate, and are complex to design and maintain. In contrast, in this paper, we explore the possibility of a simple alternative---the presence or absence of a face---to detect a loss of focus in the online learning setting. To this end, we evaluate the performance of three consumer and professional eye/face-tracking frameworks using a benchmark suite we designed specifically for this purpose: it contains a set of common xMOOC user activities and behaviours. The results of our study show that even this basic approach poses a significant challenge to current hardware and software-based tracking solutions.

References

[1]
Stylianos Asteriadis, Kostas Karpouzis, and Stefanos Kollias. 2014. Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation. International Journal of Computer Vision 107, 3 (2014), 293--316.
[2]
Robert Bixler and Sidney D'Mello. 2014. Toward fully automated person-independent detection of mind wandering. In UMAP '14. 37--48.
[3]
Robert Bixler and Sidney D'Mello. 2016. Automatic gaze-based user-independent detection of mind wandering during computerized reading. User Modeling and User-Adapted Interaction 26, 1 (2016), 33--68.
[4]
Nathaniel Blanchard, Robert Bixler, Tera Joyce, and Sidney D'Mello. 2014. Automated Physiological-Based Detection of Mind Wandering during Learning. Springer International Publishing, Cham, 55--60.
[5]
Diane M Bunce, Elizabeth A Flens, and Kelly Y Neiles. 2010. How long can students pay attention in class? A study of student attention decline using clickers. Journal of Chemical Education 87, 12 (2010), 1438--1443.
[6]
Dan Davis, Ioana Jivet, René F. Kizilcec, Guanliang Chen, Claudia Hauff, and Geert-Jan Houben. 2017. Follow the Successful Crowd: Raising MOOC Completion Rates Through Social Comparison at Scale. In LAK '17. 454--463.
[7]
Barbara Hauer. 2016. Continuous Supervision: A Novel Concept for Enhancing Data Leakage Prevention. In European Conference on Cyber Warfare and Security. Academic Conferences International Limited, 342--349.
[8]
Alex H Johnstone and Frederick Percival. 1976. Attention breaks in lectures. Education in Chemistry 13, 2 (1976), 49--50.
[9]
Katy Jordan. 2014. Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning 15, 1 (2014).
[10]
Sophie I Lindquist and John P McLean. 2011. Daydreaming and its correlates in an educational environment. Learning and Individual Differences 21, 2 (2011), 158--167.
[11]
Kep Kee Loh, Benjamin Zhi Hui Tan, and Stephen Wee Hun Lim. 2016. Media multitasking predicts video-recorded lecture learning performance through mind wandering tendencies. Computers in Human Behavior 63 (2016), 943--947.
[12]
John McLeish. 1968. The lecture method. Cambridge Institute of Education.
[13]
Caitlin Mills, Robert Bixler, Xinyi Wang, and Sidney K D'Mello. 2016. Automatic Gaze-Based Detection of Mind Wandering during Narrative Film Comprehension. In EDM '16. 30--37.
[14]
Masaki Ogawa, Takuro Yonezawa, Jin Nakazawa, and Hideyuki Tokuda. 2015. Exploring user model of the city by using interactive public display application. In UbiComp/ISWC '15 Adjunct. 1595--1598.
[15]
Alexandra Papoutsaki, Nediyana Daskalova, Patsorn Sangkloy, Jeff Huang, James Laskey, and James Hays. 2016. WebGazer: scalable webcam eye tracking using user interactions. In IJCAI '16. 3839--3845.
[16]
Alexandra Papoutsaki, James Laskey, and Jeff Huang. 2017. SearchGazer: Webcam Eye Tracking for Remote Studies of Web Search. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval. ACM, 17--26.
[17]
Matthieu Perreira Da Silva, Vincent Courboulay, Armelle Prigent, and Pascal Estraillier. 2008. Real-Time Face Tracking for Attention Aware Adaptive Games. In ICVS '08. 99--108.
[18]
Keith Rayner. 1998. Eye movements in reading and information processing: 20 years of research. Psychological bulletin 124, 3 (1998), 372--422.
[19]
Evan F Risko, Nicola Anderson, Amara Sarwal, Megan Engelhardt, and Alan Kingstone. 2012. Everyday attention: variation in mind wandering and memory in a lecture. Applied Cognitive Psychology 26, 2 (2012), 234--242.
[20]
Filipe Santos, Ana Almeida, Constantino Martins, Paulo Moura de Oliveira, and Ramiro Gonccalves. 2017. Hybrid Tourism Recommendation System Based on Functionality/Accessibility Levels. In International Conference on Practical Applications of Agents and Multi-Agent Systems. Springer, 221--228.
[21]
Kshitij Sharma, Patrick Jermann, and Pierre Dillenbourg. 2014. How Students Learn using MOOCs: An Eye-tracking Insight. In EMOOCs. 147--154.
[22]
Jonathan Smallwood, Daniel J Fishman, and Jonathan W Schooler. 2007. Counting the cost of an absent mind: Mind wandering as an underrecognized influence on educational performance. Psychonomic Bulletin & Review 14, 2 (2007), 230--236.
[23]
John Stuart and RJD Rutherford. 1978. Medical student concentration during lectures. The Lancet 312, 8088 (1978), 514--516.
[24]
Karl K Szpunar, Novall Y Khan, and Daniel L Schacter. 2013. Interpolated memory tests reduce mind wandering and improve learning of online lectures. Proceedings of the National Academy of Sciences 110, 16 (2013), 6313--6317.
[25]
Sajjad Taheri, Alexander Veidenbaum, Alexandru Nicolau, and Mohammad R Haghighat. 2017. OpenCV.js: Computer Vision Processing for the Web. Technical Report. University of California, Irvine.
[26]
Karen Wilson and James H Korn. 2007. Attention during lectures: Beyond ten minutes. Teaching of Psychology 34, 2 (2007), 85--89.
[27]
Beverly Woolf, Winslow Burleson, Ivon Arroyo, Toby Dragon, David Cooper, and Rosalind Picard. 2009. Affect-aware tutors: recognising and responding to student affect. International Journal of Learning Technology 4, 3--4 (2009), 129--164.
[28]
Xiang Xiao and Jingtao Wang. 2017. Understanding and Detecting Divided Attention in Mobile MOOC Learning. In CHI '17. 2411--2415.
[29]
Thorsten O Zander, Christian Kothe, Sabine Jatzev, and Matti Gaertner. 2010. Enhancing human-computer interaction with input from active and passive brain-computer interfaces. In Brain-computer interfaces. 181--199.
[30]
Yue Zhao, Christoph Lofi, and Claudia Hauff. 2017. Scalable Mind-Wandering Detection for MOOCs: A Webcam-Based Approach. In ECTEL '17. 330--344.

Cited By

View all
  • (2025)How Do You Ride an Elevator? Passenger In-Cabin Behavior Analysis on a Smart-Elevator PlatformSmart Life and Smart Life Engineering10.1007/978-3-031-75887-4_10(209-236)Online publication date: 1-Feb-2025
  • (2024)A Scoping Review of Webcam Eye Tracking in Learning and EducationStudia paedagogica10.5817/SP2023-3-528:3(113-131)Online publication date: 2-Apr-2024
  • (2024)Design of a Personalized AI-based Synchronous Online Education Feedback System using Eye Tracking Data and Evaluation of Intention to UseThe Journal of Korean Association of Computer Education10.32431/kace.2024.27.1.00227:1(25-37)Online publication date: 31-Jan-2024
  • Show More Cited By

Index Terms

  1. Webcam-based Attention Tracking in Online Learning: A Feasibility Study

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IUI '18: Proceedings of the 23rd International Conference on Intelligent User Interfaces
    March 2018
    698 pages
    ISBN:9781450349451
    DOI:10.1145/3172944
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 March 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. eye tracking
    2. face detection
    3. moocs
    4. online learning

    Qualifiers

    • Research-article

    Conference

    IUI'18
    Sponsor:

    Acceptance Rates

    IUI '18 Paper Acceptance Rate 43 of 299 submissions, 14%;
    Overall Acceptance Rate 746 of 2,811 submissions, 27%

    Upcoming Conference

    IUI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)84
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 04 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)How Do You Ride an Elevator? Passenger In-Cabin Behavior Analysis on a Smart-Elevator PlatformSmart Life and Smart Life Engineering10.1007/978-3-031-75887-4_10(209-236)Online publication date: 1-Feb-2025
    • (2024)A Scoping Review of Webcam Eye Tracking in Learning and EducationStudia paedagogica10.5817/SP2023-3-528:3(113-131)Online publication date: 2-Apr-2024
    • (2024)Design of a Personalized AI-based Synchronous Online Education Feedback System using Eye Tracking Data and Evaluation of Intention to UseThe Journal of Korean Association of Computer Education10.32431/kace.2024.27.1.00227:1(25-37)Online publication date: 31-Jan-2024
    • (2024)Digital Detection of Attention and Distraction BehaviorsProcedia Computer Science10.1016/j.procs.2024.09.332246(4673-4682)Online publication date: 2024
    • (2023)Student Engagement Awareness in an Asynchronous E-Learning EnvironmentInternational Journal of Technology-Enabled Student Support Services10.4018/IJTESSS.31621112:1(1-19)Online publication date: 6-Jan-2023
    • (2023)The Features of Students Paying and Not Paying Attention in Online Classes2023 International Conference on Computer and Applications (ICCA)10.1109/ICCA59364.2023.10401506(1-7)Online publication date: 28-Nov-2023
    • (2023)Towards Automatic Detection of Participant Attention in Virtual Meetings2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE)10.1109/CSCE60160.2023.00445(2731-2733)Online publication date: 24-Jul-2023
    • (2023)Webcam-based online eye-tracking for behavioral researchJudgment and Decision Making10.1017/S193029750000851216:6(1485-1505)Online publication date: 1-Jan-2023
    • (2023)Eye Tracking Auto-Correction Using Domain InformationHuman-Computer Interaction10.1007/978-3-031-35596-7_24(373-391)Online publication date: 23-Jul-2023
    • (2022)Bifurcating Cognitive Attention from Visual Concentration: Utilizing Cooperative Audiovisual Sensing for Demarcating Inattentive Online Meeting ParticipantsProceedings of the ACM on Human-Computer Interaction10.1145/35556566:CSCW2(1-34)Online publication date: 11-Nov-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media