research-article

Elicast: embedding interactive exercises in instructional programming screencasts

Authors:

Yeong Hoon Park,

Alice OhAuthors Info & Claims

L@S '18: Proceedings of the Fifth Annual ACM Conference on Learning at Scale

Article No.: 58, Pages 1 - 10

https://doi.org/10.1145/3231644.3231657

Published: 26 June 2018 Publication History

Abstract

In programming education, instructors often supplement lectures with active learning experiences by offering programming lab sessions where learners themselves practice writing code. However, widely accessed instructional programming screencasts are not equipped with assessment format that encourages such hands-on programming activities. We introduce Elicast, a screencast tool for recording and viewing programming lectures with embedded programming exercises, to provide hands-on programming experiences in the screen-cast. In Elicast, instructors embed multiple programming exercises while creating a screencast, and learners engage in the exercises by writing code within the screencast, receiving auto-graded results immediately. We conducted an exploratory study of Elicast with five experienced instructors and 63 undergraduate students. We found that instructors structured the lectures into small learning units using embedded exercises as checkpoints. Also, learners more actively engaged in the screencast lectures, checked their understanding of the content through the embedded exercises, and more frequently modified and executed the code during the lectures.

References

[1]

Kirsti M Ala-Mutka. 2005. A survey of automated assessment approaches for programming assignments. Computer science education 15, 2 (2005), 83--102.

[2]

Sumit Basu, Chuck Jacobs, and Lucy Vanderwende. 2013. Powergrading: a clustering approach to amplify human effort for short answer grading. Transactions of the Association for Computational Linguistics 1 (2013), 391--402.

[3]

Jacob Lowell Bishop and Matthew A Verleger. 2013. The flipped classroom: A survey of the research. In ASEE National Conference Proceedings, Atlanta, GA, Vol. 30. 1--18.

[4]

Jennifer Campbell, Diane Horton, Michelle Craig, and Paul Gries. 2014. Evaluating an inverted CS1. In Proceedings of the 45th ACM technical symposium on Computer science education. ACM, 307--312.

Digital Library

[5]

Jyoti Chauhan and Anita Goel. 2016. An analysis of quiz in MOOC. In Contemporary Computing (IC3), 2016 Ninth International Conference on. IEEE, 1--6.

[6]

Michael Clancy, Nate Titterton, Clint Ryan, Jim Slotta, and Marcia Linn. 2003. New roles for students, instructors, and computers in a lab-based introductory programming course. In ACM SIGCSE Bulletin, Vol. 35. ACM, 132--136.

Digital Library

[7]

National Research Council and others. 2000. How people learn: Brain, mind, experience, and school: Expanded edition. National Academies Press.

[8]

Coursera. 2017. Answer in-video questions --- Coursera Help Center. (2017). https://learner.coursera.help/hc/en-us/articles/209818663-Answer-in-video-questions {Online; accessed 18-September-2017}.

[9]

Stephen Cummins, Alastair R Beresford, and Andrew Rice. 2016. Investigating Engagement with In-Video Quiz Questions in a Programming Course. IEEE Transactions on Learning Technologies 9, 1 (2016), 57--66.

Digital Library

[10]

Mathias Ellmann, Alexander Oeser, Davide Fucci, and Walid Maalej. 2017. Find, understand, and extend development screencasts on YouTube. arXiv preprint arXiv:1707.08824 (2017).

Digital Library

[11]

Ursula Fuller, Colin G Johnson, Tuukka Ahoniemi, Diana Cukierman, Isidoro Hernán-Losada, Jana Jackova, Essi Lahtinen, Tracy L Lewis, Donna McGee Thompson, Charles Riedesel, and others. 2007. Developing a computer science-specific learning taxonomy. In ACM SIGCSE Bulletin, Vol. 39. ACM, 152--170.

Digital Library

[12]

Gerald C Gannod, Janet E Burge, and Michael T Helmick. 2008. Using the inverted classroom to teach software engineering. In Proceedings of the 30th international conference on Software engineering. ACM, 777--786.

Digital Library

[13]

Elena L Glassman, Jeremy Scott, Rishabh Singh, Philip J Guo, and Robert C Miller. 2015. OverCode: Visualizing variation in student solutions to programming problems at scale. ACM Transactions on Computer-Human Interaction (TOCHI) 22, 2 (2015), 7.

Digital Library

[14]

Philip J Guo, Juho Kim, and Rob Rubin. 2014. How video production affects student engagement: An empirical study of mooc videos. In Proceedings of the first ACM conference on Learning@ scale conference. ACM, 41--50.

Digital Library

[15]

Mina C Johnson-Glenberg. 2010. Embedded formative e-assessment: who benefits, who falters. Educational Media International 47, 2 (2010), 153--171.

[16]

Juho Kim and others. 2015a. Learnersourcing: improving learning with collective learner activity. Ph.D. Dissertation. Massachusetts Institute of Technology.

[17]

Juho Kim, Elena L Glassman, Andrés Monroy-Hernández, and Meredith Ringel Morris. 2015b. RIMES: Embedding interactive multimedia exercises in lecture videos. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1535--1544.

Digital Library

[18]

René F Kizilcec, Chris Piech, and Emily Schneider. 2013. Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In Proceedings of the third international conference on learning analytics and knowledge. ACM, 170--179.

Digital Library

[19]

Geza Kovacs. 2016. Effects of in-video Quizzes on MOOC lecture viewing. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale. ACM, 31--10.

Digital Library

[20]

Essi Lahtinen, Kirsti Ala-Mutka, and Hannu-Matti Järvinen. 2005. A study of the difficulties of novice programmers. In Acm Sigcse Bulletin, Vol. 37. ACM, 14--18.

Digital Library

[21]

Laura MacLeod, Margaret-Anne Storey, and Andreas Bergen. 2015. Code, camera, action: How software developers document and share program knowledge using YouTube. In Program Comprehension (ICPC), 2015 IEEE 23rd International Conference on. IEEE, 104--114.

Digital Library

[22]

Nehal Mamgain, Arjun Sharma, and Puneet Goyal. 2014. Learner's perspective on video-viewing features offered by MOOC providers: Coursera and edX. In MOOC, Innovation and Technology in Education (MITE), 2014 IEEE International Conference on. IEEE, 331--336.

[23]

John Markoff. 2013. Essay-grading software offers professors a break. (2013).

[24]

Toni-Jan Keith Palma Monserrat, Yawen Li, Shengdong Zhao, and Xiang Cao. 2014. L. IVE: an integrated interactive video-based learning environment. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3399--3402.

Digital Library

[25]

Keith O'Hara, Douglas Blank, and James Marshall. 2015. Computational Notebooks for AI Education. In The Twenty-Eighth International Flairs Conference.

[26]

Jungkook Park, Yeong Hoon Park, and Alice Oh. 2017. Non-Linear Editor for Text-Based Screencast. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 183--185.

Digital Library

[27]

Rishabh Singh, Sumit Gulwani, and Armando Solar-Lezama. 2013. Automated feedback generation for introductory programming assignments. ACM SIGPLAN Notices 48,6(2013), 15--26.

Digital Library

[28]

Chengzheng Sun and Clarence Ellis. 1998. Operational transformation in real-time group editors: issues, algorithms, and achievements. In Proceedings of the 1998 ACM conference on Computer supported cooperative work. ACM, 59--68.

Digital Library

[29]

Karl K Szpunar, Novall Y Khan, and Daniel L Schacter. 2013. Interpolated memory tests reduce mind wandering and improve learning of online lectures. Proceedings of the National Academy of Sciences 110, 16(2013), 6313--6317.

[30]

Mark J Van Gorp and Scott Grissom. 2001. An empirical evaluation of using constructive classroom activities to teach introductory programming. Computer Science Education 11, 3 (2001), 247--260.

[31]

Allan Wigfield and Jacquelynne S Eccles. 2000. Expectancy-value theory of achievement motivation. Contemporary educational psychology 25, 1 (2000), 68--81.

[32]

Joseph Jay Williams, Tania Lombrozo, Anne Hsu, Bernd Huber, and Juho Kim. 2016. Revising Learner Misconceptions Without Feedback: Prompting for Reflection on Anomalies. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 470--474.

Digital Library

[33]

Leon E Winslow. 1996. Programming pedagogy---a psychological overview. ACM Sigcse Bulletin 28, 3 (1996), 17--22.

Digital Library

Cited By

de Almeida R(2024)Computational Environment to Promote Learning Motivation of Distance Education Introductory Programming Students2024 International Symposium on Computers in Education (SIIE)10.1109/SIIE63180.2024.10604513(1-6)Online publication date: 19-Jun-2024
https://doi.org/10.1109/SIIE63180.2024.10604513
de Almeida RGomes AMendes A(2024)Challenges and Possibilities in Motivating Students to Learn Programming in Distance Education: A Systematic Mapping Study2024 IEEE Global Engineering Education Conference (EDUCON)10.1109/EDUCON60312.2024.10578759(1-10)Online publication date: 8-May-2024
https://doi.org/10.1109/EDUCON60312.2024.10578759
Marciniak JWójtowicz AKołodziejczak BSzczepański MMarciniak DStachowiak A(2023)Granular or Long: Influence of the Content Structure on Student Interaction with Learning Materials2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343030(1-8)Online publication date: 18-Oct-2023
https://doi.org/10.1109/FIE58773.2023.10343030
Show More Cited By

Elicast: embedding interactive exercises in instructional programming screencasts
1. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Computing education programs

Recommendations

Using multimedia and peer assessment to promote collaborative e-learning

Collaborative e-learning is increasingly appealing as a pedagogical approach that can positively affect student learning. We propose a didactical model that integrates multimedia with collaborative tools and peer assessment to foster collaborative e-...
Introducing CodeWorkout: an adaptive and social learning environment (abstract only)
SIGCSE '14: Proceedings of the 45th ACM technical symposium on Computer science education

Rudimentary programming skills are essential to developing fundamental proficiency in computer science. However, learning programming techniques can be challenging and frustrating for many students. CodeWorkout is an online learning environment that ...
MoocCast: evaluating mobile-screencast for online courses

The progressive adoption of smartphones and interconnected devices is inspiring students to redesign their physical spaces toward a seamless shift between daily life and learning activities. In the last years, Massive Open Online Courses (MOOCs) ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

L@S '18: Proceedings of the Fifth Annual ACM Conference on Learning at Scale

June 2018

391 pages

ISBN:9781450358866

DOI:10.1145/3231644

Conference Chair:
Rose Luckin
UCL Institute of Education, UK
,
Program Chairs:
Scott Klemmer
University of California at San Diego
,
Kenneth Koedinger
Carnegie Mellon University

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Research Foundation of Korea

Conference

L@S '18

L@S '18: Fifth (2018) ACM Conference on Learning @ Scale

June 26 - 28, 2018

London, United Kingdom

Acceptance Rates

L@S '18 Paper Acceptance Rate 24 of 58 submissions, 41%;

Overall Acceptance Rate 117 of 440 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
285
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

de Almeida R(2024)Computational Environment to Promote Learning Motivation of Distance Education Introductory Programming Students2024 International Symposium on Computers in Education (SIIE)10.1109/SIIE63180.2024.10604513(1-6)Online publication date: 19-Jun-2024
https://doi.org/10.1109/SIIE63180.2024.10604513
de Almeida RGomes AMendes A(2024)Challenges and Possibilities in Motivating Students to Learn Programming in Distance Education: A Systematic Mapping Study2024 IEEE Global Engineering Education Conference (EDUCON)10.1109/EDUCON60312.2024.10578759(1-10)Online publication date: 8-May-2024
https://doi.org/10.1109/EDUCON60312.2024.10578759
Marciniak JWójtowicz AKołodziejczak BSzczepański MMarciniak DStachowiak A(2023)Granular or Long: Influence of the Content Structure on Student Interaction with Learning Materials2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343030(1-8)Online publication date: 18-Oct-2023
https://doi.org/10.1109/FIE58773.2023.10343030
Marciniak JWójtowicz AKolodziejczak BSzczepanski MStachowiak ABecker BQuille KLaakso MBarendsen ESimon (2022)Impact of Course Scheduling on Student Performance in Remote LearningProceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 110.1145/3502718.3524788(400-406)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3502718.3524788
Willert N(2021)A Systematic Literature Review of Gameful Feedback in Computer Science EducationInternational Journal of Information and Education Technology10.18178/ijiet.2021.11.10.155111:10(464-470)Online publication date: 2021
https://doi.org/10.18178/ijiet.2021.11.10.1551
Brusilovsky PKoedinger KJoyner DPrice TJoyner DKizilcec RSinger S(2020)Building an Infrastructure for Computer Science Education Research and Practice at ScaleProceedings of the Seventh ACM Conference on Learning @ Scale10.1145/3386527.3405936(211-213)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386527.3405936
Hosseini RAkhuseyinoglu KBrusilovsky PMalmi LPollari-Malmi KSchunn CSirkiä T(2020)Improving Engagement in Program Construction Examples for Learning Python ProgrammingInternational Journal of Artificial Intelligence in Education10.1007/s40593-020-00197-030:2(299-336)Online publication date: 17-Jun-2020
https://doi.org/10.1007/s40593-020-00197-0

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents