research-article

The Effect of a Web-based Coding Tool with Automatic Feedback on Students' Performance and Perceptions

Authors:

Luciana Benotti,

Franco Bulgarelli,

Marcos J. GomezAuthors Info & Claims

SIGCSE '18: Proceedings of the 49th ACM Technical Symposium on Computer Science Education

Pages 2 - 7

https://doi.org/10.1145/3159450.3159579

Published: 21 February 2018 Publication History

Abstract

In this paper we do three things. First, we describe a web-based coding tool that is open-source, publicly available and provides formative feedback and assessment. Second, we compare several metrics on student performance in courses that use the tool versus courses that do not use it when learning to program in Haskell. We find that the dropout rates are significantly lower in those courses that use the tool at two different universities. Finally we apply the technology acceptance model to analyse students perceptions.

References

[1]

Valerie Barr and Deborah Trytten. 2016. Using Turing's craft CodeLab to support CS1 students as they learn to program. Association for Computing Machinery Inroads 7, 2 (2016), 67--75.

Digital Library

[2]

Peter Brusilovsky, Stephen Edwards, Amruth Kumar, Lauri Malmi, Luciana Benotti, Duane Buck, Petri Ihantola, Rikki Prince, Teemu Sirkiä, Sergey Sosnovsky, et al. 2014. Increasing Adoption of Smart Learning Content for Computer Science Education. In Proceedings of the Conference on Innovation & Technology in Computer Science Education (ITiCSE-WGR). ACM, 31--57.

Digital Library

[3]

M. Y. Chuttur. 2009. Overview of the Technology Acceptance Model: Origins, Developments and Future Directions. Sprouts: Working Papers on Information Systems 9, 37 (2009).

[4]

Koen Claessen and John Hughes. 2000. QuickCheck: A Lightweight Tool for Random Testing of Haskell Programs. In Proceedings of the International Conference on Functional Programming (ICFP). 268--279.

Digital Library

[5]

Alex Daniel Edgcomb, Frank Vahid, Roman Lysecky, Andre Knoesen, Rajeevan Amirtharajah, and Mary Lou Dorf. 2015. Student performance improvement using interactive textbooks: A three-university cross-semester analysis. American Society for Engineering Education.

[6]

Alex Gerdes, Bastiaan Heeren, Johan Jeuring, and L Thomas van Binsbergen. 2016. Ask-Elle: an adaptable programming tutor for Haskell giving automated feedback. International Journal of Artificial Intelligence in Education (2016), 1--36.

[7]

Alex Gerdes, Johan Jeuring, and Bastiaan Heeren. 2012. An interactive functional programming tutor. In Proceedings of the Conference on Innovation & Technology in Computer Science Education (ITiCSE). 250--255.

Digital Library

[8]

Petri Ihantola, Arto Vihavainen, Alireza Ahadi, Matthew Butler, Jürgen Börstler, Stephen H. Edwards, Essi Isohanni, et al. 2015. Educational Data Mining and Learning Analytics in Programming. In Proceedings of Innovation & Technology in Computer Science Education Conference (ITiCSE-WGR). ACM, 41--63.

Digital Library

[9]

Hieke Keuning, Johan Jeuring, and Bastiaan Heeren. 2016. Towards a Systematic Review of Automated Feedback Generation for Programming Exercises. In Proceedings of the Conference on Innovation & Technology in Computer Science Education (ITiCSE). ACM, 41--46.

Digital Library

[10]

Amruth N. Kumar. 2008. The Effect of Using Problem-solving Software Tutors on the Self-confidence of Female Students. Special Interest Group in Computer Science Education (SIGCSE) Bulletin 40, 1 (March 2008), 523--527.

Digital Library

[11]

Amruth N. Kumar. 2015. The Effectiveness of Visualization for Learning Expression Evaluation. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (SIGCSE '15). ACM, New York, NY, USA, 362--367.

Digital Library

[12]

Richard Lobb and Jenny Harlow. 2016. Coderunner: A Tool for Assessing Computer Programming Skills. ACM Inroads 7, 1 (Feb. 2016), 47--51.

Digital Library

[13]

Nick Parlante. 2017. CodingBat. http://codingbat.com. (2017). {Online; accessed 17-August-2017}.

[14]

Jaime Spacco, Paul Denny, Brad Richards, David Babcock, David Hovemeyer, James Moscola, and Robert Duvall. 2015. Analyzing Student Work Patterns Using Programming Exercise Data. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (SIGCSE '15). ACM, New York, NY, USA, 18--23.

Digital Library

[15]

Christopher Watson and Frederick W.B. Li. 2014. Failure Rates in Introductory Programming Revisited. In Proceedings of the Conference on Innovation & Technology in Computer Science Education (ITiCSE). 39--44.

Digital Library

Cited By

Strong GNorth BGillespie BFiori SWallace DBresnihan NMonga MLonati VBarendsen ESheard JPaterson J(2024)Experiences Trialling a Novel Block-to-text Environment in a Summer School ContextProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653585(150-156)Online publication date: 3-Jul-2024
https://dl.acm.org/doi/10.1145/3649217.3653585
Jefferson TGregg CPiech CStephenson BStone JBattestilli LRebelsky SShoop L(2024)PyodideU: Unlocking Python Entirely in a Browser for CS1Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630913(583-589)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3626252.3630913
Gulati RWest MZilles CSilva MStephenson BStone JBattestilli LRebelsky SShoop L(2024)Comparing the Security of Three Proctoring Regimens for Bring-Your-Own-Device ExamsProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630809(429-435)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3626252.3630809
Show More Cited By

Index Terms

The Effect of a Web-based Coding Tool with Automatic Feedback on Students' Performance and Perceptions
1. Applied computing
  1. Education
    1. Computer-assisted instruction

Recommendations

Exploring students' awareness and perceptions

This study investigates students' awareness and perceptions of m-learning and examines the factors affecting students' behavioral intention to adopt m-learning, by using a modified research model that integrate technology acceptance model (perceived ...
Students' perceptions of clickers as an instructional tool to promote active learning

The purpose of this study was to evaluate students' perceptions of clickers as an instructional tool to promote active learning in a Physical Geography undergraduate class. A convenience sample of 24 undergraduate students registered in a physical ...
A Study of Perceptions, Usability and Future Adoption of a Web-based Learning Tool

Studies of technology acceptance suggest that individuals' perceptions of usage might be antecedents to predict their adoption. This research study explored students' and professors' perceptions regarding a web-based tool for political science education;...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCSE '18: Proceedings of the 49th ACM Technical Symposium on Computer Science Education

February 2018

1174 pages

ISBN:9781450351034

DOI:10.1145/3159450

General Chairs:
Tiffany Barnes
North Carolina State University, USA
,
Daniel Garcia
University of California, Berkeley, USA
,
Program Chairs:
Elizabeth K. Hawthorne
Union County College, USA
,
Manuel A. Pérez-Quiñones
UNC Charlotte, USA

Copyright © 2018 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 February 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

PICT-2014-1833
PDTS-CIN-CONICET-2015-172

Conference

SIGCSE '18

Sponsor:

SIGCSE

SIGCSE '18: The 49th ACM Technical Symposium on Computer Science Education

February 21 - 24, 2018

Maryland, Baltimore, USA

Acceptance Rates

SIGCSE '18 Paper Acceptance Rate 161 of 459 submissions, 35%;

Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

Upcoming Conference

SIGCSE Virtual 2024

Sponsor:
sigcse

1st ACM Virtual Global Computing Education Conference

December 5 - 8, 2024

Virtual Event , NC , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
757
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)5

Reflects downloads up to 18 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Strong GNorth BGillespie BFiori SWallace DBresnihan NMonga MLonati VBarendsen ESheard JPaterson J(2024)Experiences Trialling a Novel Block-to-text Environment in a Summer School ContextProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653585(150-156)Online publication date: 3-Jul-2024
https://dl.acm.org/doi/10.1145/3649217.3653585
Jefferson TGregg CPiech CStephenson BStone JBattestilli LRebelsky SShoop L(2024)PyodideU: Unlocking Python Entirely in a Browser for CS1Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630913(583-589)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3626252.3630913
Gulati RWest MZilles CSilva MStephenson BStone JBattestilli LRebelsky SShoop L(2024)Comparing the Security of Three Proctoring Regimens for Bring-Your-Own-Device ExamsProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630809(429-435)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3626252.3630809
Silva DCarvalho DSilla C(2024)A Clustering-Based Computational Model to Group Students With Similar Programming Skills From Automatic Source Code Analysis Using Novel FeaturesIEEE Transactions on Learning Technologies10.1109/TLT.2023.327392617(428-444)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TLT.2023.3273926
Rocha HCosta ETedesco P(2023)Helping to provide adaptive feedback to novice programmers: a framework to assist the Teachers2023 18th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI58278.2023.10212000(1-6)Online publication date: 20-Jun-2023
https://doi.org/10.23919/CISTI58278.2023.10212000
Venigalla AChimalakonda S(2023)TAnnotator: Towards Annotating Programming E-textbooks with Facts and ExamplesSmart Learning Environments10.1186/s40561-023-00228-y10:1Online publication date: 25-Jan-2023
https://doi.org/10.1186/s40561-023-00228-y
Lusa Krug DZhang YMouza CBarnett TPollock LShepherd DLaakso MMonga MSimon Sheard J(2023)Using Domain-Specific, Immediate Feedback to Support Students Learning Computer Programming to Make MusicProceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 110.1145/3587102.3588851(368-374)Online publication date: 29-Jun-2023
https://dl.acm.org/doi/10.1145/3587102.3588851
Geng CXu WXu YPientka BSi XDoyle MStephenson BDorn BSoh LBattestilli L(2023)Identifying Different Student Clusters in Functional Programming AssignmentsProceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569882(750-756)Online publication date: 2-Mar-2023
https://dl.acm.org/doi/10.1145/3545945.3569882
Mitra JDoyle MStephenson BDorn BSoh LBattestilli L(2023)Studying the Impact of Auto-Graders Giving Immediate Feedback in Programming AssignmentsProceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569726(388-394)Online publication date: 2-Mar-2023
https://dl.acm.org/doi/10.1145/3545945.3569726
Joyse Barbosa Rocha Hde Barros Costa ECabral de Azevedo Restelli Tedesco P(2023)A Taxonomy to Assist TAs in Providing Adaptive Feedback to Novice Programmers2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343309(1-9)Online publication date: 18-Oct-2023
https://doi.org/10.1109/FIE58773.2023.10343309
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents