poster

Automatic vs manual assessment of programming tasks

Authors:

Vreda Pieterse,

Janet LiebenbergAuthors Info & Claims

Koli Calling '17: Proceedings of the 17th Koli Calling International Conference on Computing Education Research

Pages 193 - 194

https://doi.org/10.1145/3141880.3141912

Published: 16 November 2017 Publication History

Get Access

Abstract

Lecturers are struggling to keep up with their daily responsibilities because of an ever-increasing workload. Manual programming assessment processes are time-consuming, but a possible solution is to use the assistance of automatic programming assessment methods. In this study, automatic assessment is compared with manual assessment, specifically for programming tasks. The paper concludes that an automatic assessment tool seems to be less feasible for practical tests and exams, but shows promise for the assessment of programs written during practical lab sessions.

References

[1]

Sara Mernissi Arifi, Ismail Nait Abdellah, Azeddine Zahi, and Rachid Benabbou. 2015. Automatic program assessment using static and dynamic analysis. In 2015 Third World Conference on Complex Systems (WCCS). 1--6.

Crossref

Google Scholar

[2]

J Martin Bland and Douglas G Altman. 1986. Statistical methods for assessing agreement between two methods of clinical measurement. The lancet 327, 8476 (1986), 307--310.

Crossref

Google Scholar

[3]

Vincenzo Del Fatto, Gabriella Dodero, Rosella Gennari, Benjamin Gruber, Sven Helmer, and Guerriero Raimato. 2018. Automating Assessment of Exercises as Means to Decrease MOOC Teachers' Efforts. Springer International Publishing. Cham, 201--208.

Crossref

Google Scholar

[4]

Andrew Luxton-Reilly and Andrew Petersen. 2017. The Compound Nature of Novice Programming Assessments. In Proceedings of the Nineteenth Australasian Computing Education Conference (ACE '17). ACM, New York, NY, USA, 26--35.

Digital Library

Google Scholar

[5]

Ásrún Matthíasdóttir and Hallgrímur Arnalds. 2015. Rethinking Teaching and Assessing in a Programming Course a Case Study. In Proceedings of the 16th International Conference on Computer Systems and Technologies (CompSysTech '15). ACM, New York, NY, USA, 313--318.

Digital Library

Google Scholar

[6]

Vreda Pieterse. 2013. Automated Assessment of Programming Assignments. In Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education Research (CSERC '13). Open Universiteit, Heerlen. Open Univ., Heerlen, The Netherlands, The Netherlands, Article 4, 12 pages. http://dl.acm.org/citation.cfm?id=2541917.2541921

Digital Library

Google Scholar

[7]

Thomas Staubitz, Hauke Klement, Ralf Teusner, Jan Renz, and Christoph Meinel. 2015. Towards practical programming exercises and automated assessment in Massive Open Online Courses. In 2015 IEEE International Conference on Teaching. Assessment, and Learning for Engineering (TALE). 23--30.

Crossref

Google Scholar

[8]

Thomas Staubitz, Hauke Klement, Ralf Teusner, Jan Renz, and Christoph Meinel. 2016. CodeOcean - A versatile platform for practical programming excercises in online environments. In 2016 IEEE Global Engineering Education Conference (EDUCON). 314--323.

Crossref

Google Scholar

Cited By

View all

Kristiansen NNicolajsen SBrabrand C(2023)Feedback on Student Programming Assignments: Teaching Assistants vs Automated Assessment ToolProceedings of the 23rd Koli Calling International Conference on Computing Education Research10.1145/3631802.3631804(1-10)Online publication date: 13-Nov-2023
https://dl.acm.org/doi/10.1145/3631802.3631804
Doorn NVos TMarín BBarendsen E(2023)Set the right example when teaching programming: Test Informed Learning with Examples (TILE)2023 IEEE Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST57152.2023.00033(269-280)Online publication date: Apr-2023
https://doi.org/10.1109/ICST57152.2023.00033
Liebenberg J(2023)Automatic Programming Assessment SystemsNetworks and Systems in Cybernetics10.1007/978-3-031-35317-8_56(615-628)Online publication date: 15-Jul-2023
https://doi.org/10.1007/978-3-031-35317-8_56
Show More Cited By

Index Terms

Automatic vs manual assessment of programming tasks
1. Applied computing
  1. Education
    1. Computer-assisted instruction
    2. Interactive learning environments

Recommendations

Automated Assessment of Programming Assignments
CSERC '13: Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education Research

This is a position paper in which I argue that massive open online programming courses can benefit by the application of automated assessment of programming assignments.

I gathered success factors and identified concerns related to automatic assessment ...
Formative computer based assessment in diagram based domains

This paper presents an approach to conducting formative assessment of student coursework within diagram-based domains using Computer Based Assessment (CBA) technology. Formative assessment is perceived as a resource-intensive assessment mode and its ...
Formative computer based assessment in diagram based domains
ITICSE '06: Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education

This paper presents an approach to conducting formative assessment of student coursework within diagram-based domains using Computer Based Assessment (CBA) technology. Formative assessment is perceived as a resource-intensive assessment mode and its ...

Comments

Information & Contributors

Information

Published In

Koli Calling '17: Proceedings of the 17th Koli Calling International Conference on Computing Education Research

November 2017

215 pages

ISBN:9781450353014

DOI:10.1145/3141880

Conference Chairs:
Calkin Suero Montero
University of Eastern Finland, Finland
,
Mike Joy
University of Warwick, United Kingdom

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2017

Check for updates

Author Tags

Qualifiers

Poster

Conference

Koli Calling 2017

Sponsor:

Univ. Eastern Finland
University of Warwick
Joensuu University Foundation

Koli Calling 2017: 17th Koli Calling International Conference on Computing Education Research

November 16 - 19, 2017

Koli, Finland

Acceptance Rates

Overall Acceptance Rate 80 of 182 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
209
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)2

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kristiansen NNicolajsen SBrabrand C(2023)Feedback on Student Programming Assignments: Teaching Assistants vs Automated Assessment ToolProceedings of the 23rd Koli Calling International Conference on Computing Education Research10.1145/3631802.3631804(1-10)Online publication date: 13-Nov-2023
https://dl.acm.org/doi/10.1145/3631802.3631804
Doorn NVos TMarín BBarendsen E(2023)Set the right example when teaching programming: Test Informed Learning with Examples (TILE)2023 IEEE Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST57152.2023.00033(269-280)Online publication date: Apr-2023
https://doi.org/10.1109/ICST57152.2023.00033
Liebenberg J(2023)Automatic Programming Assessment SystemsNetworks and Systems in Cybernetics10.1007/978-3-031-35317-8_56(615-628)Online publication date: 15-Jul-2023
https://doi.org/10.1007/978-3-031-35317-8_56
Chean SHo SChai ITan CTeh SAhmad N(2021)The Programming Learning Assessment Model for Measuring Student PerformanceComputational Science and Technology10.1007/978-981-33-4069-5_14(153-165)Online publication date: 16-Mar-2021
https://doi.org/10.1007/978-981-33-4069-5_14
Hazzan ORagonis NLapidot THazzan ORagonis NLapidot T(2020)AssessmentGuide to Teaching Computer Science10.1007/978-3-030-39360-1_13(279-303)Online publication date: 6-Aug-2020
https://doi.org/10.1007/978-3-030-39360-1_13
Insa DPérez SSilva JTamarit S(2020)Semiautomatic generation and assessment of Java exercises in engineering educationComputer Applications in Engineering Education10.1002/cae.2235629:5(1034-1050)Online publication date: 30-Oct-2020
https://doi.org/10.1002/cae.22356
Lokar M(2019)Project TomoProceedings of the 8th Computer Science Education Research Conference10.1145/3375258.3375276(123-124)Online publication date: 18-Nov-2019
https://dl.acm.org/doi/10.1145/3375258.3375276
Ho SChean SChai ITan C(2019)Engineering Meaningful Computing Education: Programming Learning Experience Model2019 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM)10.1109/IEEM44572.2019.8978920(925-929)Online publication date: Dec-2019
https://doi.org/10.1109/IEEM44572.2019.8978920

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Automated Assessment of Programming Assignments

Formative computer based assessment in diagram based domains

Formative computer based assessment in diagram based domains