Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2659532.2659628acmotherconferencesArticle/Chapter ViewAbstractPublication PagescompsystechConference Proceedingsconference-collections
research-article

Online programming exercises for summative assessment in university courses

Published: 27 June 2014 Publication History

Abstract

Although interactive e-learning environments are increasingly used in university courses, traditional types of examination still dominate the way how students are assessed for grades. In this paper, we examined how student data from online interactive learning environment for programming exercises can be used for summative assessment at the end of the course. Using data from three different university courses, we calibrated the two parameter logistic regression model, ranked students according to their ability of solving problems, and matched them to final grades. Results indicate we can predict grades within 0.57 to 1.02 level of accuracy, suggesting that careful use of interactive e-learning environments in university courses can substitute existing assessment methods, opening further possibilities for innovation in instructional process.

References

[1]
Delev, T., Gjorgjevikj, D. (2012): E-Lab: Web Based System for Automatic Assessment of Programming Problems", Web proceedings ICT-Innovations, FYR Macedonia.
[2]
Dyke, G. (2011). Which aspects of novice programmers' usage of an IDE predict learning outcomes. ACM tech. symp. SIGCSE'11, ACM, pp. 505--510.
[3]
Gárcia-Mateos, G., Fernández-Alemán, J. L. (2009). A course on algorithms and data structures using on-line judging. ACM SIGCSE Bulletin, 41(3), ACM, pp. 45--49.
[4]
J. Helminen, P. Ihantola, V. Karavirta (2013). Recording and analyzing in-browser programming sessions. Koli Calling International Conference on Computing Education Research. Finland, ACM. pp. 13--22.
[5]
Ivanovic, M., Bogdanova, A. M., Milasinovic, B., Savic, M. & Bothe, K. (2013). TEL in teaching and learning programming: international experience. In B. Rachev & A. Smrikarov (eds.), CompSysTech'13. ACM, pp. 313--320.
[6]
Joy, M., Griffiths, N., Boyatt, R. (2005): The BOSS online submission and assessment system. ACM Journal of Educational Resources in Computing, 5(3):2.
[7]
Petit, J., Giménez, O., Roura, S. (2012): Jutge.org: an educational programming judge. ACM technical symposium SIGCSE '12. ACM, New York, USA, pp. 445--450.
[8]
Pribela, I., Ivanovic, M., Budimac, Z.(2009): Svetovid -- interactive development and submission system with prevention of academic collusion in computer programming. British Journal of Educational Technology, 40(6), pp. 1076--1093
[9]
Rodrigo, M. M. T., Baker, R. S., Jadud, M. C., Amarra, A. C. M., Dy, T., Espejo-Lahoz, M. B. V., Tabanao, E. S. (2009). Affective and behavioral predictors of novice programmer achievement. ACM SIGCSE Bulletin, 41(3), pp. 156--160.
[10]
Tvarožek, J. (2011). Bootstrapping a socially intelligent tutoring strategy. Information Sciences and Technologies Bulletin of the ACM Slovakia, 3(1): pp. 33--41.
[11]
Watson, C., Li, F. W. B., Godwin, J. L. (2013). Predicting Performance in an Introductory Programming Course by Logging and Analyzing Student Programming Behavior. Advanced Learning Technologies (ICALT'2013), IEEE, pp.319--323.
[12]
Watson, C., Li, F. W. B., Godwin, J. L. (2014). No tests required: comparing traditional and dynamic predictors of programming success. ACM tech. symp. SIGCSE'12, ACM, pp.469--474.
[13]
Woit, D., Mason, D. (2003). Effectiveness of online assessment. ACM SIGCSE Bulletin, 35(1), ACM, pp. 137--141.

Cited By

View all
  • (2022)A Collective Adaptive Approach to Decentralised k-Coverage in Multi-robot SystemsACM Transactions on Autonomous and Adaptive Systems10.1145/354714517:1-2(1-39)Online publication date: 7-Sep-2022
  • (2022)Industrial Control Systems Security via Runtime EnforcementACM Transactions on Privacy and Security10.1145/354657926:1(1-41)Online publication date: 9-Nov-2022
  • (2022)Adaptive Assessment and Content Recommendation in Online Programming Courses: On the Use of Elo-ratingACM Transactions on Computing Education10.1145/351188622:3(1-27)Online publication date: 9-Jun-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
CompSysTech '14: Proceedings of the 15th International Conference on Computer Systems and Technologies
June 2014
489 pages
ISBN:9781450327534
DOI:10.1145/2659532
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • UORB: University of Ruse, Bulgaria
  • Querbie: Querbie

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 June 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. interactive e-learning
  2. online learning environment
  3. programming exercises
  4. summative assessment
  5. technology enhanced learning

Qualifiers

  • Research-article

Funding Sources

  • ERDF

Conference

CompSysTech'14
Sponsor:
  • UORB
  • Querbie

Acceptance Rates

CompSysTech '14 Paper Acceptance Rate 56 of 107 submissions, 52%;
Overall Acceptance Rate 241 of 492 submissions, 49%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2022)A Collective Adaptive Approach to Decentralised k-Coverage in Multi-robot SystemsACM Transactions on Autonomous and Adaptive Systems10.1145/354714517:1-2(1-39)Online publication date: 7-Sep-2022
  • (2022)Industrial Control Systems Security via Runtime EnforcementACM Transactions on Privacy and Security10.1145/354657926:1(1-41)Online publication date: 9-Nov-2022
  • (2022)Adaptive Assessment and Content Recommendation in Online Programming Courses: On the Use of Elo-ratingACM Transactions on Computing Education10.1145/351188622:3(1-27)Online publication date: 9-Jun-2022
  • (2021)I Know What You Need: Investigating Document Retrieval Effectiveness with Partial Session ContextsACM Transactions on Information Systems10.1145/348866740:3(1-30)Online publication date: 17-Nov-2021
  • (2020)Web-Application Based System for Automated Testing of Network-Devices Configurations2020 18th International Conference on Emerging eLearning Technologies and Applications (ICETA)10.1109/ICETA51985.2020.9379191(154-159)Online publication date: 12-Nov-2020
  • (2020)A Systematic Literature Review of Methodology of Learning Evaluation Based on Item Response Theory in the Context of Programming Teaching2020 IEEE Frontiers in Education Conference (FIE)10.1109/FIE44824.2020.9274068(1-9)Online publication date: 21-Oct-2020
  • (2018)Data flow metrics in program comprehension tasksProceedings of the Workshop on Eye Movements in Programming10.1145/3216723.3216728(1-6)Online publication date: 15-Jun-2018
  • (2017)Automated Personalized Assessment of Computational Thinking MOOC Assignments2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT)10.1109/ICALT.2017.147(261-263)Online publication date: Jul-2017
  • (2016)Student-Generated Content Improves Online Learning of ProgrammingInternational Journal of Human Capital and Information Technology Professionals10.4018/IJHCITP.20161001067:4(79-92)Online publication date: 1-Oct-2016
  • (2016)Big Five Personality in Online Learning and GamesInternational Journal of Human Capital and Information Technology Professionals10.4018/IJHCITP.20160701037:3(33-46)Online publication date: 1-Jul-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media