Article

Free access

Improving on-line assessment: an investigation of existing marking methodologies

Authors:

Russell ShackelfordAuthors Info & Claims

ITiCSE '99: Proceedings of the 4th annual SIGCSE/SIGCUE ITiCSE conference on Innovation and technology in computer science education

Pages 29 - 32

https://doi.org/10.1145/305786.305840

Published: 27 June 1999 Publication History

PDF eReader

Abstract

We are in the process of developing an on-line marking system for use in our large-scale CS1 and CS2 courses. To better accommodate the needs of our numerous raters, we investigated their current methodologies in marking students' work; this paper presents our findings from recording "think out loud" marking sessions and surveys. A prototype for an on-line assessment software tool is described; this tool allows markers to view students' work at various degrees of detail ranging from complete, low-level to "meta-level." We believe such a system is beneficial for improving the marking process in large-scale and distance classes.

References

[1]

Canup, M and Shackelford, R. Using Software to Solve Problems in Large Computing Courses. SIGSCE Bulletin: '98 Technical Symposium (Atlanta, Georgia) ACM, New York. March, 1998. 135-139.

Digital Library

Google Scholar

[2]

Dawson-Howe K. Automatic Submission and Admirfistration of Programming Assignments. SIGSCE Bulletin, 27, 4 (December 1995), 51-53.

Digital Library

Google Scholar

[3]

East, Philip J. Including Quality Assessment in Programming Instruction. In Conference Proceedings of National Educational Computing Conference '98 (San Diego, CA) ISTE, Eugene, OR. June 1998.

Google Scholar

[4]

Hopkins, Kenneth D. Educational and Psychological Measurement and Evaluation. Allyrt & Bacon, Boston, 1998. 1-15.

Google Scholar

[5]

Nicholson, A et al. Computer Assisted Assessment. Summary from the 1994 TLTP Conference held at Cardiff. icbl.hw.ac.uk/tltp/conferences/cardiff94.html

Google Scholar

[6]

Preston, J. Evaluation software: improving consistency and reliability of performance rating. In Proceedings of lTiCSE '97 (Uppsala, Sweden) ACM, New York. June 1997.

Digital Library

Google Scholar

[7]

Preston, J. and Shackelford, R. A System for Improving Distance and Large-Scale Classes. In Proceedings of 1TiCSE '98 (Dublin, Ireland) ACM, New York. August 1998.

Digital Library

Google Scholar

[8]

Price, B. and Petre, M. Teaching Programming through Paperless Assignments: an empirical evaluation of instructor feedback. In Proceedings of 1TiCSE '97 (Uppsala, Sweden) ACM, New York. June 1997, 94-98.

Digital Library

Google Scholar

[9]

Toothman, B and Shackelford, R. The Effects of Partially-Individualized Assignments on Subsequent Student Performance. SIGSCE Bulletin: '98 Technical Symposium (Atlanta, Georgia) ACM, New York. March, 1998. 287-291.

Digital Library

Google Scholar

Cited By

View all

Liu X(2010)A new automated grading approach for computer programmingComputer Applications in Engineering Education10.1002/cae.2049421:3(484-490)Online publication date: 18-Oct-2010
https://doi.org/10.1002/cae.20494
Shaw S(2008)Essay Marking on-Screen: Implications for Assessment ValidityE-Learning and Digital Media10.2304/elea.2008.5.3.2565:3(256-274)Online publication date: 1-Jan-2008
https://doi.org/10.2304/elea.2008.5.3.256
Plimmer BApperley MApperley M(2007)Making paperless workProceedings of the 8th ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: design centered HCI10.1145/1278960.1278961(1-8)Online publication date: 2-Jul-2007
https://dl.acm.org/doi/10.1145/1278960.1278961
Show More Cited By

Index Terms

Improving on-line assessment: an investigation of existing marking methodologies
1. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Computing education programs
        Computer science education
        Information science education

Recommendations

Improving on-line assessment: an investigation of existing marking methodologies

We are in the process of developing an on-line marking system for use in our large-scale CS1 and CS2 courses. To better accommodate the needs of our numerous raters, we investigated their current methodologies in marking students' work; this paper ...
Replicating a Validated CS1 Assessment (Abstract Only)
SIGCSE '16: Proceedings of the 47th ACM Technical Symposium on Computing Science Education

Validated assessments are important for teachers and researchers. A validated assessment is carefully developed to make sure that it is measuring the right things. Computing education needs more and better validated assessments. Validated assessments ...
Retracted on September 22, 2021: TA Marking Parties: Worth the Price of Pizza?
ICER '18: Proceedings of the 2018 ACM Conference on International Computing Education Research

NOTICE OF RETRACTION: This work has been retracted at the request of the authors as it contains some potentially misleading information. The retracted Work remains in the ACM Digital Library for archiving purposes only and should not be used for further ...

Comments

Information & Contributors

Information

Published In

ITiCSE '99: Proceedings of the 4th annual SIGCSE/SIGCUE ITiCSE conference on Innovation and technology in computer science education

June 1999

214 pages

ISBN:1581130872

DOI:10.1145/305786

Chairmen:
Carl Erickson
Grand Valley State Univ.
,
Tadeusz Wilusz
Cracow Univ. of Economics, Poland
,
Mats Daniels
Uppsala Univ., Sweden
,
Renée McCauley
Univ. of Southwestern Louisiana
,
Editor:
Bill Manaris
Univ. of Southwestern Louisiana

ACM SIGCSE Bulletin Volume 31, Issue 3
Sept. 1999
212 pages
ISSN:0097-8418
DOI:10.1145/384267
Editor:
John Impagliazzo
Hofstra Univ., Hempstead, NY
Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 June 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ITiCSE99

Sponsor:

ITiCSE99: Innovation and Technology in Computer Science Education

June 27 - 30, 1999

Cracow, Poland

Acceptance Rates

Overall Acceptance Rate 552 of 1,613 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
586
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)17

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liu X(2010)A new automated grading approach for computer programmingComputer Applications in Engineering Education10.1002/cae.2049421:3(484-490)Online publication date: 18-Oct-2010
https://doi.org/10.1002/cae.20494
Shaw S(2008)Essay Marking on-Screen: Implications for Assessment ValidityE-Learning and Digital Media10.2304/elea.2008.5.3.2565:3(256-274)Online publication date: 1-Jan-2008
https://doi.org/10.2304/elea.2008.5.3.256
Plimmer BApperley MApperley M(2007)Making paperless workProceedings of the 8th ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: design centered HCI10.1145/1278960.1278961(1-8)Online publication date: 2-Jul-2007
https://dl.acm.org/doi/10.1145/1278960.1278961
Plimmer BMason P(2006)A pen-based paperless environment for annotating and marking student assignmentsProceedings of the 7th Australasian User interface conference - Volume 5010.5555/1151758.1151762(37-44)Online publication date: 1-Jan-2006
https://dl.acm.org/doi/10.5555/1151758.1151762
Noonan R(2006)The back end of a grading systemACM SIGCSE Bulletin10.1145/1124706.112136038:1(56-60)Online publication date: 3-Mar-2006
https://dl.acm.org/doi/10.1145/1124706.1121360
Noonan RBaldwin DTymann PHaller SRussell I(2006)The back end of a grading systemProceedings of the 37th SIGCSE technical symposium on Computer science education10.1145/1121341.1121360(56-60)Online publication date: 3-Mar-2006
https://dl.acm.org/doi/10.1145/1121341.1121360
Truong NRoe PBancroft P(2005)Automated feedback for "fill in the gap" programming exercisesProceedings of the 7th Australasian conference on Computing education - Volume 4210.5555/1082424.1082439(117-126)Online publication date: 1-Jan-2005
https://dl.acm.org/doi/10.5555/1082424.1082439
Zhang JHeinrich E(2005)A System Designed to Support Formative Assessment of Open-Ended Written AssignmentsProceedings of the Fifth IEEE International Conference on Advanced Learning Technologies10.1109/ICALT.2005.29(88-92)Online publication date: 5-Jul-2005
https://dl.acm.org/doi/10.1109/ICALT.2005.29
Roberts GVerbyla J(2003)An online programming assessment toolProceedings of the fifth Australasian conference on Computing education - Volume 2010.5555/858403.858412(69-75)Online publication date: 1-Jan-2003
https://dl.acm.org/doi/10.5555/858403.858412
Heo MBrewer JMendonca J(2003)A learning and assessment tool for web-based distributed educationProceedings of the 4th conference on Information technology curriculum10.1145/947121.947156(151-154)Online publication date: 16-Oct-2003
https://dl.acm.org/doi/10.1145/947121.947156
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Improving on-line assessment: an investigation of existing marking methodologies

Replicating a Validated CS1 Assessment (Abstract Only)

Retracted on September 22, 2021: TA Marking Parties: Worth the Price of Pizza?