research-article

How Tool Support and Peer Scoring Improved Our Students' Attitudes Toward Peer Reviews

Authors:

Daniel Toll,

Anna WingkvistAuthors Info & Claims

ITiCSE '17: Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education

Pages 311 - 316

https://doi.org/10.1145/3059009.3059059

Published: 28 June 2017 Publication History

Get Access

Abstract

We wanted to introduce peer reviews for the final report in a course on Software Testing. The students had however experienced issues with peer reviews in a previous course which made this a challenge. To get a better understanding of the situation, we distributed a pre-questionnaire to the students. 48 of the 83 students provided their expectations on peer reviews. To deal with some of the perceived issues, we developed a peer review tool where we introduce anonymity, grading of reviews, teacher interventions, as well as let students score and comment on the reviews they receive. In total, 67 reports were submitted by 83 students and 325 reviews were completed. The post-questionnaire was answered by 48 students (not necessarily the same respondents as for the pre-questionnaire as both were collected anonymously). While 27 of the students expected incorrect feedback only 13 students agreed to have got incorrect feedback in the post-questionnaire. The students reported that they found the feedback from their peers more valuable (+15%) than expected, and 88% of the students reported that they learned from doing peer reviews. Overall, we find that the students' attitudes towards peer reviews have improved.

References

[1]

Christine Bauer, Kathrin Figl, Michael Derntl, Peter Paul Beran, and Sonja Kabicher. 2009. The Student View on Online Peer Reviews. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE '09). 26--30.

Digital Library

Google Scholar

[2]

N. Falchikov. 2007. The place of peers in learning and assessment. In D. Boud and N. Falchikov, editors, Rethinking Assessment in Higher Education: Learning for the Longer Term. Routledge.

Google Scholar

[3]

John Hamer, Kenneth T. K. Ma, and Hugh H. F. Kwong. 2005. A Method of Automatic Grade Calibration in Peer Assessment. In Proceedings of the 7th Australasian Conference on Computing Education - Volume 42 (ACE '05). 67--72.

Digital Library

Google Scholar

[4]

Barbara Moskal, Keith Miller, and Laurie A. Smith King. 2002. Grading Essays in Computer Ethics: Rubrics Considered Helpful. In Proceedings of the 33rd SIGCSE technical symposium on Computer science education (SIGCSE '02). 101--105.

Digital Library

Google Scholar

[5]

Paul Orsmond, Stephen Merry, and Kevin Reiling. 1996. The Importance of Marking Criteria in the Use of Peer Assessment. Assessment & Evaluation in Higher Education 21, 3 (1996), 239--250.

Crossref

Google Scholar

[6]

Joanna Smith, Joe Tessler, Elliot Kramer, and Calvin Lin. 2012. Using Peer Review to Teach Software Testing. In Proceedings of the Ninth Annual International Conference on International Computing Education Research (ICER '12). 93--98.

Digital Library

Google Scholar

[7]

Harald Sondergaard. 2009. Learning from and with Peers: The Different Roles of Student Peer Reviewing. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE '09). 31--35.

Digital Library

Google Scholar

[8]

Scott A. Turner and Manuel A. Pérez-Quiñones. 2009. Exploring Peer Review in the Computer Science Classroom. ArXiv e-prints (July 2009). arXiv:cs.CY/0907.3456

Google Scholar

Cited By

View all

Alipour SElahimanesh SJahanzad SMohammadi IMorassafar PNeshaei STefagh M(2024)Improving Grading Fairness and Transparency with Decentralized Collaborative Peer AssessmentProceedings of the ACM on Human-Computer Interaction10.1145/36373508:CSCW1(1-24)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637350
Chang CHuang K(2024)A multiple mediation model of thinking style, student assessors’ online assessment performance, and critical thinking in online assessment environmentEducation and Information Technologies10.1007/s10639-024-13044-9Online publication date: 13-Sep-2024
https://doi.org/10.1007/s10639-024-13044-9

Index Terms

How Tool Support and Peer Scoring Improved Our Students' Attitudes Toward Peer Reviews
1. Applied computing
  1. Education
    1. Computer-assisted instruction
    2. E-learning
2. Software and its engineering
  1. Software creation and management

Recommendations

Student attitudes and motivation for peer review in CS2
SIGCSE '11: Proceedings of the 42nd ACM technical symposium on Computer science education

Computer science students need experience with essential concepts and professional activities. Peer review is one way to meet these goals. In this work, we examine the students' attitudes towards and engagement in the peer review process, in early, ...
A study of college students' attitudes toward computers
Peer Grading Without Protest: The SPARK Approach to Summative Peer Assessment
SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education - Volume 1

As Computer Science Professors, we strive to construct courses that maximally support and contribute to student learning through carefully crafted in-class and out-of-class activities. There is evidence that homework enhances student learning, and that ...

Comments

Information & Contributors

Information

Published In

ITiCSE '17: Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education

June 2017

412 pages

ISBN:9781450347044

DOI:10.1145/3059009

Conference Chairs:
Renzo Davoli
University of Bologna, Italy
,
Michael Goldweber
Xavier University, USA
,
Program Chairs:
Guido Rößling
Technische Universität Darmstadt, Germany
,
Irene Polycarpou
University of Central Lancashire, Cyprus

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITiCSE '17

Sponsor:

SIGCSE

ITiCSE '17: Innovation and Technology in Computer Science Education

July 3 - 5, 2017

Bologna, Italy

Acceptance Rates

ITiCSE '17 Paper Acceptance Rate 56 of 175 submissions, 32%;

Overall Acceptance Rate 552 of 1,613 submissions, 34%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
128
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alipour SElahimanesh SJahanzad SMohammadi IMorassafar PNeshaei STefagh M(2024)Improving Grading Fairness and Transparency with Decentralized Collaborative Peer AssessmentProceedings of the ACM on Human-Computer Interaction10.1145/36373508:CSCW1(1-24)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637350
Chang CHuang K(2024)A multiple mediation model of thinking style, student assessors’ online assessment performance, and critical thinking in online assessment environmentEducation and Information Technologies10.1007/s10639-024-13044-9Online publication date: 13-Sep-2024
https://doi.org/10.1007/s10639-024-13044-9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Student attitudes and motivation for peer review in CS2

A study of college students' attitudes toward computers

Peer Grading Without Protest: The SPARK Approach to Summative Peer Assessment