research-article

Towards improving programming habits to create better computer science course outcomes

Authors:

Davide Fossati,

Kelly RiversAuthors Info & Claims

ITiCSE '13: Proceedings of the 18th ACM conference on Innovation and technology in computer science education

Pages 243 - 248

https://doi.org/10.1145/2462476.2465594

Published: 01 July 2013 Publication History

Abstract

We examine a large dataset collected by the Marmoset system in a CS2 course. The dataset gives us a richly detailed portrait of student behavior because it combines automatically collected program snapshots with unit tests that can evaluate the correctness of all snapshots. We find that students who start earlier tend to earn better scores, which is consistent with the findings of other researchers. We also detail the overall work habits exhibited by students. Finally, we evaluate how students use release tokens, a novel mechanism that provides feedback to students without giving away the code for the test cases used for grading, and gives students an incentive to start coding earlier. We find that students seem to use their tokens quite effectively to acquire feedback and improve their project score, though we do not find much evidence suggesting that students start coding particularly early.

References

[1]

A. Allevato, M. Thornton, S. H. Edwards, and M. A. Pérez-Quiñones. Mining data from an automated grading and testing system by adding rich reporting capabilities. In R. S. J. de Baker, T. Barnes, and J. E. Beck, editors, EDM, pages 167--176. www.educationaldatamining.org, 2008.

[2]

T. Beaubouef and J. Mason. Why the high attrition rate for computer science students: some thoughts and observations. SIGCSE Bull., 37(2):103--106, June 2005.

Digital Library

[3]

P. Blikstein. Using learning analytics to assess students' behavior in open-ended programming tasks. In Proceedings of the 1st International Conference on Learning Analytics and Knowledge, LAK '11, pages 110--116, New York, NY, USA, 2011. ACM.

Digital Library

[4]

N. S. Board. Science and engineering indicators digest 2012. 2012.

[5]

L. Carter. Why students with an apparent aptitude for computer science don't choose to major in computer science. SIGCSE Bull., 38(1):27--31, Mar. 2006.

Digital Library

[6]

S. H. Edwards. Using software testing to move students from trial-and-error to reflection-in-action. SIGCSE Bull., 36(1):26--30, Mar. 2004.

Digital Library

[7]

S. H. Edwards, J. Snyder, M. A. Pérez-Quinones, A. Allevato, D. Kim, and B. Tretola. Comparing effective and ineffective behaviors of student programmers. In Proceedings of the fifth international workshop on Computing education research workshop, ICER '09, pages 3--14, New York, NY, USA, 2009. ACM.

Digital Library

[8]

N. Falkner and K. Falkner. A fast measure for identifying at-risk students in computer science. In Proceedings of the ninth annual international conference on International computing education research, pages 55--62. ACM, 2012.

Digital Library

[9]

J. B. Fenwick, Jr., C. Norris, F. E. Barry, J. Rountree, C. J. Spicer, and S. D. Cheek. Another look at the behaviors of novice programmers. In Proceedings of the 40th ACM technical symposium on Computer science education, SIGCSE '09, pages 296--300, New York, NY, USA, 2009. ACM.

Digital Library

[10]

M. C. Jadud. A first look at novice compilation behaviour using bluej. Computer Science Education, 15:1--25, 2005.

[11]

J. Kasurinen and U. Nikula. Estimating programming knowledge with bayesian knowledge tracing. In Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education, ITiCSE '09, pages 313--317, New York, NY, USA, 2009. ACM.

Digital Library

[12]

M. McCracken, V. Almstrum, D. Diaz, M. Guzdial, D. Hagan, Y. B.-D. Kolikant, C. Laxer, L. Thomas, I. Utting, and T. Wilusz. A multi-national, multi-institutional study of assessment of programming skills of first-year cs students. SIGCSE Bull., 33(4):125--180, Dec. 2001.

Digital Library

[13]

C. Murphy, G. Kaiser, K. Loveland, and S. Hasan. Retina: helping students and instructors based on observed programming activities. In Proceedings of the 40th ACM technical symposium on Computer science education, SIGCSE '09, pages 178--182, New York, NY, USA, 2009. ACM.

Digital Library

[14]

P. C. of Advisors on Science and Technology. Designing a digital future: Federally funded research and development in networking and information technology. 2013.

[15]

N. A. of Colleges and Employers. Nace january 2013 salary survey. 2013.

[16]

J. Spacco, J. Strecker, D. Hovemeyer, and W. Pugh. Software repository mining with marmoset: an automated programming project snapshot and testing system. In Proceedings of the 2005 international workshop on Mining software repositories, MSR '05, pages 1--5, New York, NY, USA, 2005. ACM.

Digital Library

[17]

E. S. Tabanao, M. M. T. Rodrigo, and M. C. Jadud. Predicting at-risk novice java programmers through the analysis of online protocols. In Proceedings of the seventh international workshop on Computing education research, ICER '11, pages 85--92, New York, NY, USA, 2011. ACM.

Digital Library

[18]

I. Utting, N. Brown, M. Kölling, D. McCall, and P. Stevens. Web-scale data gathering with bluej. In Proceedings of the ninth annual international conference on International computing education research, ICER '12, pages 1--4, New York, NY, USA, 2012. ACM.

Digital Library

Cited By

Karnalim O(2024)Identifying AI Generated Code with Parallel KNN Weight Outlier DetectionAdvanced Technologies and the University of the Future10.1007/978-3-031-71530-3_29(459-470)Online publication date: 17-Dec-2024
https://doi.org/10.1007/978-3-031-71530-3_29
Karnalim O(2024)Work-In-Progress: Student Motivation on Gamification in Maintaining Programming EthicsTowards a Hybrid, Flexible and Socially Engaged Higher Education10.1007/978-3-031-53022-7_49(495-502)Online publication date: 7-Feb-2024
https://doi.org/10.1007/978-3-031-53022-7_49
Toba HKarnalim OJohan MTada TDjajalaksana YVivaldy T(2024)Inappropriate Benefits and Identification of ChatGPT Misuse in Programming Tests: A Controlled ExperimentTowards a Hybrid, Flexible and Socially Engaged Higher Education10.1007/978-3-031-51979-6_54(520-531)Online publication date: 1-Feb-2024
https://doi.org/10.1007/978-3-031-51979-6_54
Show More Cited By

Index Terms

Towards improving programming habits to create better computer science course outcomes
1. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Computing education programs
        Computer science education

Recommendations

Pseudocode vs. Compile-and-Run Prompts: Comparing Measures of Student Programming Ability in CS1 and CS2
ITiCSE 2023: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1

In college-level introductory computer science courses, the programming ability of students is often evaluated using pseudocode responses to prompts. However, this does not necessarily reflect modern programming practice in industry and academia, where ...
High School Calculus and Computer Science Course Taking as Predictors of Success in Introductory College Computer Science

Success in an introductory college computer science (CS) course encourages students to major and pursue careers in computer science and many other STEM fields, whereas weak performance is often a powerful deterrent. This article examines the role of ...
A Landscape Study of Computer Science Education in NYC: Early Findings and Implications for Policy and Practice
SIGCSE '18: Proceedings of the 49th ACM Technical Symposium on Computer Science Education

NYC's Computer Science for All (CS4All) is a 10-year, districtwide initiative aimed at providing high-quality computer science (CS) education to all NYC public school students. It aspires to greatly increase the number of students, teachers, and schools ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ITiCSE '13: Proceedings of the 18th ACM conference on Innovation and technology in computer science education

July 2013

384 pages

ISBN:9781450320788

DOI:10.1145/2462476

General Chair:
Janet Carter
University of Kent, UK
,
Program Chairs:
Ian Utting
University of Kent, UK
,
Alison Clear
Christchurch Polytechnic Institute of Technology, NZ

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Bilkent University: Bilkent University
SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITiCSE '13

Sponsor:

Bilkent University
SIGCSE

ITiCSE '13: Innovation and Technology in Computer Science Education conference 2013

July 1 - 3, 2013

Canterbury, England, UK

Acceptance Rates

ITiCSE '13 Paper Acceptance Rate 51 of 161 submissions, 32%;

Overall Acceptance Rate 552 of 1,613 submissions, 34%

Upcoming Conference

ITiCSE '25

Sponsor:
sigcse

Innovation and Technology in Computer Science Education

June 27 - July 2, 2025

Nijmegen , Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
426
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)2

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Karnalim O(2024)Identifying AI Generated Code with Parallel KNN Weight Outlier DetectionAdvanced Technologies and the University of the Future10.1007/978-3-031-71530-3_29(459-470)Online publication date: 17-Dec-2024
https://doi.org/10.1007/978-3-031-71530-3_29
Karnalim O(2024)Work-In-Progress: Student Motivation on Gamification in Maintaining Programming EthicsTowards a Hybrid, Flexible and Socially Engaged Higher Education10.1007/978-3-031-53022-7_49(495-502)Online publication date: 7-Feb-2024
https://doi.org/10.1007/978-3-031-53022-7_49
Toba HKarnalim OJohan MTada TDjajalaksana YVivaldy T(2024)Inappropriate Benefits and Identification of ChatGPT Misuse in Programming Tests: A Controlled ExperimentTowards a Hybrid, Flexible and Socially Engaged Higher Education10.1007/978-3-031-51979-6_54(520-531)Online publication date: 1-Feb-2024
https://doi.org/10.1007/978-3-031-51979-6_54
Poitras EDempsey DCrane BSimpson SSiegel A(2023)The Applications of Learning Analytics to Enhance Learning and Engagement in Introductory Programming InstructionPerspectives on Learning Analytics for Maximizing Student Outcomes10.4018/978-1-6684-9527-8.ch005(89-108)Online publication date: 24-Oct-2023
https://doi.org/10.4018/978-1-6684-9527-8.ch005
Hsueh NLai LTseng W(2023)Design of an Online Programming Platform and a Study on Learners’ Testing AbilityElectronics10.3390/electronics1222459612:22(4596)Online publication date: 10-Nov-2023
https://doi.org/10.3390/electronics12224596
Forden JGebhard ABrylow DChoppella VPhatak DLuxton-Reilly ACraig M(2023)Experiences with TA-Bot in CS1Proceedings of the ACM Conference on Global Computing Education Vol 110.1145/3576882.3617930(57-63)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3576882.3617930
Forden JGebhard ABrylow DDoyle MStephenson BDorn BSoh LBattestilli L(2023)Dynamic Rate Limiting with TA-Bot in CS1Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 210.1145/3545947.3576276(1330-1330)Online publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1145/3545947.3576276
Karnalim OSimon Chivers W(2023)Gamification to Help Inform Students About Programming Plagiarism and CollusionIEEE Transactions on Learning Technologies10.1109/TLT.2023.324389316:5(708-721)Online publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1109/TLT.2023.3243893
Karnalim OTan R(2023)High School Student Perspective of Programming Plagiarism and Collusion2023 IEEE World Engineering Education Conference (EDUNINE)10.1109/EDUNINE57531.2023.10102902(1-5)Online publication date: 12-Mar-2023
https://doi.org/10.1109/EDUNINE57531.2023.10102902
Karnalim OSimon Chivers W(2023)Reporting less coincidental similarity to educate students about programming plagiarism and collusionComputer Science Education10.1080/08993408.2023.217806334:3(442-472)Online publication date: 21-Feb-2023
https://doi.org/10.1080/08993408.2023.2178063
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents