research-article

On the way to a test instrument for object-oriented programming competencies

Authors:

Matthias Kramer,

David A. Tobinski,

Torsten BrindaAuthors Info & Claims

Koli Calling '16: Proceedings of the 16th Koli Calling International Conference on Computing Education Research

Pages 145 - 149

https://doi.org/10.1145/2999541.2999544

Published: 24 November 2016 Publication History

Abstract

Modeling and assessing competencies in computer science education is still an up to date topic. Especially regarding object-oriented programming the research data leaves room for further investigations. Based on an existing competency structure model, a first version of a test has been developed, to assess students' abilities to recognize elements of object-oriented programming in given source code. The results lead into the direction that novices tend to search for keywords while more experienced individuals recognize patterns via code structure. Relying on these results, ideas for further item types are presented.

References

[1]

B. Adelson. Problem solving and the development of abstract categories in programming languages. Memory & cognition, 9(4):422--433, 1981.

[2]

J. R. Anderson and K. Gluck. What role do cognitive architectures play in intelligent tutoring systems. Cognition & Instruction: Twenty-five years of progress, pages 227--262, 2001.

[3]

D. J. Armstrong. The quarks of object-oriented development. Communications of the ACM, 49(2):123--128, 2006.

Digital Library

[4]

D. J. Barnes and M. Kölling. Objects First with Java: A Practical Introduction Using BlueJ: International Edition. Pearson Higher Education, 5 edition, 2012.

Digital Library

[5]

M. Berges and P. Hubwieser. Evaluation of Source Code with Item Response Theory. In Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education, pages 51--56. ACM, 2015.

Digital Library

[6]

T. Bond and C. Fox. Applying the Rasch model: Fundamental measurement in the social sciences, 2001.

[7]

R. Brickenkamp and E. Zillmer. The d2 test of attention. Hogrefe & Huber Pub, 1998.

[8]

W. G. Chase and H. A. Simon. The mind's eye in chess. In W. G. Chase, editor, Visual information processing. Academic, New York, 1973.

[9]

P. Denny, A. Luxton-Reilly, and B. Simon. Evaluating a new exam question: Parsons problems. In Proceedings of the fourth international workshop on computing education research, pages 113--124. ACM, 2008.

Digital Library

[10]

S. Embretson and S. Reise. Item response theory for psychologists. Lawrence Elbaum Associate Publishers, London, 2000.

[11]

W. T. Fitch and A. D. Friederici. Artificial grammar learning meets formal language theory: an overview. Phil. Trans. R. Soc. B, 367(1598):1933--1955, 2012.

[12]

J. Hartig and A. Frey. Benefits and limitations of modeling competencies by means of Item Response Theory (IRT). Zeitschrift für Erziehungswissenschaft, 16:47--51, 2013.

[13]

M. Havenga, E. Mentz, and R. De Villiers. Knowledge, skills and strategies for successful object-oriented programming: a proposed learning repertoire. South African Computer Journal: SACLA 2008: Special Edition 42, pages 1--8, 2008.

[14]

E. Klieme, J. Hartig, and D. Rauch. The Concept of Competence in Educational Contexts. In J. Hartig, E. Klieme, and D. Leutner, editors, Assessment of competencies in educational contexts, pages 3--22. Hogrefe & Huber Publishers, Toronto, 2008.

[15]

E. Klieme, D. Leutner, M. Kenk, et al. Kompetenzmodellierung. Zwischenbilanz des DFG-Schwerpunktprogramms und Perspektiven des Forschungsansatzes. Weinheim; Basel: Beltz, 2010.

[16]

K. Koeppen, J. Hartig, E. Klieme, and D. Leutner. Current issues in competence modeling and assessment. Zeitschrift für Psychologie/Journal of Psychology, 216(2):61--73, 2008.

[17]

K. Kotovsky, J. R. Hayes, and H. A. Simon. Why are some problems hard? Evidence from Tower of Hanoi. Cognitive psychology, 17(2):248--294, 1985.

[18]

M. Kramer, P. Hubwieser, and T. Brinda. A Competency Structure Model of Object-Oriented Programming. In International Conference on Learning and Teaching in Computing and Engineering (LaTiCE), 2016, pages 1--8. IEEE, (in press).

[19]

M. Kramer, D. A. Tobinski, and T. Brinda. Modelling Competency in the Field of OOP: From Investigating Computer Science Curricula to Developing Test Items. In Stakeholders and Information Technology in Education (SaITE), 2016. IEEE, (in press).

[20]

B. Linck, L. Ohrndorf, S. Schubert, P. Stechert, J. Magenheim, W. Nelles, J. Neugebauer, and N. Schaper. Competence model for informatics modelling and system comprehension. In Global Engineering Education Conference (EDUCON), 2013 IEEE, pages 85--93. IEEE, 2013.

[21]

M. M. Louwerse. Symbol interdependency in symbolic and embodied cognition. Topics in Cognitive Science, 3(2):273--302, 2011.

[22]

G. F. Luger and M. A. Bauer. Transfer effects in isomorphic problem situations. Acta Psychologica, 42(2):121--131, 1978.

[23]

P. Mair and R. Hatzinger. Extended Rasch modeling: The eRm package for the application of IRT models in R. 2007.

[24]

I. Milne and G. Rowe. Difficulties in learning and teaching programming-views of students and tutors. Education and Information technologies, 7(1):55--66, 2002.

Digital Library

[25]

A. Mühling, P. Hubwieser, and M. Berges. Dimensions of Programming Knowledge, pages 32--44. Springer International Publishing, Cham, 2015.

[26]

A. Mühling, A. Ruf, and P. Hubwieser. Design and First Results of a Psychometric Test for Measuring Basic Programming Abilities. In Proceedings of the Workshop in Primary and Secondary Computing Education, WiPSCE '15, pages 2--10, New York, NY, USA, 2015. ACM.

Digital Library

[27]

A. Schäfer, R. Brück, S. Büchner, S. Jaschke, S. Schubert, D. Fey, B. Kleinert, and H. Schmidt. The Empirically Refined Competence Structure Model for Embedded Micro- and Nanosystems. In Proceedings of the 17th ACM Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE '12, pages 57--62, New York, NY, USA, 2012. ACM.

Digital Library

[28]

F. Waldow. What PISA did and did not do: Germany after the 'PISA-shock'. European Educational Research Journal, 8(3):476--483, 2009.

[29]

F. E. Weinert. Concept of competence: A conceptual clarification. In D. S. Rychen and L. Salganik, editors, Defining and Selecting Key Competencies, pages 45--65. Hogrefe and Huber, Seattle, 2001.

[30]

D. J. Weiss and G. Kingsbury. Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21(4):361--375, 1984.

Cited By

Barkmin MBrinda T(2020)Analysis of Programming Assessments — Building an Open Repository for Measuring CompetenciesProceedings of the 20th Koli Calling International Conference on Computing Education Research10.1145/3428029.3428039(1-10)Online publication date: 19-Nov-2020
https://dl.acm.org/doi/10.1145/3428029.3428039
Mühling ASchulte CBennedsen JBudde LGroße-Bölting GIhantola PFalkner N(2019)Assessing students' understanding of object structuresProceedings of the 19th Koli Calling International Conference on Computing Education Research10.1145/3364510.3364511(1-10)Online publication date: 21-Nov-2019
https://dl.acm.org/doi/10.1145/3364510.3364511
Kramer MBarkmin MBrinda TScharlau BMcDermott RPears ASabin M(2019)Identifying Predictors for Code Highlighting SkillsProceedings of the 2019 ACM Conference on Innovation and Technology in Computer Science Education10.1145/3304221.3319745(367-373)Online publication date: 2-Jul-2019
https://dl.acm.org/doi/10.1145/3304221.3319745
Show More Cited By

Index Terms

On the way to a test instrument for object-oriented programming competencies
1. Social and professional topics
  1. Professional topics
    1. Computing education

Recommendations

What Is Object-Oriented Programming?

The meaning of the term 'object oriented' is examined in the context of the general-purpose programming language C++. This choice is made partly to introduce C++ and partly because C++ is one of the few languages that supports data abstraction, object-...
A Domain-Theoretic Model Of Nominally-Typed Object-Oriented Programming

The majority of contemporary mainstream object-oriented (OO) software is written using nominally-typed OO programming languages. Extant domain-theoretic models of OOP developed to analyze OO type systems miss crucial features of these mainstream OO ...
Syntax to Syntax: Assessment of Orthogonality in the Design of Object-oriented Programming Languages using Code Listing Method
ICSIM '21: Proceedings of the 2021 4th International Conference on Software Engineering and Information Management

The Object-oriented programming (OOP) is the undoubted language that becomes the widely accepted and the most powerful way in the creation of a software product. Here the four pillars of the OOP like encapsulation, data abstraction, polymorphism and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

Koli Calling '16: Proceedings of the 16th Koli Calling International Conference on Computing Education Research

November 2016

189 pages

ISBN:9781450347709

DOI:10.1145/2999541

Conference Chairs:
Judy Sheard
Monash University, Australia
,
Calkin Suero Montero
University of Eastern Finland, Finland

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Univ. Eastern Finland: University of Eastern Finland
Univ. Turku: University of Turku
Monash University, Australia: Monash University, Australia

In-Cooperation

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Koli Calling 2016

Sponsor:

Univ. Eastern Finland
Univ. Turku
Monash University, Australia

Koli Calling 2016: 16th Koli Calling International Conference on Computing Education Research

November 24 - 27, 2016

Koli, Finland

Acceptance Rates

Koli Calling '16 Paper Acceptance Rate 21 of 57 submissions, 37%;

Overall Acceptance Rate 80 of 182 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
172
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Barkmin MBrinda T(2020)Analysis of Programming Assessments — Building an Open Repository for Measuring CompetenciesProceedings of the 20th Koli Calling International Conference on Computing Education Research10.1145/3428029.3428039(1-10)Online publication date: 19-Nov-2020
https://dl.acm.org/doi/10.1145/3428029.3428039
Mühling ASchulte CBennedsen JBudde LGroße-Bölting GIhantola PFalkner N(2019)Assessing students' understanding of object structuresProceedings of the 19th Koli Calling International Conference on Computing Education Research10.1145/3364510.3364511(1-10)Online publication date: 21-Nov-2019
https://dl.acm.org/doi/10.1145/3364510.3364511
Kramer MBarkmin MBrinda TScharlau BMcDermott RPears ASabin M(2019)Identifying Predictors for Code Highlighting SkillsProceedings of the 2019 ACM Conference on Innovation and Technology in Computer Science Education10.1145/3304221.3319745(367-373)Online publication date: 2-Jul-2019
https://dl.acm.org/doi/10.1145/3304221.3319745
Kramer MBarkmin MTobinski DBrinda T(2018)Understanding the Differences Between Novice and Expert Programmers in Memorizing Source CodeTomorrow's Learning: Involving Everyone. Learning with and about Technologies and Computing10.1007/978-3-319-74310-3_63(630-639)Online publication date: 21-Jan-2018
https://doi.org/10.1007/978-3-319-74310-3_63

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents