article

Concept inventories in computer science for the topic discrete mathematics

Authors:

Vicki L. Almstrum,

Peter B. Henderson,

Valerie Harvey,

William Marion,

Charles Riedesel,

Allison Elliott TewAuthors Info & Claims

ACM SIGCSE Bulletin, Volume 38, Issue 4

Pages 132 - 145

https://doi.org/10.1145/1189136.1189182

Published: 26 June 2006 Publication History

Abstract

This report describes concept inventories, specialized assessment instruments that enable educational researchers to investigate student (mis)understandings of concepts in a particular domain. While students experience a concept inventory as a set of multiple-choice items taken as a test, this belies its purpose, its careful development, and its validation. A concept inventory is not intended to be a comprehensive instrument, but rather a tool that probes student comprehension of a carefully selected subset of concepts that give rise to the most common and pervasive mismodelings. The report explains how concept inventories have been developed and used in other STEM fields, then outlines a project to explore the feasibility of concept inventories in the computing field. We use the domain of discrete mathematics to illustrate a suggested plan of action.

References

[1]

Albanese, M. A., Kent, T. H., & Whitney, D. R. (1977). A comparison of the difficulty, reliability and validity of complex multiple choice, multiple response and multiple true-false items," Annual Conference on Research in Medical Education. 16:105--110.

[2]

Almstrum, V. L., Klappholz, D., Condly, S., and Clement, J. (2006). Are they learning what (we think) we're teaching? In Proceedings of the 37th SIGCSE Technical Symposium on Computer Science Education (Houston, Texas, USA, March 3--5, 2006). ACM Press, New York, NY, p. 195--196.

Digital Library

[3]

Begel, A., Garcia, D. D., & Wolfman, S. A. (2004). Kinesthetic learning in the classroom, SIGCSE '04: Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education, Norfolk, VA, ACM Press, pp. 183--184.

Digital Library

[4]

Bransford, J. D., Brown, A. L., & Cocking, R. R. (2000). How People Learn: Brain, Mind, Experience, and School (expanded edition). Washington, D.C.: National Academy Press.

[5]

Center for Education (2001). Knowing What Students Know: The Science and Design of Educational Assessment. The National Academies Press. Available: www.nap.edu/books/0309072727/html/

[6]

Colorado School of Mines (2006). Developing an Outcomes Assessment Instrument for Identifying Engineering Student Misconceptions in Thermal and Transport Sciences. (NSF DUE - 0127806) {July 19, 2006}. Available: www.mines.edu/research/cee/Misconceptions.html

[7]

Doxas, I., Garvin-Doxas, K., & Klymkowsky, M. W. (2006) Bioliteracy Project Home Page. July 2, 2006 {July 23, 2006}. Available: bioliteracy.net/.

[8]

Epp, S. (2003). The role of logic in teaching proof, The American Mathematical Monthly, 110(10), pp 886--99.

[9]

Epp, S. (2004). Discrete Mathematics with Applications, 3rd Edition, Brooks/Cole Publishing.

Digital Library

[10]

Ericsson, K. A. & Simon, H. A. (1984). Protocol Analysis: Verbal Reports as Data, Cambridge, MA: MIT Press.

[11]

Evans, D. L., moderator (2003). Panel session: Progress on concept inventory assessment tools, FIE'2003: Proceedings of the 33rd Annual Frontiers in Education, pp. 1--8.

[12]

Fagen, A. P., Crouch, C. H., & Mazur, E. (2002). Peer instruction: Results from a range of classrooms. The Physics Teacher, 40(4), pp. 206--209.

[13]

The Foundation Coalition. (2006). The Foundation Coalition Home Page. {July 27, 2006}. Available: www.foundationcoalition.org/

[14]

Gay, L. R. & Airasian, P. (2000). Educational Research: Competencies for Analysis and Application, 6th Edition, Upper Saddle River, NJ: Prentice-Hall, Inc.

[15]

Gersting, J. (2007). Mathematical Structures for Computer Science, 6th Edition, W. H. Freeman Publishing.

Digital Library

[16]

Gray, G. L., Evans, D., Cornwell, P., Costanzo, F. & Self, B. (2003). Towards a nationwide dynamics concept inventory assessment test, Proceedings of the 2003 American Society for Engineering Education Annual Conference and Exposition, Nashville, TN.

[17]

Gronlund, N. E. & Linn, R. L. (1990). Measurement and Evaluation in Teaching, Sixth Edition, New York, NY: Macmillan Publishing Company.

[18]

Hake, R. R. (1998) Interactive-engagement vs. traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66, pp 64--74. Available: www.physics.indiana.edu/~sdi/ajpv3i.pdf

[19]

Haladyna, T. M. (2004). Developing and Validating Multiple-Choice Test Items, 3rd Edition, Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

[20]

Halloun, I. A., & Hestenes, D. (1985a). Common sense concepts about motion, American Journal of Physics, 53, pp.1056--1065.

[21]

Halloun, I. A., & Hestenes, D. (1985b) The initial knowledge state of college physics students, American Journal of Physics, 53, 1043--1055.

[22]

Helgeland, B. & Rancour, D. (2003). Circuits Concept Inventory, The Foundation Coalition, {July 19, 2006}. Available: www.foundationcoalition.org/home/keycomponents/concept/circuits.html

[23]

Hestenes, D., Wells, M., & Swackhamer, G. (1992) Force Concept Inventory, Physics Teacher, 30, pp. 141--158. Available modeling.asu.edu/R&E/Research.html

[24]

Hundhausen, C. D. & Brown, J. L. (2005). Personalizing and discussing algorithms within CS1 studio experiences: an observational study. ICER '05: Proceedings of the 2005 International Workshop on Computing Education Research, Seattle, WA, ACM Press, pp. 45--56.

Digital Library

[25]

Jackson, J. (2006). Private Communication. September 6.

[26]

Jacobi, A., Martin, J., Mitchell, J., & Newell, T. (2003). A concept inventory for heat transfer. 33rd ASEE/IEEE Frontiers in Education Conference, Boulder, CO.

[27]

Joint Task Force on Computing Curricula, Computing Curricula 2001, Journal on Educational Resources in Computing, 1(3es), ACM Press, New York, NY.

[28]

Klappholz, A. D. and Almstrum, V. L. (2006). Collaborative Research: Discrete Mathematics in Computing Education. National Science Foundation. Available: www.nsf.gov/awardsearch/showAward.do? AwardNumber=0536270

[29]

Kolodner, J. (1997). Educational implications of analogy: A view from case-based reasoning, American Psychologist, 52(1), pp. 57--66.

[30]

Krause, S., Decker, J. C., & Griffin, R. (2003). Using a materials concept inventory to assess conceptual gain in introductory materials engineering courses. 33rd ASEE/IEEE Frontiers in Education Conference, Boulder, CO.

[31]

Krause, S., Birk, J., Bauer, R., Jenkins, B., & Pavelich, M. J. (2004). Development, testing, and application of a chemistry concept inventory. 34th ASEE/IEEE Frontiers in Education Conference, Savannah, GA.

[32]

Kvale, S. (1996). Inter Views: An Introduction to Qualitative Research Interviewing. Thousand Oaks, CA: Sage.

[33]

Lewis, M. (1999). Focus Group Interviews in Qualitative Research: A Review of the Literature. August 24, 1999 {July 19, 2006}. Available: www.scu.edu.au/schools/gcm/ar/arr/arow/rlewis.html

[34]

Longino, J. T. (2006). Boolean blunders: identification and assessment of student misconceptions in a digital logic course. Tech. Rep. UILU-ENG-06-2215 CRHC-06-11, Coordinated Science Laboratory, University of Illinois at Urbana-Champaign.

[35]

Martin, J. K., Mitchell, J., & Newell, T. (2004). Work in progress: Analysis of reliability of the Fluid Mechanics Concept Inventory. 34th ASEE/IEEE Frontiers in Education Conference, Savannah, GA.

[36]

Mazur, E. (1997). Peer Instruction: A User's Manual, Prentice Hall.

[37]

Michel, H., Jackson, J., Fortier, P., & Liu, H. (2006). Computer Engineering Concept Inventory. The Foundation Coalition. July 23, 2006. Available: www.foundationcoalition.org/home/keycomponents/concept/computer.html

[38]

Midkiff, K. C., Litzinger, T. A., & Evans, D. L. (2001). Development of engineering thermodynamics concept inventory instruments. 31st ASEE/IEEE Frontiers in Education Conference, Reno, NV.

Digital Library

[39]

Naps, T. L., Eagan, J. R., & Norton, L. L. (2000). JHAVÉÉ --- an environment to actively engage students in Web-based algorithm visualizations. SIGCSE'00: Proceedings of the 31st SIGCSE Technical Symposium on Computer Science Education, Austin, TX, ACM Press, pp. 109--113.

Digital Library

[40]

National Research Council, Committee on Undergraduate Science Education (1997). Science Teaching Reconsidered: A Handbook, Washington, D.C.: National Academy Press.

[41]

Norman, D. A. (1983). Some Observations on Mental Models. In Gentner, D. R., Stevens, A. L. (Eds.) Mental Models. Lawrence Erlbaum Associates.

[42]

Notaros, B. M. (2002). Concept inventory assessment instruments for electromagnetic education, Proceedings of the IEEE Antennas and Propagation Society International Symposium, San Antonio, TX.

[43]

Richardson, J., Steif, P., Morgan, J., & Dantzler, J. (2003). Development of a concept inventory for strength of materials. 33rd ASEE/IEEE Frontiers in Education Conference, Boulder, CO.

[44]

Richardson, J. (2004) Concept Inventories: Tools for uncovering STEM students' misconceptions. Invention and Impact: Building Excellence in Undergraduate Science, Technology, Engineering and Mathematics (STEM) Education. Available: www.aaas.org/publications/books_reports/CCLI/PDFs/02_AER_Richardson.pdf

[45]

Roedel, R. J., El-Ghazaly, S., Rhoads, T. R., & El-Sharawy, E. (1998). The Wave Concepts Inventory: An assessment tool for courses in electromagnetic engineering. ASEE/IEEE Frontiers in Education Conference.

[46]

Rosen, K. (2003). Common Mistakes in Discrete Math. In Discrete Mathematics and Its Applications Student Solutions Guide, McGraw Hill Publishing. Available: www.mhhe.com/math/advmath/rosen/r5/student/mistakes .html

[47]

Rosen, K. (2007). Discrete Mathematics and Its Applications, 6th Edition, McGraw Hill Publishing.

Digital Library

[48]

Soh, L. K. (2006). Implementing the jigsaw model in CS1 closed labs. ITiCSE '06: Proceedings of the 11th annual SIGCSE Conference on Innovation and Technology in Computer Science Education, Bologna, Italy, ACM Press, pp. 163--167.

Digital Library

[49]

Stone, A., Allen, K., Rhoads, R. R., Murphy, T. J., Shehab, R. L., & Saha, C. (2003). The Statistics Concept Inventory: A pilot study. 33rd ASEE/IEEE Frontiers in Education Conference, Boulder, CO.

[50]

The Teaching Resources Compendium for Higher Education (2002). Glossary of Assessment Terms. {July 27, 2006}. Available: www.lmuaut.demon.co.uk/trc/edissues/assgloss.htm

[51]

Wage, K. E. & Buck, J. R. (2001). Development of the Signals and Systems Concept Inventory (SSCI) assessment instrument. 31st ASEE/IEEE Frontiers in Education Conference, Reno, NV.

Digital Library

[52]

Wikipedia, "Assessment", July 10, 2006 {July 19, 2006}. Available: en.wikipedia.org/wiki/Assessment

[53]

Wikipedia, "Concept Inventory", July 1, 2006 {July 19, 2006}. Available: en.wikipedia.org/wiki/Concept_inventory

[54]

Working Group on Integrating Mathematical Reasoning into Computer Science Curricula. {July 26, 2006}. Available: www.math-in-cs.org/

[55]

Wyckoff, S. (2001). Changing the culture of undergraduate science teaching. Journal of College Science Teaching. 30(5), 306--312.

[56]

Zilles, C., Longino, J., and Loui, M. (2006). Student misconceptions in an introductory digital logic design course. Proceedings of the 2006 ASEE Annual Conference and Exposition, Chicago, IL., June 18--21, 2006, CD-ROM.

Cited By

Greenman BPrasad SDi Stasio AZhu SDe Giacomo GKrishnamurthi SMontali MNelson TZizyte M(2024)Misconceptions in Finite-Trace and Infinite-Trace Linear Temporal LogicFormal Methods10.1007/978-3-031-71162-6_30(579-599)Online publication date: 11-Sep-2024
https://doi.org/10.1007/978-3-031-71162-6_30
Almadhoun EParham-Mocello J(2023)Students’ difficulties with inserting and deleting nodes in a singly linked list in the C programming languageJournal of Computer Languages10.1016/j.cola.2022.10118474(101184)Online publication date: Jan-2023
https://doi.org/10.1016/j.cola.2022.101184
Adamoli A(2023)An Agile Concept Inventory Methodology to Detect Large Sets of Student Misconceptions in Programming Language CoursesResponsive and Sustainable Educational Futures10.1007/978-3-031-42682-7_1(1-15)Online publication date: 4-Sep-2023
https://dl.acm.org/doi/10.1007/978-3-031-42682-7_1
Show More Cited By

Index Terms

Concept inventories in computer science for the topic discrete mathematics

Recommendations

Identifying student misconceptions of programming
SIGCSE '10: Proceedings of the 41st ACM technical symposium on Computer science education

Computing educators are often baffled by the misconceptions that their CS1 students hold. We need to understand these misconceptions more clearly in order to help students form correct conceptions. This paper describes one stage in the development of a ...
Creating the digital logic concept inventory
SIGCSE '10: Proceedings of the 41st ACM technical symposium on Computer science education

A concept inventory (CI) is a standardized assessment tool that evaluates how well a student's conceptual framework matches the accepted conceptual framework of a discipline. In this paper, we present our process in creating and evaluating the alpha ...
Concept inventories in computer science for the topic discrete mathematics
ITiCSE-WGR '06: Working group reports on ITiCSE on Innovation and technology in computer science education

This report describes concept inventories, specialized assessment instruments that enable educational researchers to investigate student (mis)understandings of concepts in a particular domain. While students experience a concept inventory as a set of ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGCSE Bulletin

ACM SIGCSE Bulletin Volume 38, Issue 4

December 2006

186 pages

ISSN:0097-8418

DOI:10.1145/1189136

Issue’s Table of Contents

ITiCSE-WGR '06: Working group reports on ITiCSE on Innovation and technology in computer science education
June 2006
99 pages
ISBN:1595936033
DOI:10.1145/1189215

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2006

Published in SIGCSE Volume 38, Issue 4

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

79
Total Citations
View Citations
1,179
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)7

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Greenman BPrasad SDi Stasio AZhu SDe Giacomo GKrishnamurthi SMontali MNelson TZizyte M(2024)Misconceptions in Finite-Trace and Infinite-Trace Linear Temporal LogicFormal Methods10.1007/978-3-031-71162-6_30(579-599)Online publication date: 11-Sep-2024
https://doi.org/10.1007/978-3-031-71162-6_30
Almadhoun EParham-Mocello J(2023)Students’ difficulties with inserting and deleting nodes in a singly linked list in the C programming languageJournal of Computer Languages10.1016/j.cola.2022.10118474(101184)Online publication date: Jan-2023
https://doi.org/10.1016/j.cola.2022.101184
Adamoli A(2023)An Agile Concept Inventory Methodology to Detect Large Sets of Student Misconceptions in Programming Language CoursesResponsive and Sustainable Educational Futures10.1007/978-3-031-42682-7_1(1-15)Online publication date: 4-Sep-2023
https://dl.acm.org/doi/10.1007/978-3-031-42682-7_1
Prasad SGreenman BNelson TWrenn JKrishnamurthi S(2022)Making Hay from Wheats: A Classsourcing Method to Identify MisconceptionsProceedings of the 22nd Koli Calling International Conference on Computing Education Research10.1145/3564721.3564726(1-7)Online publication date: 17-Nov-2022
https://dl.acm.org/doi/10.1145/3564721.3564726
Zhang HLee IAli SDiPaola DCheng YBreazeal C(2022)Integrating Ethics and Career Futures with Technical Learning to Promote AI Literacy for Middle School Students: An Exploratory StudyInternational Journal of Artificial Intelligence in Education10.1007/s40593-022-00293-333:2(290-324)Online publication date: 9-May-2022
https://doi.org/10.1007/s40593-022-00293-3
Valstar SKrause-Levy SSalguero APorter LGriswold WSchulte CBecker BDivitini MBarendsen E(2021)Proficiency in Basic Data Structures among Various Subpopulations of Students at Different Stages in a CS ProgramProceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 110.1145/3430665.3456337(429-435)Online publication date: 26-Jun-2021
https://dl.acm.org/doi/10.1145/3430665.3456337
Medová JPáleníková KRybanský ĽNaštická Z(2019)Undergraduate Students’ Solutions of Modeling Problems in Algorithmic Graph TheoryMathematics10.3390/math70705727:7(572)Online publication date: 26-Jun-2019
https://doi.org/10.3390/math7070572
Zhao SKirk DBowen SChatting DWright P(2019)Supporting the Cross-cultural Appreciation of Traditional Chinese Puppetry Through a Digital Gesture LibraryJournal on Computing and Cultural Heritage 10.1145/334188212:4(1-19)Online publication date: 17-Nov-2019
https://dl.acm.org/doi/10.1145/3341882
Kaczmarczyk LPetrick EEast JHerman G(2019)THE FIRST OF THE TOP TEN SIGCSE SYMPOSIUM RESEARCH PAPERS OF THE LAST 50 YEARSACM Inroads10.1145/332490010:2(65-69)Online publication date: 25-Apr-2019
https://dl.acm.org/doi/10.1145/3324900
Jones LMahoney R(2019)Incorporating global software development into advanced placement computer science principlesACM Inroads10.1145/332488910:2(36-40)Online publication date: 25-Apr-2019
https://dl.acm.org/doi/10.1145/3324889
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents