Exploring Models and Theories of Spatial Skills in CS through a Multi-National Study
Authors: 
Jack Parkinson, 
Sebastian Dziallas, Fiona McNeill, James Stephen WilliamsAuthors Info & Claims
Jack Parkinson, Sebastian Dziallas, Fiona McNeill, James Stephen WilliamsAuthors Info & ClaimsPages 122 - 133
Abstract
Background and Context. The relationship between spatial skills and computing science success has been demonstrated at multiple institutions. ICER has reacted positively to two theories for why this relationship exists, by both Parkinson & Cutts and Margulieux. However, only limited work has been done to validate these theories, and more confirmatory research about the relationship between spatial skills and module grades in CS is necessary.
Objectives. We wish to validate two dimensions of existing theories for the relationship between spatial skills and CS: does CS learning improve spatial skills (as has been observed in other domains, such as physics) as Parkinson & Cutts propose, and does the relationship with grades predominantly apply to students with less prior programming fluency when they begin their learning, as Margulieux proposes. We also wish to contribute more data to the existing set of correlations between spatial skills and measures of CS success (replication).
Method. We conducted a multi-institutional, multi-national project to capture prior programming experience and module grades in CS at three institutions, as well as conducting spatial skills tests at three points during the academic year. We compare spatial skills results with module grades, we examine changes in spatial skills over a period of CS learning and we explore whether the correlations between spatial skills and module grades apply for students at all levels of prior programming fluency.
Findings. We found that spatial skills correlated with module grades at each institution, spatial skills improved over the first semester of teaching (though not the second semester, and at different rates in different institutions) and students with lower self-reported prior programming fluency exhibited much stronger correlations between spatial skills and grades than students with greater programming fluency.
Implications. This work provides additional evidence that spatial skills are correlated with introductory CS outcomes. It also takes steps towards validating existing theories for the relationship by demonstrating that spatial skills can be trained through CS learning and students with lower levels of prior programming fluency are more likely to rely on spatial skills in their CS learning.
References
[1]
Ryan Bockmon and Stephen Cooper. 2022. What’s your placebo?Commun. ACM 65, 10 (Oct. 2022), 31–33. https://doi.org/10.1145/3528085
[2]
Ryan Bockmon, Stephen Cooper, Jonathan Gratch, and Mohsen Dorodchi. 2019. (Re)Validating Cognitive Introductory Computing Instruments. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education. ACM, Minneapolis MN USA, 552–557. https://doi.org/10.1145/3287324.3287372
[3]
Ryan Bockmon, Stephen Cooper, Jonathan Gratch, Jian Zhang, and Mohsen Dorodchi. 2020. Can Students’ Spatial Skills Predict Their Programming Abilities?. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education. ACM, Trondheim Norway, 446–451. https://doi.org/10.1145/3341525.3387380
[4]
Ryan Bockmon, Stephen Cooper, William Koperski, Jonathan Gratch, Sheryl Sorby, and Mohsen Dorodchi. 2020. A CS1 Spatial Skills Intervention and the Impact on Introductory Programming Abilities. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education. ACM, Portland OR USA, 766–772. https://doi.org/10.1145/3328778.3366829
[5]
Neil C. C. Brown, Eva Marinus, and Aleata Hubbard Cheuoua. 2022. Launching Registered Report Replications in Computer Science Education Research. In Proceedings of the 2022 ACM Conference on International Computing Education Research V.1. ACM, Lugano and Virtual Event Switzerland, 309–322. https://doi.org/10.1145/3501385.3543971
[6]
Jeffrey Buckley, Niall Seery, and Donal Canty. 2018. A Heuristic Framework of Spatial Ability: a Review and Synthesis of Spatial Factor Literature to Support its Translation into STEM Education. Educational Psychology Review 30, 3 (Sept. 2018), 947–972. https://doi.org/10.1007/s10648-018-9432-z
[7]
John B. Carroll. 1993. Human Cognitive Abilities: A Survey of Factor-Analytic Studies (1 ed.). Cambridge University Press, Cambridge, UK. https://doi.org/10.1017/CBO9780511571312
[8]
Stephen Cooper, Karen Wang, Maya Israni, and Sheryl Sorby. 2015. Spatial Skills Training in Introductory Computing. In Proceedings of the eleventh annual International Conference on International Computing Education Research. ACM, Omaha Nebraska USA, 13–20. https://doi.org/10.1145/2787622.2787728
[9]
Anthony Cox, Maryanne Fisher, and Philip O’Brien. 2005. Theoretical Considerations on Navigating Codespace with Spatial Cognition. In Proceedings of the 17th Annual Workshop of the Psychology of Programming Interest Group. Psychology of Programming Interest Group, Brighton, UK, 9. https://ppig.org/papers/2005-ppig-17th-cox/
[10]
Brian Dorn and Allison Elliott Tew. 2015. Empirical validation and application of the computing attitudes survey. Computer Science Education 25, 1 (Jan. 2015), 1–36. https://doi.org/10.1080/08993408.2015.1014142
[11]
Sally Fincher, Bob Baker, Ilona Box, Quintin Cutts, Michael de Raadt, Patricia Haden, John Hamer, Margaret Hamilton, Raymond Lister, and Marian Petre. 2005. Programmed to succeed?: A multi-national, multi-institutional study of introductory programming courses. Technical Report. University of Kent.
[12]
Sally Fincher and Marian Petre (Eds.). 2004. Computer science education research. Taylor & Francis, London ; New York.
[13]
Sue Jones and Gary Burnett. 2007. Spatial skills and navigation of source code. In Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education - ITiCSE ’07. ACM Press, Dundee, Scotland, 231. https://doi.org/10.1145/1268784.1268852
[14]
Sue Jones and Gary Burnett. 2008. Spatial Ability And Learning To Program. Human Technology: An Interdisciplinary Journal on Humans in ICT Environments 4, 1 (2008), 47–61. https://doi.org/10.17011/ht/urn.200804151352
[15]
Maria Kozhevnikov, Mary Hegarty, and Richard Mayer. 2002. Spatial Abilities in Problem Solving in Kinematics. In Diagrammatic Representation and Reasoning, Michael Anderson, Bernd Meyer, and Patrick Olivier (Eds.). Springer London, London, 155–171. https://doi.org/10.1007/978-1-4471-0109-3_9
[16]
Maria Kozhevnikov, Michael A. Motes, and Mary Hegarty. 2007. Spatial Visualization in Physics Problem Solving. Cognitive Science 31, 4 (July 2007), 549–579. https://doi.org/10.1080/15326900701399897
[17]
Patrick C. Kyllonen, David F. Lohman, and Richard E. Snow. 1984. Effects of aptitudes, strategy training, and task facets on spatial task performance.Journal of Educational Psychology 76, 1 (Feb. 1984), 130–145. https://doi.org/10.1037/0022-0663.76.1.130
[18]
Ken Liu, Burkhard C. Wünsche, and Andrew Luxton-Reilly. 2022. Relationship Between Spatial Skills and Performance in Introductory Computer Graphics. In Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1. ACM, Dublin Ireland, 304–310. https://doi.org/10.1145/3502718.3524756
[19]
Anna Ly, Jack Parkinson, Quintin Cutts, Michael Liut, and Andrew Petersen. 2021. Spatial Skills and Demographic Factors in CS1. In Koli Calling. ACM, Joensuu, Finland, 1–10. https://doi.org/10.1145/3488042.3488049
[20]
Aaron Mac Raighne, Avril Behan, Gavin Duffy, Stephanie Farrell, Rachel Harding, Robert Howard, Edmund Nevin, and Brian Bowe. 2015. Examining the Relationship Between Physics Students’ Spatial Skills and Conceptual Understanding of Newtonian Mechanics. In The 6th Research in Engineering Education Symposium. TU Dublin, Dublin, Ireland, 8. https://doi.org/10.21427/8ET5-X129 Publisher: Technological University Dublin.
[21]
Lauri Malmi, Judy Sheard, Päivi Kinnunen, Simon, and Jane Sinclair. 2019. Computing Education Theories: What Are They and How Are They Used?. In Proceedings of the 2019 ACM Conference on International Computing Education Research. ACM, Toronto ON Canada, 187–197. https://doi.org/10.1145/3291279.3339409
[22]
Lauren E. Margulieux. 2019. Spatial Encoding Strategy Theory: The Relationship between Spatial Skill and STEM Achievement. In Proceedings of the 2019 ACM Conference on International Computing Education Research. ACM, Toronto ON Canada, 81–90. https://doi.org/10.1145/3291279.3339414
[23]
Richard E. Mayer, Jennifer L. Dyck, and William Vilberg. 1986. Learning to program and learning to think: what’s the connection?Commun. ACM 29, 7 (July 1986), 605–610. https://doi.org/10.1145/6138.6142
[24]
George J. Pallrand and Fred Seeber. 1984. Spatial ability and achievement in introductory physics. Journal of Research in Science Teaching 21, 5 (May 1984), 507–516. https://doi.org/10.1002/tea.3660210508
[25]
Miranda C. Parker, Mark Guzdial, and Shelly Engleman. 2016. Replication, Validation, and Use of a Language Independent CS1 Knowledge Assessment. In Proceedings of the 2016 ACM Conference on International Computing Education Research(ICER ’16). Association for Computing Machinery, New York, NY, USA, 93–101. https://doi.org/10.1145/2960310.2960316 event-place: Melbourne, VIC, Australia.
[26]
Miranda C. Parker, Amber Solomon, Brianna Pritchett, David A. Illingworth, Lauren E. Marguilieux, and Mark Guzdial. 2018. Socioeconomic Status and Computer Science Achievement: Spatial Ability as a Mediating Variable in a Novel Model of Understanding. In Proceedings of the 2018 ACM Conference on International Computing Education Research. ACM, Espoo Finland, 97–105. https://doi.org/10.1145/3230977.3230987
[27]
Jack Parkinson, Ryan Bockmon, Quintin Cutts, Michael Liut, Andrew Petersen, and Sheryl Sorby. 2021. Practice report: six studies of spatial skills training in introductory computer science. ACM Inroads 12, 4 (Dec. 2021), 18–29. https://doi.org/10.1145/3494574
[28]
Jack Parkinson and Quintin Cutts. 2018. Investigating the Relationship Between Spatial Skills and Computer Science. In Proceedings of the 2018 ACM Conference on International Computing Education Research. ACM, Espoo Finland, 106–114. https://doi.org/10.1145/3230977.3230990
[29]
Jack Parkinson and Quintin Cutts. 2020. The Effect of a Spatial Skills Training Course in Introductory Computing. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education. ACM, Trondheim Norway, 439–445. https://doi.org/10.1145/3341525.3387413
[30]
Jack Parkinson and Quintin Cutts. 2022. Relationships between an Early-Stage Spatial Skills Test and Final CS Degree Outcomes. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education. ACM, Providence RI USA, 293–299. https://doi.org/10.1145/3478431.3499332
[31]
Jack Parkinson, Quintin Cutts, and Steve Draper. 2020. Relating Spatial Skills and Expression Evaluation. In United Kingdom & Ireland Computing Education Research conference.ACM, Glasgow United Kingdom, 17–23. https://doi.org/10.1145/3416465.3416473
[32]
Herbert L. Pick and Jeffrey J. Lockman. 1983. Map Reading and Spatial Cognition: Discussion. In Spatial Orientation, Herbert L. Pick and Linda P. Acredolo (Eds.). Springer US, Boston, MA, 219–224. https://doi.org/10.1007/978-1-4615-9325-6_10
[33]
Leo Porter, Cynthia Bailey Lee, Beth Simon, Quintin Cutts, and Daniel Zingaro. 2011. Experience report: a multi-classroom report on the value of peer instruction. In Proceedings of the 16th annual joint conference on Innovation and technology in computer science education. ACM, Darmstadt Germany, 138–142. https://doi.org/10.1145/1999747.1999788
[34]
Bruno Poucet. 1993. Spatial cognitive maps in animals: new hypotheses on their structure and neural mechanisms.Psychological review 100, 2 (1993), 163. Publisher: American Psychological Association.
[35]
Simon, Sally Fincher, Anthony Robins, Bob Baker, IIona Box, Quintin Cutts, Michael De Raadt, Patricia Haden, John Hamer, Margaret Hamilton, and others. 2006. Predictors of success in a first programming course. In Conferences in Research and Practice in Information Technology, Vol. 52. Australian Computer Society, Hobart, Australia, 189–196.
[36]
Sheryl Sorby. 1999. Developing 3-D Spatial Visualisation Skills. The Engineering Design Graphics Journal 63, 2 (1999), 21–32.
[37]
Sheryl Sorby, Norma Veurink, and Scott Streiner. 2018. Does spatial skills instruction improve STEM outcomes? The answer is ‘yes’. Learning and Individual Differences 67 (Oct. 2018), 209–222. https://doi.org/10.1016/j.lindif.2018.09.001
[38]
Sheryl A. Sorby. 2009. Educational Research in Developing 3‐D Spatial Skills for Engineering Students. International Journal of Science Education 31, 3 (Feb. 2009), 459–480. https://doi.org/10.1080/09500690802595839
[39]
Sheryl Ann Sorby, Anne Frances Wysocki, and Beverly Gimmestad Baartmans. 2003. Introduction to 3-D spatial visualization: an active approach. Thomson/Delmar Learning, Clifton Park, N.Y. OCLC: ocm51301756.
[40]
Sorby, Sheryl A. and Baartmans, Beverly J.1996. A Course for the Development of 3-D Spatial Visualization Skills. Engineering Design Graphics Journal 60, n1 (1996), 13–20.
[41]
Ian Spence and Jing Feng. 2010. Video Games and Spatial Cognition. Review of General Psychology 14, 2 (June 2010), 92–104. https://doi.org/10.1037/a0019491
[42]
Denise Tolhurst, Bob Baker, John Hamer, Ilona Box, Raymond Lister, Quintin Cutts, Marian Petre, Michael De Raadt, Anthony Robins, Sally Fincher, and others. 2006. Do map drawing styles of novice programmers predict success in programming? A multi-national, multi-institutional study. Research in Practice in Information Technology 52 (2006), 213–222.
[43]
David H. Uttal, Nathaniel G. Meadow, Elizabeth Tipton, Linda L. Hand, Alison R. Alden, Christopher Warren, and Nora S. Newcombe. 2013. The malleability of spatial skills: A meta-analysis of training studies.Psychological Bulletin 139, 2 (March 2013), 352–402. https://doi.org/10.1037/a0028446
[44]
Jonathan Wai, David Lubinski, and Camilla P. Benbow. 2009. Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance.Journal of Educational Psychology 101, 4 (Nov. 2009), 817–835. https://doi.org/10.1037/a0016127
[45]
Ronald L. Wasserstein, Allen L. Schirm, and Nicole A. Lazar. 2019. Moving to a World Beyond “ p < 0.05”. The American Statistician 73, sup1 (March 2019), 1–19. https://doi.org/10.1080/00031305.2019.1583913
[46]
So Yoon Yoon. 2011. Psychometric properties of the Revised Purdue Spatial Visualization Tests: Visualization of Rotations (the Revised PSVT:R). Ph. D. Dissertation. Purdue University.
Index Terms
- Exploring Models and Theories of Spatial Skills in CS through a Multi-National Study
Recommendations
The Effect of a Spatial Skills Training Course in Introductory Computing
ITiCSE '20: Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science EducationSpatial skills have been associated with STEM success for decades. Research has shown that training spatial skills can have a positive impact on outcomes in STEM domains such as engineering, mathematics and physics; however -- despite some promising ...
Spatial Skills and Demographic Factors in CS1
Koli Calling '21: Proceedings of the 21st Koli Calling International Conference on Computing Education ResearchMotivation Prior studies have established that training spatial skills may improve outcomes in computing courses. Very few of these studies have, however, explored the impact of spatial skills training on women or examined its relationship with other ...
What does Space look like in CS? Mapping out the Relationship between Spatial Skills and CS Aptitude
ICER '22: Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 2Spatial skills are cognitive skills relating to the mental consolidation of spatial structures and operations. Rotating shapes in one’s head, identifying patterns from obscured environments and parsing 3D structures from 2D representations are some ...
Comments
Information & Contributors
Information
Published In
August 2023
520 pages
ISBN:9781450399760
DOI:10.1145/3568813
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 10 September 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICER 2023
ICER 2023: ACM Conference on International Computing Education Research
August 7 - 11, 2023
IL, Chicago, USA
Acceptance Rates
Overall Acceptance Rate 189 of 803 submissions, 24%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 50Total Downloads
- Downloads (Last 12 months)37
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format