research-article

Analytics-enabled teaching as design: reconceptualisation and call for research

Authors:

Sakinah S. J. Alhadad,

Jason M. LodgeAuthors Info & Claims

LAK '18: Proceedings of the 8th International Conference on Learning Analytics and Knowledge

Pages 427 - 435

https://doi.org/10.1145/3170358.3170390

Published: 07 March 2018 Publication History

Abstract

As a human-centred educational practice and field of research, learning analytics must account for key stakeholders in teaching and learning. The focus of this paper is on the role of institutions to support teachers to incorporate learning analytics into their practice by understanding the confluence of internal and external factors that influence what they do. In this paper, we reconceptualise `teaching as design' for `analytics-enabled teaching as design' to shape this discussion to allow for the consideration of external factors, such as professional learning or ethical considerations of student data, as well as personal considerations, such as data literacy and teacher beliefs and identities. In order to address the real-world challenges of progressing teachers' efficacy and capacity toward analytics-enabled teaching as design, we have placed the teacher - as a cognitive, social, and emotional being - at the center. In so doing, we discuss potential directions towards research for practice in elucidating underpinning factors of teacher inquiry in the process of authentic design.

References

[1]

Gašević, D., Dawson, S., & Siemens, G. (2015). Let's not forget: Learning analytics are about learning. TechTrends, 59(1), 64--71.

[2]

Lizzio, A., Wilson, K., Alhadad, S., Albert, L., Easom, A. Shenqu, L., ...Brown, P. (2015). Case Study 5: Griffith University. In The National Forum for "Let's Talk Learning Analytics": Case Studies. Retrieved from: http://www.letstalklearninganalytics.edu.au/wp-content/uploads/2015/06/Introduction-to-Case-Studies1.pdf

[3]

Colvin, C., Rogers, T., Wade, A., Dawson, S., Gasevic, D., Buckingham Shum, S....Fisher, J. (2015). Student retention and learning analytics: a snapshot of Australian practices and a framework for advancement. Canberra, ACT: Australian Office for Learning and Teaching.

[4]

Dawson, S., Jovanovic, J., Gašević, D., & Pardo, A. (2017). From prediction to impact: Evaluation of a learning analytics retention program. Proceedings of the Seventh International Learning Analytics and Knowledge Conference (pp. 474--478). /bib>

Digital Library

[5]

Baker, R.S. (2016). Stupid Tutoring Systems, Intelligent Humans. International Journal of Artificial Intelligence and Education, 26(2), 600--614.

[6]

Liu, D. Y-T, Bartimote-Aufflick, K., Pardo, A., Bridgeman, A. J. (2017). Data-driven personalization of student learning support in Higher Education. In A. Pena-Ayala (Ed.), Learning Analytics: Fundaments, Applications, & Trends (pp. 143--169).

[7]

Edwards, R. & Fenwick, T. (2016). Digital analytics in professional work and learning. Studies in Continuing Education, 38(2), 213--227.

[8]

Goodyear, P., & Dimitriadis, Y. (2013). In medias res: reframing design for learning. Research in Learning Technology, 21(1)

[9]

Kalantzis, M., & Cope, B. (2010). The teacher as designer: Pedagogy in the new media age. E-learning & Digital Media, 7(3), 200--222.

[10]

Laurillard, D. (2012). Teaching as a Design Science: Building Pedagogical Patterns for Learning and Technology, Routledge: Abingdon.

[11]

Kali, Y., Goodyear, P., Markauskaite, L. (2011). Researching design practices and design cognition: contexts, experiences and pedagogical knowledge-in-pieces. Learning, Media and Technology, 36(2), 129--149.

[12]

Bennett, S., Agostinho, S. & Lockyer, L. (2017). The process of designing for learning: understanding university teachers' design work. Educational Technology Research & Development, 65(1), 125--145.

[13]

Spiro, R.J., Feltovich, P.J., Jacobson, M., & Coulson, R.L. (1991). Cognitive flexibility, constructivism, and hypertext: Advanced knowledge acquisition in ill-structured domains. Educational Technology, 31(5); 24--33.

[14]

Ionescu, T. (2012). Exploring the nature of cognitive flexibility. New Ideas in Psychology, 30(2), 190--200.

[15]

Markauskaite, L., & Goodyear, P. (2017). Epistemic Fluency and Professional Education: Innovation, Knowledgeable Action And Actionable Knowledge, Springer: Dordrecht.

[16]

Corrin, L., Kennedy, G., & Mulder, R. (2013). Enhancing learning analytics by understanding the needs of teachers. Proceedings ascilite 2013 (pp. 201--205). Sydney, Australia.

[17]

West, D., Huijser, H., Heath, D., Lizzio, A., Toohey, D., Miles, C. ... et al. (2016). Higher education teachers' experiences with learning analytics in relation to student retention. Australasian Journal of Educational Technology, 32(5), 48--60.

[18]

Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., Hlosta, M., & Naydenova, G. (2017). Implementing predictive learning analytics on a large scale: The teacher's perspective. Proceedings of the Seventh International Learning Analytics & Knowledge Conference (pp. 267--271).

Digital Library

[19]

Gunn, C. Blumenstein, M., Donald, C., McDonald, J. & Milne, J. (2016). The missing link for learning analytics. In S. Barker, S. Dawson, A. Pardo, & C. Colvin (Eds.), Show Me The Learning. Proceedings ASCILITE 2016 Adelaide (pp. 255--260).

[20]

Ferguson, R., Brasher, Q., Clow, D., Cooper, A., Hillaire, G, Mitttelmeier, J...Ullmann, T. (2016). Research evidence on the use of learning analytics: Implications for education policy. JRC Science for Policy Report.

[21]

Alhadad, S.S.J. & Thompson, K. (2017). Understanding the mediating role of teacher inquiry when connecting learning analytics with design for learning. Interaction, Design, & Architecture(s), 33, 54--74. Retrieved from: http://www.mifav.uniroma2.it/inevent/events/idea2010/doc/33_3.pdf

[22]

van Leeuwen A., van Wermeskerken M., Erkens G., & Rummel N. (2017). Measuring teacher sense making strategies of learning analytics: A case study. Learning: Research & Practice, 3(1), 42--58.

[23]

Clow, D. (2012). The learning analytics cycle: Closing the loop effectively. In proceedings of the 2nd international conference on learning analytics and knowledge (pp. 134--138). ACM.

Digital Library

[24]

Alhadad, S.S.J. (2016). Attentional and cognitive processing of analytics visualisations: Can design features affect interpretations and decisions about learning and teaching? In S. Barker, S. Dawson, A. Pardo, & C. Colvin (Eds.), Show Me The Learning. Proceedings ASCILITE 2016 (pp. 20--32).

[25]

Gibbs, G. (1988). Learning by doing: A guide to teaching and learning methods. London, UK: Further Education Unit.

[26]

Campbell, J. P., DeBlois, P. B., & Oblinger, D. G. (2007). Academic analytics: A new tool for a new era. Educause Review, 42(4), 40.

[27]

Schön, D. A. (1983). The reflective practitioner: How professionals think in action. New York, NY: Basic books.

[28]

Benassi, V. A. Tappin, E. M., Overson, C. E., Lee, M. J., O'Brien, E. J. White, B. P., et al. (2014). Applying the science of learning: The cognition toolbox. In V. A. Benassi, C. E., Overson, & C. M. Hakala (Eds.), Applying the Science of Learning in education: Infusing psychological science into curriculum (pp. 194--205)

[29]

Cox, M.D. (2001). Faculty learning communities: Change agents for transforming institutions into learning organizations. To Improve the Academy, 19, 69--93.

[30]

Turner, J. C., Christensen, A., Kackar-Cam, H. Z., Fulmer, S. M., & Trucano, M. (2017). The development of professional learning communities and their teacher leaders: An activity systems analysis. Journal of the Learning Sciences

[31]

Stes, A., Min-Leliveld, M., Gijbels, D. and Van Pategewm, P. (2010). The impact of instructional development in higher education: The state-of-the-art of the research. Educational Research Review, 5, 25--49.

[32]

Goodyear, P. (2015). Teaching as design. HERSDA Review of Higher Education, 2, 27--50.

[33]

Bakharia, A., Corrin, L., de Barba, P., Kennedy, G., Gašević, D., Mulder, R., Williams, D., Dawson, S. & Lockyer, L. (2016). A conceptual framework linking learning design with learning analytics. In LAK '16 Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. (pp. 329--338).

Digital Library

[34]

Ifenthaler, D. (2017). Learning analytics design. In L. Lin & J. M. Spector (Eds.), The sciences of learning and instructional design: Constructive articulation between communities (pp. 202--211). New York, NY: Routledge.

[35]

Kali, Y., Goodyear, P., Markauskaite, L. (2011). Researching design practices and design cognition: contexts, experiences and pedagogical knowledge-in-pieces. Learning, Media & Technology, 36(2), 129--149.

[36]

McKenney, S., Kali, Y., Markauskaite, L., & Voogt, J. (2015). Teacher design knowledge of technology enhanced learning: an ecological framework for investigating assets and needs. Instructional Science, 43, 181--202.

[37]

Mandinach, E.B., Parton, B.M., Gummer, E.S., & Anderson, R. (2015). Ethical and appropriate data use requires data literacy. Phi Delta Kappan, 96(5), 25--28.

[38]

Godsil, R. D., Tropp, L. R., Goff, P. A., & Powell, J. A. (2014). Addressing Implicit Bias, Racial Anxiety, and Stereotype Threat in Education and Health Care. The Science of Equality, Volume 1.

[39]

Staats, C. (2016). Understanding implicit bias: what educators should know. American Educator, 39(4), 29--43.

[40]

Lewis, M. J., Bartimote-Aufflick, K., Bell, A., Pattison, P., Peseta, T., Barrie, S...., Wen, A. (2016). Articulating cultural competence as inquiry at Sydney: Identity shifts for the contemporary university? Symposium paper presented at the International Academic Identities Conference, 2016. Retrieved from: https://sydney.edu.au/education-portfolio/ei/cms/files/3A_Lewis.pdf

[41]

Devine, P. G., Forscher, P. S., Austin, A. J., & Cox, W. T. (2012). Long-term reduction in implicit race bias: A prejudice habit-breaking intervention. Journal of Experimental Social Psychology, 48(6), 1267--1278.

[42]

Buckingham Shum, S., Sándor, A., Goldsmith, R., Bass, R., & McWilliams, M. (2017). Towards reflective writing analytics: Rationale, methodology, and preliminary results. Journal of Learning Analytics, 4(1), 58--84.

[43]

Gibson, A., Kitto, K. & Bruza, P. (2016). Towards the Discovery of Learner Metacognition from Reflective Writing. Journal of Learning Analytics, 3(2), 22--36.

[44]

Liu, R. & Koedinger, K. R. (2017). Closing the loop: Automated data-driven cognitive model discoveries lead to improved instruction and learning gains. Journal of Educational Data Mining, 9(1), 25--41.

[45]

Khosravi, H., Cooper, K., & Kitto, K. (2017). RiPLE: Recommendation in peer-learning environments based on knowledge gaps and interests. Journal of Educational Data Mining, 9(1), 42--67.

[46]

Harvey, A., Russell-Mundine, G., Hoving, E. (2016). Modelling interdisciplinary collaboration to build cultural competence and academic literacy. Journal of Academic Language & Learning, 10(1), 101--117.

[47]

Willis, J. E., Slade, S., Prinsloo, P. (2016). Ethical oversight of student data in learning analytics: a typology derived from a cross-continental, cross-institutional perspective. Educational Technology Research & Development, 64(5), 881--901.

[48]

Trigwell, K., Prosser, M., & Waterhouse, F. (1999). Relations between teachers' approaches to teaching and students' approaches to learning. Higher Education, 37(1), 57--70.

[49]

Kirkwood, A., & Price, L. (2012). The influence upon design of differing conceptions of teaching and learning with technology. In A. D. Olofsson and O. Lindberg (Eds.), Informed Design of Educational Technologies in Higher Education: Enhanced Learning and Teaching, (pp.1--20). Hershey, PA: IGI Global.

[50]

Englund, C., Olofsson, A.D., Price, L. (2017). Teaching with technology in higher education: understanding conceptual change and development in practice, Higher Education Research & Development, 36(1), 73--87.

[51]

Koutsabasis, P., Vosinakis, S., Malisova, K., & Paparounas, N. (2012). On the value of virtual worlds for collaborative design. Design Studies, 33(4), 357--390.

[52]

McComb, C., Cagan, J., & Kotovsky, K. (2015). Rolling with the punches: An examination of team performance in a design task subject to drastic changes. Design Studies, 36, 99--121.

[53]

Kleinsmann, M. & Valkersburg, R. (2008). Barriers and enablers for creating a shared understanding in co-design projects. Design Studies, 29(4): 369--386.

[54]

Kleinsmann, M., Deken, F., Dong, A. & Lauche, K. (2012). Development of design collaboration skills. Journal of Engineering Design 23(7), 485--506.

[55]

Lu, J., Lajoie, S.P., & Wiseman, J. (2010). Scaffolding problem-based learning with CSCL tools. International Journal of Computer-Supported Collaborative Learning, 5(3), 283--298.

[56]

Strijbos, J.W., Kirschner, P.A., & Martens, R.L. (2006). What We Know About CSCL: & Implementing It In Higher Education. Springer Science & Business Media.

Digital Library

[57]

Hernández-Leo, D., Moreno, P., Chacón, J., & Blat, J. (2014). LdShake support for team-based learning design. Computers in Human Behavior, 37, 402--412.

Digital Library

[58]

Martinez-Maldonado, R., Goodyear, P., Carvalho, L., Thompson, K., Hernandez-Leo, D., Dimitriadis, Y., ... Wardak, D. (2017). Supporting collaborative design activity in a multi-user digital design ecology. Computers in Human Behavior, 71, 327--342.

Digital Library

[59]

Wardak, D. (2016). Gestures orchestrating the multimodal development of ideas in educational design team meetings. Design Studies, 47, 1--22.

[60]

Er, E., Lorenzo, B., Miguel, L., Gómez Sánchez, E., Dimitriadis, Y. A., Pérez, A., & Ignacio, J. (2017). Predicting Student Participation in Peer Reviews in MOOCs. Retrieved from http://uvadoc.uva.es/handle/10324/24889

[61]

Moallem, M. (2003). An interactive online course: A collaborative design model. Educational Technology Research & Development, 51(4), 85--103. {62} Lockyer, L., & Dawson, S. (2011). Learning designs and learning analytics. In LAK '11 Proceedings of the International Conference on Learning Analytics and Knowledge, (pp. 153--156). New York: ACM.

Digital Library

[62]

Pennington, D., Bammer, G., Danielson, A., Gosselin, D. C., Gouvea, J., Habron, G., Hawthorne, D., Parnell, R. A., Thompson, K., Vincent, S., & Wei, C. (2015) The EMBeRS project: Employing model-based reasoning in socio-environmental synthesis. Journal of Environmental Studies & Sciences, October, 2015.

[63]

Thompson, K., Alhadad, S.S.J., Buckingham Shum, S., Howard, S., Knight, S., Martinez-Maldonado, R., Pardo, A. (accepted). Connecting expert knowledge in the design of classroom learning experiences. In J.M. Lodge, J.C. Horvarth, & L. Corrin (Eds.) From data and analytics to the classroom: Translating learning analytics for teachers.

[64]

Thompson, K., Carvalho, L., Aditomo, A., Dimitriadis, Y., Dyke, G., Evans, M. A, Huang, L., Khosronejad, M., Martinez-Madldonado, R., Reimann, P., Wardak, D. (2015) Synthesis research in the Learning Sciences: A multimodal approach to the analysis of complex learning environments. International Conference for Computer Supported Collaborative Learning, Gottenburg, Sweden. The conceptualisation of teaching as design has

Cited By

Shahril Khuzairi NChe Cob Z(2021)A Preliminary Model of Learning Analytics to Explore Data Visualization on Educator’s Satisfaction and Academic Performance in Higher EducationAdvances in Visual Informatics10.1007/978-3-030-90235-3_3(27-40)Online publication date: 16-Nov-2021
https://doi.org/10.1007/978-3-030-90235-3_3
Hoyos AVelasquez J(2020)Teaching Analytics: Current Challenges and Future DevelopmentIEEE Revista Iberoamericana de Tecnologias del Aprendizaje10.1109/RITA.2020.297924515:1(1-9)Online publication date: Feb-2020
https://doi.org/10.1109/RITA.2020.2979245
Teixeira AGuerra AKnorn SStaffas KVaragnolo D(2020)Computer-aided curriculum analysis and design: existing challenges and open research directions2020 IEEE Frontiers in Education Conference (FIE)10.1109/FIE44824.2020.9274292(1-9)Online publication date: 21-Oct-2020
https://doi.org/10.1109/FIE44824.2020.9274292
Show More Cited By

Index Terms

Analytics-enabled teaching as design: reconceptualisation and call for research
1. General and reference
  1. Cross-computing tools and techniques
    1. Design
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User models

Recommendations

Pair Teaching in Action
ACE '19: Proceedings of the Twenty-First Australasian Computing Education Conference

We share our procedure, resources, and experiences in using pair teaching to deliver a first-year introductory web development course. We will describe how having two lecturers in the lecture theatre can provide more opportunities for live examples, ...
Learning to teach online or learning to become an online teacher: An exploration of teachers' experiences in a blended learning course
Special issue on CALL and CMC teacher education research

A key role in the successful implementation of any learning approach is played by teachers, so how well blended learning works will depend largely on how well teachers make the transition from their traditional face-to-face classroom roles to the wider ...
Context counts

Massive Open Online Courses (MOOCs) require individual learners to self-regulate their own learning, determining when, how and with what content and activities they engage. However, MOOCs attract a diverse range of learners, from a variety of learning ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

LAK '18: Proceedings of the 8th International Conference on Learning Analytics and Knowledge

March 2018

489 pages

ISBN:9781450364003

DOI:10.1145/3170358

Conference Chairs:
Abelardo Pardo
The University of Sydney, AUS
,
Kathryn Bartimote-Aufflick
The University of Sydney, AUS
,
Grace Lynch
Society for Learning Analytics Research, AUS
,
Program Chairs:
Simon Buckingham Shum
University of Technology Sydney, AUS
,
Rebecca Ferguson
The Open University, UK
,
Agathe Merceron
Beuth University of Applied Sciences, GER
,
Xavier Ochoa
Escuela Superior Politécnica del Litoral, EC

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

LAK '18

LAK '18: International Conference on Learning Analytics and Knowledge

March 7 - 9, 2018

New South Wales, Sydney, Australia

Acceptance Rates

LAK '18 Paper Acceptance Rate 35 of 115 submissions, 30%;

Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
401
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shahril Khuzairi NChe Cob Z(2021)A Preliminary Model of Learning Analytics to Explore Data Visualization on Educator’s Satisfaction and Academic Performance in Higher EducationAdvances in Visual Informatics10.1007/978-3-030-90235-3_3(27-40)Online publication date: 16-Nov-2021
https://doi.org/10.1007/978-3-030-90235-3_3
Hoyos AVelasquez J(2020)Teaching Analytics: Current Challenges and Future DevelopmentIEEE Revista Iberoamericana de Tecnologias del Aprendizaje10.1109/RITA.2020.297924515:1(1-9)Online publication date: Feb-2020
https://doi.org/10.1109/RITA.2020.2979245
Teixeira AGuerra AKnorn SStaffas KVaragnolo D(2020)Computer-aided curriculum analysis and design: existing challenges and open research directions2020 IEEE Frontiers in Education Conference (FIE)10.1109/FIE44824.2020.9274292(1-9)Online publication date: 21-Oct-2020
https://doi.org/10.1109/FIE44824.2020.9274292
Lewis MStenlake B(2020)A Working Guide Towards Debiasing Higher Education Through the Affordances of Indigenous Australian Cultural Competence CurriculumTeaching Aboriginal Cultural Competence10.1007/978-981-15-7201-2_14(169-180)Online publication date: 12-Nov-2020
https://doi.org/10.1007/978-981-15-7201-2_14
Lodge JPanadero EBroadbent Jde Barba P(2018)Supporting self-regulated learning with learning analyticsLearning Analytics in the Classroom10.4324/9781351113038-4(45-55)Online publication date: 3-Oct-2018
https://doi.org/10.4324/9781351113038-4

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten