Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3657604.3664677acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesl-at-sConference Proceedingsconference-collections
short-paper
Open access

Scaling Generated Feedback for Novice Teachers by Sustaining Teacher Educators' Expertise: A Design to Train LLMs with Teacher Educator Endorsement of Generated Feedback

Published: 15 July 2024 Publication History

Abstract

When using simulations to design and implement novice teacher practice, a teacher educator may be concerned about if what is technically possible in terms of generating feedback to novice teachers' responses is educationally purposeful to support their learning. This paper details the design of infrastructure to incorporate user feedback within the Teacher Moments platform that is generated by an AI agent, and how we designed to sustain and scale the expertise of mathematics teacher educators when training a large language model. To best support the learning of novice mathematics teacher users to enact ambitious and equitable mathematics teaching, this paper explains the research design of training a large language model by collaborating with mathematics teacher educators to edit or endorse generated feedback across multiple training cycles. This paper also describes the UI design to explore potential of hosting such processes all within the Teacher Moments platform.

References

[1]
Ball, D., & Forzani, F. M. (2009). The Work of Teaching and the Challenge for Teacher Education. Journal of Teacher Education, 60(5), 497--511. https://doi.org/10.1177/0022487109348479. Approximations of Practice for Preservice Mathematics Teachers. IGI Global.
[2]
Barno, E. (in progress). Anzalduan Philosophies to (Re)Imagine Multiplicity within Moments of Decision Making in Simulations. . In Lee, C., Bondurant, L., Sapkota, B., & Howell, H. (Eds.). Promoting Equity in Approximations of Practice for Preservice Mathematics Teachers. IGI Global.
[3]
Boyd, D. B., Grossman, P., Lankford, H., Loeb, S., & Wyckoff, J. (2009). Teacher preparation and student achievement. Educational Evaluation and Policy Analysis, 31(4), 416--440. https://doi.org/10.3102/0162373709353129
[4]
Cobb, P., Jackson, K., Henrick, E., & Smith,T. M. (2018). Systems for instructional improvement: Creating coherence from the classroom to the district office. Harvard Education Press.
[5]
Hillaire, G., Waldron, R., Littenberg-Tobias, J., Thompson, M., O'Brien, S., Marvez, G. R., & Reich, J. (2022, June). Digital clinical simulation suite: Specifications and architecture for simulation-based pedagogy at scale. In Proceedings of the Ninth ACM Conference on Learning@ Scale (pp. 212--221). https://dl.acm.org/doi/pdf/10.1145/3491140.3528276.
[6]
Horn, I., & Garner, B. (2022). Teacher Learning of Ambitious and Equitable Mathematics Instruction: A Sociocultural Approach (1st ed.). Routledge. https://doi.org/10.4324/9781003182214.
[7]
Lampert, M., Franke, M. L., Kazemi, E., Ghousseini, H., Turrou, A. C., Beasley, H., ..., Crowe, K. (2013). Keeping it complex: Using rehearsals to support novice teacher learning of ambitious teaching. Journal of Teacher Education, 64(3), 226--243. https://doi.org/10.1177/0022487112473837.
[8]
Marvez, G. R., Zheng, T., Littenberg-Tobias, J., Hillaire, G., O'Brien, S., & Reich, J. (2022, June). Integrating Dynamic Supports into an Equity Teaching Simulation to Promote Equity Mindsets. In Proceedings of the Ninth ACM Conference on Learning@ Scale (pp. 364--367). https://dl.acm.org/doi/pdf/10.1145/3491140.3528327.
[9]
Reich, J. (2022). Teaching drills: Advancing practice-based teacher education through short, low-stakes, high-frequency practice. Journal of Technology and Teacher Education, 30(2), 217--228.
[10]
Self, E. A., & Stengel, B. S. (2020). Toward anti-oppressive teaching: Designing and using simulated encounters. Harvard Education Press.
[11]
Shaughnessy, M., Ghousseini, H., Kazemi, E., Franke, M., Kelley-Petersen, M., & Hartmann, E. S. (2019). An investigation of supporting teacher learning in the context of a common decomposition for leading mathematics discussions. Teaching and Teacher Education, 80, 167--179. https://doi.org/10.1016/j.tate.2019.01.008.
[12]
Thompson, M., Leonard, G., Mikeska, J. N., Lottero-Perdue, P. S., Maltese, A. V., Pereira, G., ... & Reich, J. (2022). Eliciting Learner Knowledge: Enabling Focused Practice through an Open-Source Online Tool. Behavioral Sciences, 12(9), 324. https://www.mdpi.com/2076--328X/12/9/324/pdf.

Index Terms

  1. Scaling Generated Feedback for Novice Teachers by Sustaining Teacher Educators' Expertise: A Design to Train LLMs with Teacher Educator Endorsement of Generated Feedback

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    L@S '24: Proceedings of the Eleventh ACM Conference on Learning @ Scale
    July 2024
    582 pages
    ISBN:9798400706332
    DOI:10.1145/3657604
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 July 2024

    Check for updates

    Author Tags

    1. digital simulations
    2. generative AI
    3. natural language processing
    4. professional learning
    5. teacher education

    Qualifiers

    • Short-paper

    Conference

    L@S '24

    Acceptance Rates

    Overall Acceptance Rate 117 of 440 submissions, 27%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 96
      Total Downloads
    • Downloads (Last 12 months)96
    • Downloads (Last 6 weeks)43
    Reflects downloads up to 26 Sep 2024

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media