UpGrade: Sourcing student open-ended solutions to create scalable learning opportunities

X Wang, ST Talluri, C Rose, K Koedinger - Proceedings of the Sixth …, 2019 - dl.acm.org
X Wang, ST Talluri, C Rose, K Koedinger
Proceedings of the Sixth (2019) ACM Conference on Learning@ Scale, 2019dl.acm.org
In schools and colleges around the world, open-ended home-work assignments are
commonly used. However, such assignments require substantial instructor effort for grading,
and tend not to support opportunities for repeated practice. We propose UpGrade, a novel
learnersourcing approach that generates scalable learning opportunities using prior student
solutions to open-ended problems. UpGrade creates interactive questions that offer
automated and real-time feedback, while enabling repeated practice. In a two-week …
In schools and colleges around the world, open-ended home-work assignments are commonly used. However, such assignments require substantial instructor effort for grading, and tend not to support opportunities for repeated practice. We propose UpGrade, a novel learnersourcing approach that generates scalable learning opportunities using prior student solutions to open-ended problems. UpGrade creates interactive questions that offer automated and real-time feedback, while enabling repeated practice. In a two-week experiment in a college-level HCI course, students answering UpGrade-created questions instead of traditional open-ended assignments achieved indistinguishable learning outcomes in ~30% less time. Further, no manual grading effort is required. To enhance quality control, UpGrade incorporates a psychometric approach using crowd workers' answers to automatically prune out low quality questions, resulting in a question bank that exceeds reliability standards for classroom use.
ACM Digital Library