Evaluating neural networks as a method for identifying students in need of assistance
K Castro-Wunsch, A Ahadi, A Petersen - Proceedings of the 2017 ACM …, 2017 - dl.acm.org
K Castro-Wunsch, A Ahadi, A Petersen
Proceedings of the 2017 ACM SIGCSE technical symposium on computer science …, 2017•dl.acm.orgCourse instructors need to be able to identify students in need of assistance as early in the
course as possible. Recent work has suggested that machine learning approaches applied
to snapshots of small programming exercises may be an effective solution to this problem.
However, these results have been obtained using data from a single institution, and prior
work using features extracted from student code has been highly sensitive to differences in
context. This work provides two contributions: first, a partial reproduction of previously …
course as possible. Recent work has suggested that machine learning approaches applied
to snapshots of small programming exercises may be an effective solution to this problem.
However, these results have been obtained using data from a single institution, and prior
work using features extracted from student code has been highly sensitive to differences in
context. This work provides two contributions: first, a partial reproduction of previously …
Course instructors need to be able to identify students in need of assistance as early in the course as possible. Recent work has suggested that machine learning approaches applied to snapshots of small programming exercises may be an effective solution to this problem. However, these results have been obtained using data from a single institution, and prior work using features extracted from student code has been highly sensitive to differences in context. This work provides two contributions: first, a partial reproduction of previously published results, but in a different context, and second, an exploration of the efficacy of neural networks in solving this problem. Our findings confirm the importance of two features (the number of steps required to solve a problem and the correctness of key problems), indicate that machine learning techniques are relatively stable across contexts (both across terms in a single course and across courses), and suggest that neural network based approaches are as effective as the best Bayesian and decision tree methods. Furthermore, neural networks can be tuned to be reliably pessimistic, so they may serve a complementary role in solving the problem of identifying students who need assistance.
ACM Digital Library