Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleMarch 2025
Platform-based Adaptive Experimental Research in Education: Lessons Learned from The Digital Learning Challenge
- Ilya Musabirov,
- Mohi Reza,
- Haochen Song,
- Steven Moore,
- Pan Chen,
- Harsh Kumar,
- Tong Li,
- John Stamper,
- Norman Bier,
- Anna Rafferty,
- Thomas Price,
- Nina Deliu,
- Audrey Durand,
- Michael Liut,
- Joseph Jay Williams
LAK '25: Proceedings of the 15th International Learning Analytics and Knowledge ConferencePages 13–23https://doi.org/10.1145/3706468.3706471Adaptive Experimentation is one of the most promising approaches to support complex decision-making in learning experience design and delivery. This paper reports on our experience with a real-world, multi-experimental evaluation of an adaptive ...
- research-articleNovember 2024
Guiding Students in Using LLMs in Supported Learning Environments: Effects on Interaction Dynamics, Learner Performance, Confidence, and Trust
- Harsh Kumar,
- Ilya Musabirov,
- Mohi Reza,
- Jiakai Shi,
- Xinyuan Wang,
- Joseph Jay Williams,
- Anastasia Kuzminykh,
- Michael Liut
Proceedings of the ACM on Human-Computer Interaction (PACMHCI), Volume 8, Issue CSCW2Article No.: 499, Pages 1–30https://doi.org/10.1145/3687038Personalized chatbot-based teaching assistants can be crucial in addressing increasing classroom sizes, especially where direct teacher presence is limited. Large language models (LLMs) offer a promising avenue, with increasing research exploring their ...
- research-articleJuly 2024
Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classrooms
- Harsh Kumar,
- Ruiwei Xiao,
- Benjamin Lawson,
- Ilya Musabirov,
- Jiakai Shi,
- Xinyuan Wang,
- Huayin Luo,
- Joseph Jay Williams,
- Anna N. Rafferty,
- John Stamper,
- Michael Liut
L@S '24: Proceedings of the Eleventh ACM Conference on Learning @ ScalePages 86–97https://doi.org/10.1145/3657604.3662042Self-reflection on learning experiences constitutes a fundamental cognitive process, essential for consolidating knowledge and enhancing learning efficacy. However, traditional methods to facilitate reflection often face challenges in personalization, ...
ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models
- Mohi Reza,
- Nathan M Laundry,
- Ilya Musabirov,
- Peter Dushniku,
- Zhi Yuan “Michael” Yu,
- Kashish Mittal,
- Tovi Grossman,
- Michael Liut,
- Anastasia Kuzminykh,
- Joseph Jay Williams
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing SystemsArticle No.: 1042, Pages 1–18https://doi.org/10.1145/3613904.3641899Exploring alternative ideas by rewriting text is integral to the writing process. State-of-the-art Large Language Models (LLMs) can simplify writing variation generation. However, current interfaces pose challenges for simultaneous consideration of ...
- research-articleJune 2024
Opportunities for Adaptive Experiments to Enable Continuous Improvement in Computer Science Education
WCCCE '24: Proceedings of the 26th Western Canadian Conference on Computing EducationArticle No.: 4, Pages 1–7https://doi.org/10.1145/3660650.3660659Randomized A/B comparisons of alternative pedagogical strategies or other course improvements could provide useful empirical evidence for instructor decision-making. However, traditional experiments do not provide a straightforward pathway to rapidly ...
-
- research-articleFebruary 2024
Using adaptive bandit experiments to increase and investigate engagement in mental health
- Harsh Kumar,
- Tong Li,
- Jiakai Shi,
- Ilya Musabirov,
- Rachel Kornfield,
- Jonah Meyerhoff,
- Ananya Bhattacharjee,
- Chris Karr,
- Theresa Nguyen,
- David Mohr,
- Anna Rafferty,
- Sofia Villar,
- Nina Deliu,
- Joseph Jay Williams
AAAI'24/IAAI'24/EAAI'24: Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial IntelligenceArticle No.: 2605, Pages 22906–22912https://doi.org/10.1609/aaai.v38i21.30328Digital mental health (DMH) interventions, such as text-message-based lessons and activities, offer immense potential for accessible mental health support. While these interventions can be effective, real-world experimental testing can further enhance ...
- posterApril 2023
Using A/B Testing as a Pedagogical Tool for Iterative Design in HCI Classrooms
EduCHI '23: Proceedings of the 5th Annual Symposium on HCI EducationPages 43–48https://doi.org/10.1145/3587399.3587412This paper explores the use of A/B testing as a pedagogical tool for iterative design in HCI classrooms and outlines a vision for experiment-inspired design. The traditional focus on the statistical aspects of A/B testing education has meant that the ...
- Work in ProgressApril 2023
Exploring the Use of Large Language Models for Improving the Awareness of Mindfulness
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsArticle No.: 129, Pages 1–7https://doi.org/10.1145/3544549.3585614Teachable self-help techniques, such as mindfulness, can reduce anxiety and improve mental well-being outcomes. However, people lack proper awareness of such techniques. In this work, we explore the design space of using online dissemination channels to ...
- abstractMarch 2023
Designing, Deploying, and Analyzing Adaptive Educational Field Experiments
SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2Page 1179https://doi.org/10.1145/3545947.3569635Digital experiments can be used in CSedu to test hypotheses about interventions and conditions' efficacy (or inefficacy). This workshop will discuss and deconstruct the design process and analysis for various experiments conducted in CS1. E.g., ...
- posterMarch 2023
Co-aligning User-Centered Design and Software Engineering Courses: A Case Study
SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2Page 1305https://doi.org/10.1145/3545947.3576252Introducing students to different perspectives and roles in the development process allows them to engage in the work of cross-disciplinary diverse teams and even can enable them to change roles in designer-developer interactions. Industry work often ...
- posterMarch 2023
A Case Study in Opportunities for Adaptive Experiments to Enable Rapid Continuous Improvement
SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2Page 1279https://doi.org/10.1145/3545947.3576225Drawing inspiration from machine learning and experimentation in product development at leading technology companies, we explore how adaptive experimentation might help in continuous course improvement. In adaptive experiments, as different arms/...
- abstractMarch 2023
Challenges and Opportunities of Infrastructure-Enabled Experimental Research in Computer Science Education
SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2Page 1265https://doi.org/10.1145/3545947.3573242In this lightning talk, I reflect on the ongoing rise of software infrastructures for educational experiments and their role in potential shifts in Computer Science Education research. I outline some emerging challenges and opportunities for scientific ...
- posterFebruary 2020
Teaching Undergraduate Sociologists Modeling and Computational Thinking
SIGCSE '20: Proceedings of the 51st ACM Technical Symposium on Computer Science EducationPage 1368https://doi.org/10.1145/3328778.3372687The introductory agent-based modeling course we are presenting aims to equip second-year sociology students with basic skills which are critical to transforming their research ideas into theories and computational models. Our course follows a general ...
- Work in ProgressOctober 2019
Media Metrics in Esports: The Case of Dota 2
CHI PLAY '19 Extended Abstracts: Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended AbstractsPages 519–524https://doi.org/10.1145/3341215.3356304Esports organisations and players rely on revenue model based on spectators attention, which makes player and team brands crucial for their success. In this work, we demonstrate our approach to analyse brand value formation based on computational ...
- abstractJuly 2018
Code-sharing networks of non-STEM students: the case of data science minor
ITiCSE 2018: Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science EducationPage 389https://doi.org/10.1145/3197091.3205814In this work-in-progress report, we outline the first results from our study of collaboration networks in a two-year Data Science minor for non-STEM students at the Higher School of Economics, St. Petersburg, Russia.
- posterApril 2018
Educational Migration from Russia to the Nordic Countries, China and the Middle East. Social Media Data
WWW '18: Companion Proceedings of the The Web Conference 2018Pages 49–50https://doi.org/10.1145/3184558.3186923We use social media and WWW data to analyse international educational migration from Russia. We find substantial regional differences in migration patterns for three contrast directions: the Nordic countries, China and the Middle East. We built a model ...
- abstractApril 2018
Event-driven Spectators' Communication in Massive eSports Online Chats
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsPaper No.: LBW564, Pages 1–6https://doi.org/10.1145/3170427.3188447ESports tournaments, such as Dota 2»s The International (TI), attract millions of spectators to watch broadcasts on online streaming platforms, communicate, and share their experience and emotions. Unlike traditional streams, tournament broadcasts lack a ...
- posterNovember 2017
Trajectories of student interaction with learning resources in blended learning: the case of data science minor
Koli Calling '17: Proceedings of the 17th Koli Calling International Conference on Computing Education ResearchPages 191–192https://doi.org/10.1145/3141880.3141907The paper presents the preliminary results of the analysis of student learning behavior in a blended undergraduate Data Science course for a heterogenous group of non-STEM students. To identify learning trajectories, a mixture model was applied to ...
- research-articleMay 2017
Deconstructing Cosmetic Virtual Goods Experiences in Dota 2
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsPages 2054–2058https://doi.org/10.1145/3025453.3025893Cosmetic items do not provide functional advantages in games, but, nevertheless, they play an important role in the overall player experience. Possessing predominantly socially-constructed dimensions of value, cosmetic items are chosen, discussed, ...
- research-articleOctober 2016
Enabling Information Access in Virtual Learning Environment: The Case of Data Science Minor
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer InteractionArticle No.: 119, Pages 1–6https://doi.org/10.1145/2971485.2996754In this paper, we present our current research regarding information interaction strategies of students of minor specialization in Data Science. We employed an online platform, consisted of a third-party and our software, to provide students with means ...