Pauline Salim Muljana, Ph.D. student in the Instructional Design and Technology (IDT) Program, Darden College of Education and Professional Studies, Old Dominion University, focuses her research on investigating how learning analytics informs instructional design to foster learning behaviors and strategies associated with academic success. Before joining the IDT program, she held instructional design responsibilities for 12 years at California State Polytechnic University, Pomona that included design and development of courses with various delivery modes and multimedia learning objects, as well as facilitation of faculty workshops on instructional strategies and effective technology integration. Supervisors: Tian Luo
Journal of Educational Technology Development and Exchange
This paper presents a case study of a technology-enhanced professional development strategy and d... more This paper presents a case study of a technology-enhanced professional development strategy and demonstrates how an extended workshop approach, based on tutorials, instructional modeling, and support (TIMS), was used for professional learning at a school site. Data collection procedures included a pre-survey, an audiotaped focus group, interviews, a post-survey, and previous district historical survey collection and analysis regarding professional development sessions. Overall, the results indicate that the TIMS approach is an effective form of professional development delivery, which focuses on providing live modeling, attending to lesson relevancy and student needs, as well as being content-specific. Implications regarding implementing technology-focused professional development initiatives are discussed.
Students perceive molecular bonding as an abstract concept; therefore, learning this concept seem... more Students perceive molecular bonding as an abstract concept; therefore, learning this concept seems uninteresting and difficult. A strategically designed learning object (LO), such as in the form of a simulation, can be used to help students acquire accurate mental images and build appropriate schema in addition to providing a concrete learning experience and encouraging knowledge construction. This paper presents an evaluation of the design and development of the Making Molecules simulation through students’ perceptions of the previous version and recommendations for improving a future version. Data were collected from two online chemistry courses (N = 159) through an anonymous online survey. Results indicate that students responded positively to the use of the simulation. They reported gaining a better understanding of molecular bonding through an interactive learning experience. One of their recommendations was to include more learning tasks related to complex molecules, expressing an interest in learning more about chemistry. This paper provides insights for educators and instructional designers regarding the selection and/or design of an LO for optimizing student learning of complex topics.
This study investigates factors that stimulate better academic performance for female students in... more This study investigates factors that stimulate better academic performance for female students in learning quantitative topics, such as those involving mathematical-related tasks. We explore the differences in self-regulated learning (e.g., sources of motivation and execution of learning strategies), learning behaviors, and learning achievement of female students in quantitative courses. A combination of primary survey data and secondary data from the course-specific Learning Management System (LMS) is used in this study to identify differences between the four grade groups (e.g., students earning final grades A, B, C, and D & F). Findings reveal that the higher-grade groups have stronger metacognitive self-regulation, elaboration, time and study environment management, and effort regulation skills than the lower-grade groups. The higher-grade groups also have stronger self-efficacy, lower test anxiety, more LMS activities, and earlier assignment and quiz submissions. The lower-grade group students consistently submit assignments at the last minute and show fewer LMS activities overall. Our findings have important implications for instructors, academic administrators, and scholars in promoting female students’ self-regulated learning in quantitative courses.
Journal of Research on Technology in Education, 2021
Homework completion is associated with learning achievement, but students’ challenges revolve aro... more Homework completion is associated with learning achievement, but students’ challenges revolve around meeting deadlines and preventing procrastination. Promoting students’ self-regulated learning (S...
Journal of Information Technology Education: Research, 2019
Aim/Purpose: This systematic literature review investigates the underlying factors that influence... more Aim/Purpose: This systematic literature review investigates the underlying factors that influence the gap between the popularity of online learning and its completion rate. The review scope within this paper includes an observation of possible causal aspects within the non-ideal completion rates in online learning environments and an identification of recommended strategies to increase retention rates. Background: While online learning is increasingly popular, and the number of online students is steadily growing, student retention rates are significantly lower than those in the traditional environment. Despite the multitude of studies, many institutions are still searching for solutions for this matter. Methodology: A systematic literature review was conducted on 40 studies published between 2010 and 2018. We established a set of criteria to guide the selection of eligible articles including topic relevance (aligned with the research questions), empirical studies, and publication t...
Journal of Information Technology Education: Research, 2021
Aim/Purpose: The current literature discusses the use and benefits of learner-generated videos (L... more Aim/Purpose: The current literature discusses the use and benefits of learner-generated videos (LGVs). However, it rarely addresses any correlation between the types of subjects that are best suited for using these videos or what techniques should accompany the use of LGVs. Background: This systematic review synthesizes current literature to identify patterns and implications that develop from the use of LGVs so that their future use can be both consistent and effective. This paper also reviews the studies to establish the most consistent educational benefits that emerge from this activity. Methodology: Employing the Preferred-Reporting of Items for Systematic Reviews and Meta-Analyses (PRISMA) technique, this systematic review cumulated 39 eligible studies published between 2008 to 2020. A set of eligibility criteria guided us in the article selection process, such as the use of LGVs as an assignment, educational settings, publication time frame, and empirical studies. We conducted...
Despite the burgeoning studies on student attrition and retention, many institutions continue to ... more Despite the burgeoning studies on student attrition and retention, many institutions continue to deal with related issues, including D, F, and W grades rates. The emerging and rapidly developing Learning Analytics (LA) field shows great potential for improving learning outcomes by monitoring and analyzing student performance to allow instructors to recommend specific interventions based on key performance indicators. Unfortunately, the important role of LA has not been fully recognized, and therefore higher education has been slow to implement it. We, therefore, provide the rationale and benefits of increased LA integration into courses and curriculum. We further identify and suggest ready-to-implement best practices, as well as tools available in Learning Management Systems (LMSs) and other helpful resources.
International Journal of Designs for Learning, 2020
The concept of chemical bonding is abstract and perceived as difficult. While it is a fundamental... more The concept of chemical bonding is abstract and perceived as difficult. While it is a fundamental concept required to comprehend other chemistry topics, the learning outcomes are not always attained. Addressing this issue, our challenge was to create a learning intervention regarding a common, fundamental chemistry concept for students in a variety of undergraduate chemistry courses. We envisioned a learning product that invites students’ interest yet is challenging. This design case discusses the process, the literature that informs our design decisions, and strategies incorporated into the design of a learning object entitled Making Molecules: Dot Structures and Ionic Compounds to mitigate the learning issue. Discussion on the context of the project, design and development strategies, evaluation, and project reflection is presented as well.
International Journal of Designs for Learning, 2020
The concept of chemical bonding is abstract and perceived as difficult. While it is a fundamental... more The concept of chemical bonding is abstract and perceived as difficult. While it is a fundamental concept required to comprehend other chemistry topics, the learning outcomes are not always attained. Addressing this issue, our challenge was to create a learning intervention regarding a common, fundamental chemistry concept for students in a variety of undergraduate chemistry courses. We envisioned a learning product that invites students’ interest yet is challenging. This design case discusses the process, the literature that informs our design decisions, and strategies incorporated into the design of a learning object entitled Making Molecules: Dot Structures and Ionic Compounds to mitigate the learning issue. Discussion on the context of the project, design and development strategies, evaluation, and project reflection is presented as well.
Studies in learning analytics (LA) have garnered positive findings on learning improvement and ad... more Studies in learning analytics (LA) have garnered positive findings on learning improvement and advantages for informing course design. However, little is known about instructional designers’ perception and their current state of LA-related adoption. This qualitative study explores the perception of instructional designers in higher education regarding factors influencing their intent and actual practice of LA approach in course design practice, based on analysis of multiple strategies such as focus group, individual, and email interviews. Most instructional designers admitted LA had great potential, but adoption was limited. Their perception, intention, and the current state of adoption are affected by individual differences, system characteristics, social influence, and facilitating conditions. Findings have imperative implications for promoting effective implementation of LA approach in higher education.
Accreditation is important for ensuring and sustaining the quality of an educational program, but... more Accreditation is important for ensuring and sustaining the quality of an educational program, but the process can be challenging. Higher education institutions are open systems that rely on multiple entities, such as faculty members, to assist with the accreditation process. However, there is sometimes a lack of buy-in and involvement from faculty when assisting with accreditation-related tasks. This paper describes a cause-analysis study that was grounded in systems thinking and conducted at an engineering department at a large, diverse public university in the U.S. The study was aimed to reveal interrelated factors influencing the engineering faculty’s buy-in and involvement in conducting departmental accreditation tasks. Findings indicate a need to improve the environmental factors, such as provisions of clear communication and suitable resources, as a prioritized intervention to promote faculty’s buy-in and involvement. Recommended interventions, possible challenges of implementing them, and implications on managing changes are also discussed.
The COVID-19 pandemic has impacted personal and professional lives. Graduate students juggle a va... more The COVID-19 pandemic has impacted personal and professional lives. Graduate students juggle a variety of roles and had to quickly adjust. In this article, six graduate students share their reflections regarding the influence of the pandemic on respective stages in their doctoral program. They provide unique personal and professional perspectives that depict their abrupt shift to remote working and remote learning. The intention of this article is to garner an understanding of graduate students' challenges during the pandemic, capture their strategies for success, and provide a space for further conversation and support about how the pandemic has impacted graduate students.
Journal of Educational Technology Development and Exchange
This paper presents a case study of a technology-enhanced professional development strategy and d... more This paper presents a case study of a technology-enhanced professional development strategy and demonstrates how an extended workshop approach, based on tutorials, instructional modeling, and support (TIMS), was used for professional learning at a school site. Data collection procedures included a pre-survey, an audiotaped focus group, interviews, a post-survey, and previous district historical survey collection and analysis regarding professional development sessions. Overall, the results indicate that the TIMS approach is an effective form of professional development delivery, which focuses on providing live modeling, attending to lesson relevancy and student needs, as well as being content-specific. Implications regarding implementing technology-focused professional development initiatives are discussed.
Students perceive molecular bonding as an abstract concept; therefore, learning this concept seem... more Students perceive molecular bonding as an abstract concept; therefore, learning this concept seems uninteresting and difficult. A strategically designed learning object (LO), such as in the form of a simulation, can be used to help students acquire accurate mental images and build appropriate schema in addition to providing a concrete learning experience and encouraging knowledge construction. This paper presents an evaluation of the design and development of the Making Molecules simulation through students’ perceptions of the previous version and recommendations for improving a future version. Data were collected from two online chemistry courses (N = 159) through an anonymous online survey. Results indicate that students responded positively to the use of the simulation. They reported gaining a better understanding of molecular bonding through an interactive learning experience. One of their recommendations was to include more learning tasks related to complex molecules, expressing an interest in learning more about chemistry. This paper provides insights for educators and instructional designers regarding the selection and/or design of an LO for optimizing student learning of complex topics.
This study investigates factors that stimulate better academic performance for female students in... more This study investigates factors that stimulate better academic performance for female students in learning quantitative topics, such as those involving mathematical-related tasks. We explore the differences in self-regulated learning (e.g., sources of motivation and execution of learning strategies), learning behaviors, and learning achievement of female students in quantitative courses. A combination of primary survey data and secondary data from the course-specific Learning Management System (LMS) is used in this study to identify differences between the four grade groups (e.g., students earning final grades A, B, C, and D & F). Findings reveal that the higher-grade groups have stronger metacognitive self-regulation, elaboration, time and study environment management, and effort regulation skills than the lower-grade groups. The higher-grade groups also have stronger self-efficacy, lower test anxiety, more LMS activities, and earlier assignment and quiz submissions. The lower-grade group students consistently submit assignments at the last minute and show fewer LMS activities overall. Our findings have important implications for instructors, academic administrators, and scholars in promoting female students’ self-regulated learning in quantitative courses.
Journal of Research on Technology in Education, 2021
Homework completion is associated with learning achievement, but students’ challenges revolve aro... more Homework completion is associated with learning achievement, but students’ challenges revolve around meeting deadlines and preventing procrastination. Promoting students’ self-regulated learning (S...
Journal of Information Technology Education: Research, 2019
Aim/Purpose: This systematic literature review investigates the underlying factors that influence... more Aim/Purpose: This systematic literature review investigates the underlying factors that influence the gap between the popularity of online learning and its completion rate. The review scope within this paper includes an observation of possible causal aspects within the non-ideal completion rates in online learning environments and an identification of recommended strategies to increase retention rates. Background: While online learning is increasingly popular, and the number of online students is steadily growing, student retention rates are significantly lower than those in the traditional environment. Despite the multitude of studies, many institutions are still searching for solutions for this matter. Methodology: A systematic literature review was conducted on 40 studies published between 2010 and 2018. We established a set of criteria to guide the selection of eligible articles including topic relevance (aligned with the research questions), empirical studies, and publication t...
Journal of Information Technology Education: Research, 2021
Aim/Purpose: The current literature discusses the use and benefits of learner-generated videos (L... more Aim/Purpose: The current literature discusses the use and benefits of learner-generated videos (LGVs). However, it rarely addresses any correlation between the types of subjects that are best suited for using these videos or what techniques should accompany the use of LGVs. Background: This systematic review synthesizes current literature to identify patterns and implications that develop from the use of LGVs so that their future use can be both consistent and effective. This paper also reviews the studies to establish the most consistent educational benefits that emerge from this activity. Methodology: Employing the Preferred-Reporting of Items for Systematic Reviews and Meta-Analyses (PRISMA) technique, this systematic review cumulated 39 eligible studies published between 2008 to 2020. A set of eligibility criteria guided us in the article selection process, such as the use of LGVs as an assignment, educational settings, publication time frame, and empirical studies. We conducted...
Despite the burgeoning studies on student attrition and retention, many institutions continue to ... more Despite the burgeoning studies on student attrition and retention, many institutions continue to deal with related issues, including D, F, and W grades rates. The emerging and rapidly developing Learning Analytics (LA) field shows great potential for improving learning outcomes by monitoring and analyzing student performance to allow instructors to recommend specific interventions based on key performance indicators. Unfortunately, the important role of LA has not been fully recognized, and therefore higher education has been slow to implement it. We, therefore, provide the rationale and benefits of increased LA integration into courses and curriculum. We further identify and suggest ready-to-implement best practices, as well as tools available in Learning Management Systems (LMSs) and other helpful resources.
International Journal of Designs for Learning, 2020
The concept of chemical bonding is abstract and perceived as difficult. While it is a fundamental... more The concept of chemical bonding is abstract and perceived as difficult. While it is a fundamental concept required to comprehend other chemistry topics, the learning outcomes are not always attained. Addressing this issue, our challenge was to create a learning intervention regarding a common, fundamental chemistry concept for students in a variety of undergraduate chemistry courses. We envisioned a learning product that invites students’ interest yet is challenging. This design case discusses the process, the literature that informs our design decisions, and strategies incorporated into the design of a learning object entitled Making Molecules: Dot Structures and Ionic Compounds to mitigate the learning issue. Discussion on the context of the project, design and development strategies, evaluation, and project reflection is presented as well.
International Journal of Designs for Learning, 2020
The concept of chemical bonding is abstract and perceived as difficult. While it is a fundamental... more The concept of chemical bonding is abstract and perceived as difficult. While it is a fundamental concept required to comprehend other chemistry topics, the learning outcomes are not always attained. Addressing this issue, our challenge was to create a learning intervention regarding a common, fundamental chemistry concept for students in a variety of undergraduate chemistry courses. We envisioned a learning product that invites students’ interest yet is challenging. This design case discusses the process, the literature that informs our design decisions, and strategies incorporated into the design of a learning object entitled Making Molecules: Dot Structures and Ionic Compounds to mitigate the learning issue. Discussion on the context of the project, design and development strategies, evaluation, and project reflection is presented as well.
Studies in learning analytics (LA) have garnered positive findings on learning improvement and ad... more Studies in learning analytics (LA) have garnered positive findings on learning improvement and advantages for informing course design. However, little is known about instructional designers’ perception and their current state of LA-related adoption. This qualitative study explores the perception of instructional designers in higher education regarding factors influencing their intent and actual practice of LA approach in course design practice, based on analysis of multiple strategies such as focus group, individual, and email interviews. Most instructional designers admitted LA had great potential, but adoption was limited. Their perception, intention, and the current state of adoption are affected by individual differences, system characteristics, social influence, and facilitating conditions. Findings have imperative implications for promoting effective implementation of LA approach in higher education.
Accreditation is important for ensuring and sustaining the quality of an educational program, but... more Accreditation is important for ensuring and sustaining the quality of an educational program, but the process can be challenging. Higher education institutions are open systems that rely on multiple entities, such as faculty members, to assist with the accreditation process. However, there is sometimes a lack of buy-in and involvement from faculty when assisting with accreditation-related tasks. This paper describes a cause-analysis study that was grounded in systems thinking and conducted at an engineering department at a large, diverse public university in the U.S. The study was aimed to reveal interrelated factors influencing the engineering faculty’s buy-in and involvement in conducting departmental accreditation tasks. Findings indicate a need to improve the environmental factors, such as provisions of clear communication and suitable resources, as a prioritized intervention to promote faculty’s buy-in and involvement. Recommended interventions, possible challenges of implementing them, and implications on managing changes are also discussed.
The COVID-19 pandemic has impacted personal and professional lives. Graduate students juggle a va... more The COVID-19 pandemic has impacted personal and professional lives. Graduate students juggle a variety of roles and had to quickly adjust. In this article, six graduate students share their reflections regarding the influence of the pandemic on respective stages in their doctoral program. They provide unique personal and professional perspectives that depict their abrupt shift to remote working and remote learning. The intention of this article is to garner an understanding of graduate students' challenges during the pandemic, capture their strategies for success, and provide a space for further conversation and support about how the pandemic has impacted graduate students.
14th annual International Technology, Education and Development (INTED) Conference, 2020
This study examined 124 teachers in the United States of America to understand teachers’ proficie... more This study examined 124 teachers in the United States of America to understand teachers’ proficiency and degree of personal use with social media applications and their perceptions of integrating these tools into literacy instruction.
2019 Pacific Southwest Section Meeting, California State University, Los Angeles , California, 2019
The quality of course design and organization often affects student success in the classroom as m... more The quality of course design and organization often affects student success in the classroom as much as a student’s ability to learn and apply course material. Students frequently must overcome poorly organized classes, including those organized within Learning Management Systems (LMSs) such as Blackboard. Ideally, instructors utilize LMSs and similar learning portals to optimize the amount of knowledge transfer, while minimizing the time students need to reach subject proficiency and the time instructors need to administer and to assess students. For example, searching for misleadingly labeled documents by navigating folders within folders can stress students and cause negative instructor reviews. We relate this to issues with “signal – to – noise ratio addressed in a previous work. Lamentably, while institutions of higher education regularly survey students for course feedback, a critical component most often missing is student user feedback on how well course design and organization contributed to the learning process. Based on a review of the literature, and previous experience, we developed multiple preliminary course structures that considered folder organization, the number of tabs to include, and kind of LMS features to use. We then recommend several easy-to-follow practices to help instructors improve their online course design to improve student learning and retention.
Uploads
Papers by Pauline Muljana
focus group, individual, and email interviews. Most instructional designers admitted LA had great potential, but adoption was limited. Their perception, intention, and the current state of adoption are affected by individual differences, system characteristics, social influence, and facilitating conditions. Findings have imperative implications for promoting effective implementation of LA approach in higher education.
accreditation process. However, there is sometimes a lack of buy-in and involvement from faculty when assisting with accreditation-related tasks. This paper describes a cause-analysis study that was grounded in systems thinking and conducted at an engineering department at a large, diverse public university in the U.S. The study was aimed to reveal interrelated factors influencing the engineering faculty’s buy-in and involvement in conducting departmental accreditation tasks. Findings indicate a need to improve the environmental factors, such as provisions of clear communication and suitable resources, as a prioritized intervention to promote faculty’s buy-in and involvement. Recommended interventions, possible challenges of implementing them, and implications on managing changes are also discussed.
focus group, individual, and email interviews. Most instructional designers admitted LA had great potential, but adoption was limited. Their perception, intention, and the current state of adoption are affected by individual differences, system characteristics, social influence, and facilitating conditions. Findings have imperative implications for promoting effective implementation of LA approach in higher education.
accreditation process. However, there is sometimes a lack of buy-in and involvement from faculty when assisting with accreditation-related tasks. This paper describes a cause-analysis study that was grounded in systems thinking and conducted at an engineering department at a large, diverse public university in the U.S. The study was aimed to reveal interrelated factors influencing the engineering faculty’s buy-in and involvement in conducting departmental accreditation tasks. Findings indicate a need to improve the environmental factors, such as provisions of clear communication and suitable resources, as a prioritized intervention to promote faculty’s buy-in and involvement. Recommended interventions, possible challenges of implementing them, and implications on managing changes are also discussed.
can stress students and cause negative instructor reviews. We relate this to issues with “signal – to – noise ratio addressed in a previous work. Lamentably, while institutions of higher education regularly survey students for course feedback, a critical component most often missing is student
user feedback on how well course design and organization contributed to the learning process. Based on a review of the literature, and previous experience, we developed multiple preliminary course structures that considered folder organization, the number of tabs to include, and kind of LMS features to use. We then recommend several easy-to-follow practices to help instructors
improve their online course design to improve student learning and retention.