My research agenda involves Program Evaluation in Education with a general objective of understanding and improving the teaching and learning process. My specific emphasis is on the use of technology and its ability to enhance learning. This includes evaluating adaptive instructional systems through educational data mining and learning analytics.
I also have worked with improving assessment as its impact on evaluation is so important. My research activities include evaluating educational practices and programs, policies, assessments, and instructional methods. In addition, I am interested in understanding how learner intent affects instruction, how it is measured, and how teachers can influence a student's desire to learn. Phone: 801-422-5229 Address: 150-L MCKB Provo UT 84602
Existing scholarship indicates a wide range of variance and inconsistency in how evaluation is ta... more Existing scholarship indicates a wide range of variance and inconsistency in how evaluation is taught in introductory-level graduate courses between and across instructors and universities and within programs. The purpose of this study was to empirically explore faculty, student, and employers' perceptions of what should be included in a graduate level introductory course on program evaluation. The researchers used a mixed methods approach (survey and focus group) to build consensus on and articulate key elements of an introductory evaluation course, as well as the approximate amount of time that stakeholders feel should be invested in each topic area. The results suggested consistency among stakeholders, suggesting the topics covered could form the basis for an introductory course that is consistent across instructors, programs, and institutions.
The recent increase in online instruction caused by the 2020 pandemic has reignited the debate ov... more The recent increase in online instruction caused by the 2020 pandemic has reignited the debate over the efficacy of online instruction compared to in-person instruction. This study explored the impact various modes of instruction had on student achievement and compared students’ stated modality preference with their actual attendance behavior. Results show that while most students preferred in-person instruction (74%), only 47% of those who indicated they preferred in-person instruction attended class only in-person. Many attended classes utilizing a modality other than in-person, and several students switched their preferred modality away from in-person instruction. In general, students who attended class using a mixed modality or in-person achieved slightly better results than those attending class live online. However, the only statistically significant difference was between those participating predominantly in person and those watching class recordings (88% compared to 84% on a...
This Thesis is brought to you for free and open access by BYU ScholarsArchive. It has been accept... more This Thesis is brought to you for free and open access by BYU ScholarsArchive. It has been accepted for inclusion in All Theses and Dissertations by an
This Dissertation is brought to you for free and open access by BYU ScholarsArchive. It has been ... more This Dissertation is brought to you for free and open access by BYU ScholarsArchive. It has been accepted for inclusion in All Theses and Dissertations by an authorized administrator of BYU ScholarsArchive. For more information, please contact scholarsarchive@byu.edu.
Recommended Citation Hanks, Joseph; Ferrin, Scott E.; Davies, Randall S.; Christensen, Steven S.;... more Recommended Citation Hanks, Joseph; Ferrin, Scott E.; Davies, Randall S.; Christensen, Steven S.; Harris, Scott P.; and Bowles, W. Bryan (2020) "Law and Policy Impacts on Teacher Attrition in Public Education: Data Suggesting a New Focus Beyond the Silver Bullets of Targeted STEM and Other Salary Increases," BYU Education & Law Journal: Vol. 2020 : Iss. 2 , Article 3. Available at: https://scholarsarchive.byu.edu/byu_elj/vol2020/iss2/3
While access to higher education has grown over the past few years, significant barriers exist fo... more While access to higher education has grown over the past few years, significant barriers exist for nontraditional students attempting to prepare for and complete postsecondary education. For these students, the traditional methods for acknowledging student achievement do not always work. This research explored the impact of earning professional certificates on nontraditional students’ confidence, motivation, and persistence. Specifically, this study evaluated the matriculation rates between two cohorts of students who participated in the online PathwayConnect program. The mixed-method study found that matriculation rates for students who were encouraged to earn a certificate increased compared to those who followed a traditional path. Analysis of these results suggests that earning a certificate increased students’ confidence and motivation to persist in school. Students reported that (a) earning certificates represented a significant achievement and encouraged them to earn more, (b...
This study examined the use of a college course evaluation instrument in an effort to better unde... more This study examined the use of a college course evaluation instrument in an effort to better understand and improve the assessment data derived from the instrument. The purpose of the analysis was to examine the dimensionality and reliability of the instrument but, more importantly, to ...
This Dissertation is brought to you for free and open access by BYU ScholarsArchive. It has been ... more This Dissertation is brought to you for free and open access by BYU ScholarsArchive. It has been accepted for inclusion in All Theses and Dissertations by an authorized administrator of BYU ScholarsArchive. For more information, please contact scholarsarchive@byu.edu.
While access to higher education has grown over the past few years, significant barriers exist fo... more While access to higher education has grown over the past few years, significant barriers exist for nontraditional students attempting to prepare for and complete postsecondary education. For these students, the traditional methods for acknowledging student achievement do not always work. This research explored the impact of earning professional certificates on nontraditional students’ confidence, motivation, and persistence. Specifically, this study evaluated the matriculation rates between two cohorts of students who participated in the online PathwayConnect program. The mixed-method study found that matriculation rates for students who were encouraged to earn a certificate increased compared to those who followed a traditional path. Analysis of these results suggests that earning a certificate increased students’ confidence and motivation to persist in school. Students reported that (a) earning certificates represented a significant achievement and encouraged them to earn more, (b...
This study examined the use of a college course evaluation instrument in an effort to better unde... more This study examined the use of a college course evaluation instrument in an effort to better understand and improve the assessment data derived from the instrument. The purpose of the analysis was to examine the dimensionality and reliability of the instrument but, more importantly, to ...
Existing scholarship indicates a wide range of variance and inconsistency in how evaluation is ta... more Existing scholarship indicates a wide range of variance and inconsistency in how evaluation is taught in introductory-level graduate courses between and across instructors and universities and within programs. The purpose of this study was to empirically explore faculty, student, and employers' perceptions of what should be included in a graduate level introductory course on program evaluation. The researchers used a mixed methods approach (survey and focus group) to build consensus on and articulate key elements of an introductory evaluation course, as well as the approximate amount of time that stakeholders feel should be invested in each topic area. The results suggested consistency among stakeholders, suggesting the topics covered could form the basis for an introductory course that is consistent across instructors, programs, and institutions.
The recent increase in online instruction caused by the 2020 pandemic has reignited the debate ov... more The recent increase in online instruction caused by the 2020 pandemic has reignited the debate over the efficacy of online instruction compared to in-person instruction. This study explored the impact various modes of instruction had on student achievement and compared students’ stated modality preference with their actual attendance behavior. Results show that while most students preferred in-person instruction (74%), only 47% of those who indicated they preferred in-person instruction attended class only in-person. Many attended classes utilizing a modality other than in-person, and several students switched their preferred modality away from in-person instruction. In general, students who attended class using a mixed modality or in-person achieved slightly better results than those attending class live online. However, the only statistically significant difference was between those participating predominantly in person and those watching class recordings (88% compared to 84% on a...
This Thesis is brought to you for free and open access by BYU ScholarsArchive. It has been accept... more This Thesis is brought to you for free and open access by BYU ScholarsArchive. It has been accepted for inclusion in All Theses and Dissertations by an
This Dissertation is brought to you for free and open access by BYU ScholarsArchive. It has been ... more This Dissertation is brought to you for free and open access by BYU ScholarsArchive. It has been accepted for inclusion in All Theses and Dissertations by an authorized administrator of BYU ScholarsArchive. For more information, please contact scholarsarchive@byu.edu.
Recommended Citation Hanks, Joseph; Ferrin, Scott E.; Davies, Randall S.; Christensen, Steven S.;... more Recommended Citation Hanks, Joseph; Ferrin, Scott E.; Davies, Randall S.; Christensen, Steven S.; Harris, Scott P.; and Bowles, W. Bryan (2020) "Law and Policy Impacts on Teacher Attrition in Public Education: Data Suggesting a New Focus Beyond the Silver Bullets of Targeted STEM and Other Salary Increases," BYU Education & Law Journal: Vol. 2020 : Iss. 2 , Article 3. Available at: https://scholarsarchive.byu.edu/byu_elj/vol2020/iss2/3
While access to higher education has grown over the past few years, significant barriers exist fo... more While access to higher education has grown over the past few years, significant barriers exist for nontraditional students attempting to prepare for and complete postsecondary education. For these students, the traditional methods for acknowledging student achievement do not always work. This research explored the impact of earning professional certificates on nontraditional students’ confidence, motivation, and persistence. Specifically, this study evaluated the matriculation rates between two cohorts of students who participated in the online PathwayConnect program. The mixed-method study found that matriculation rates for students who were encouraged to earn a certificate increased compared to those who followed a traditional path. Analysis of these results suggests that earning a certificate increased students’ confidence and motivation to persist in school. Students reported that (a) earning certificates represented a significant achievement and encouraged them to earn more, (b...
This study examined the use of a college course evaluation instrument in an effort to better unde... more This study examined the use of a college course evaluation instrument in an effort to better understand and improve the assessment data derived from the instrument. The purpose of the analysis was to examine the dimensionality and reliability of the instrument but, more importantly, to ...
This Dissertation is brought to you for free and open access by BYU ScholarsArchive. It has been ... more This Dissertation is brought to you for free and open access by BYU ScholarsArchive. It has been accepted for inclusion in All Theses and Dissertations by an authorized administrator of BYU ScholarsArchive. For more information, please contact scholarsarchive@byu.edu.
While access to higher education has grown over the past few years, significant barriers exist fo... more While access to higher education has grown over the past few years, significant barriers exist for nontraditional students attempting to prepare for and complete postsecondary education. For these students, the traditional methods for acknowledging student achievement do not always work. This research explored the impact of earning professional certificates on nontraditional students’ confidence, motivation, and persistence. Specifically, this study evaluated the matriculation rates between two cohorts of students who participated in the online PathwayConnect program. The mixed-method study found that matriculation rates for students who were encouraged to earn a certificate increased compared to those who followed a traditional path. Analysis of these results suggests that earning a certificate increased students’ confidence and motivation to persist in school. Students reported that (a) earning certificates represented a significant achievement and encouraged them to earn more, (b...
This study examined the use of a college course evaluation instrument in an effort to better unde... more This study examined the use of a college course evaluation instrument in an effort to better understand and improve the assessment data derived from the instrument. The purpose of the analysis was to examine the dimensionality and reliability of the instrument but, more importantly, to ...
Uploads