Kci Fi003033962
Kci Fi003033962
Kci Fi003033962
net/publication/378309929
CITATIONS READS
0 35
2 authors, including:
Seongryeong Yu
Old Dominion University
6 PUBLICATIONS 1 CITATION
SEE PROFILE
All content following this page was uploaded by Seongryeong Yu on 19 February 2024.
Yu, Seongryeong
Old Dominion University
Department of Teaching and Learning
Assistant Professor (Corresponding Author)
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 139
I. Introduction
II. Literature Review
III. Methods
IV. Dynamics in Planning Performance Assessment Tasks
V. Discussion and Conclusion
I. Introduction
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 141
Brownlee et al., 2017; Maggioni & Parkinson, 2008; Soleimani, 2020;
Viholainen et al., 2017; Yilmaz & Sahin, 2011), there is a noticeable
gap in national studies in Korea. To address the gap in the lack of
research on teachers’ epistemological beliefs in national studies,
this study aims to explore the epistemological beliefs of pre-service
teachers, with a specific focus on Korean language education (KLE).1
Through an examination of performance assessment task planning
by pre-service teachers, this study aims to identify their perspectives
and conceptions expressed in their assessment task. The task focuses
on one of the KLE standards, emphasizing the exploration of various
perspectives in constructing knowledge and expressing ideas in lan-
guage (Ministry of Education, 2022).
Given the profound connection between teachers’ epistemologi-
cal beliefs and their teaching practices, pre-service teachers need to
be exposed to constructivist teaching that allows them to construct
or reconstruct their beliefs about teaching (Yilmaz & Sahin, 2011).
The emphasis on pre-service teachers is particularly significant, con-
sidering they are in a formative stage, developing their teaching phi-
losophies and methodologies (Ketabi et al., 2014; Park, 2018a). This
process is evident in the task design within an assessment context,
revealing their understanding of knowledge ( Jang & Kwon, 2019). By
understanding how these beliefs shape their teaching practices (i.e.,
approaches to assessment tasks in KLE), this study stands at the inter-
section of educational philosophy and practical application.
To lay the groundwork for more informed and impactful edu-
cational practices and to form the foundation for an educational
philosophical approach, the study is structured around the following
research questions: (1) What are the epistemological beliefs of pre-
service teachers regarding teaching practices?, (2) How do pre-service
teachers approach the planning of performance assessment tasks?,
1 In this study, Korean Language Education refers to native language instruction target-
ing learners who use Korean as their first language.
142 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
and (3) How do task planning patterns vary among pre-service teach-
ers depending on their epistemological beliefs?
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 143
subject-focused such as science education (Cho & Yang, 2008; Jo et
al., 2009; Kim & Yeo, 2022; Oh & Lee, 2013; Sung et al., 2020).
Despite the wealth of research in this area, there remains a signif-
icant gap in understanding the epistemological beliefs of pre-service
teachers and the impact of those beliefs on teaching practices within
the unique context of KLE in Korea. This study delves into the beliefs
of pre-service teachers regarding their teaching of KLE by exploring
how those beliefs shape or regulate their planning of performance
assessment tasks, extending beyond considerations of classroom
management in general instructional practices. Specifically, within
the context of KLE, a refined interpretation of epistemic autonomy is
proposed in language aspects, acknowledging that the expression’s
ability to choose perspectives extends beyond a singular dimension.
In the context of task design in KLE performance assessment, episte-
mological beliefs manifest in complex ways that necessitate a more
intricate understanding than conventional models offer. By rethinking
the epistemological dimensions in the KLE context, this study contrib-
utes to a more nuanced understanding of how pre-service teachers
navigate and conceptualize their epistemic beliefs, providing valuable
insights for both research and pedagogical practice.
144 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
language performance as well as learners’ cognitive and affective as-
pects.
Wolf (1993) proposed various variables that influence the appli-
cation and outcomes of performance assessment in language educa-
tion. These include teachers’ competence as assessment experts, the
creation of an environment with systematically observable task condi-
tions, utilization of diverse assessment methods and contexts, evalua-
tion of language improvement over time, task settings that reflect the
reality of language use, and the collection and recording of meaning-
ful student results (Cheon, 1999). Planning performance assessments
in a constructivist manner that aligns with the intended evaluation
purpose requires teachers to consider and incorporate various factors
(Ryu et al., 2021). However, according to Lee (2008), KLE is reported
as one of the subjects where teachers in Korea feel the most difficulty
when planning and conducting performance assessments. Valid and
reliable assessment of learners’ language abilities requires teachers’
thorough consideration and expertise, and teachers often recognize
their limitations.
From this perspective, among the various internal characteristics
of teachers, epistemological beliefs are crucial as they influence what
and how students learn. Previous studies in Korea often analyzed the
differences in teachers’ performance based on epistemological beliefs
in the teaching and learning context, such as lesson planning ( Jo
et al., 2009; Park, 2018b). In this study, we hypothesized that there
would be differences in pre-service teachers’ planning and execution
of assessments based on their epistemological beliefs.
III. Methods
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 145
service elementary teachers based on their epistemological beliefs.
To achieve this, the research targeted 150 junior (third-year) students
from two national universities of education in Korea. University A is
located in the Gyeonggi province, and 86 students (57.3%) from that
school participated in the research. University B is situated in the
Jeonnam province, with 64 students (42.7%) participating in the study.
Among the total sample, 70.7% were female (n=106), and 29.3% were
male (n=44). To assess participants’ epistemological beliefs and per-
formance assessment plans in KLE, a two-part questionnaire was pro-
vided. Participants who agreed to the study received an explanation
of the research during the <Korean Language Arts Education II> class
and completed the questionnaire by hand. Participants independently
responded to the questionnaire items for 30 minutes.
1. Epistemological beliefs
146 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
pared to the number of survey items. Following the reliability coef-
ficient, a total of 8 items were removed. Consequently, Cronbach’s α
value for the remaining 55 items was adjusted to .781.
1) Avoid Ambiguity 3 0
2. Certain
.441
Knowledge
2) Knowledge is Certain 5 3
1) Learning is Quick 5 2
5. Quick
2) Learn First Time 2 1 .401
Learning
3) Concentrated Effort is a Waste of Time 2 1
TOTAL 55 24 .781
Despite the item deletion, the range of reliability for domains re-
mained between .140 and .540 indicating a relatively low level. How-
ever, accurately measuring epistemological beliefs can be challenging,
and low reliability may be anticipated (Schommer, 1994). Therefore,
the study proceeded with basic statistics and cluster analysis based on
the data for the final 55 items after item removal.
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 147
of multiple-choice and open-ended questions aimed at quantitatively
examining the planning aspects of performance assessments in KLE
by pre-service elementary teachers. Given that pre-service elementary
teachers are expected to teach all subjects, understanding how their
beliefs are specifically expressed in certain subjects, such as KLE, is
crucial to understanding the relationships between the beliefs and
the practices. Participants were instructed to design performance as-
sessments freely for the 6th-grade achievement standard: “[6K02-04]
Read various texts reflecting diverse perspectives related to the prob-
lem and utilize them for problem-solving.” The standard was chosen
based on the implication that participants could incorporate their un-
derstanding of knowledge and how to apply it in diverse contexts
(Ministry of Education, 2022). As outlined by Cheon (2001), perfor-
mance assessments should facilitate the direct observation of essential
and authentic tasks aligned with the curriculum content. Therefore,
an accurate understanding of the achievement standard and subse-
quent development of tasks based on this understanding are crucial
components of assessment. In this study, the differences in partici-
pants’ comprehension of the achievement standard and planning of
performance assessment were systematically investigated using sur-
vey responses.
For the item-specific types in Table 2, both quantitative and quali-
tative analysis methods were employed. Firstly, for items where par-
ticipants could choose multiple characteristics of the nature of the
planned performance assessment, quantitative analyses such as fre-
quency analysis and chi-square tests were conducted. These analyses
aimed to examine whether the nature of the performance assessment
pursued by pre-service teachers varied according to their epistemo-
logical belief types.
148 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
Table 2. Composition of Test Items for Examining Patterns in Performance Assess-
ment Planning
Response
Area Example
Type
1) Behavioral Areas
According to Educational
Objective Classification “Indicate the nature of the
2. Nature of performance assessment you
2) Difficulty Multiple
Performance would like to conduct, consid-
choice
Assessment ering Korean language teaching
3) Performance Assessment
and learning context given.”
Method
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 149
cluster related codes into broader themes or categories (i.e., present-
ing various perspectives, autonomy of choice, realistic problems and
solutions, validity, problem understanding, self-appropriation, real-
life application, problem-solving attitude, and observation in real-life
contexts). Aligning with thematic analysis, researchers engaged in this
process by re-reading the raw data to categorize the clusters. This
axial coding involved a selective coding process, focused on refind-
ing and organizing the categories. The resulting data were then con-
solidated and reduced to derive meaning by connecting interrelated
elements (Creswell, 2013). Following the contextualization and rep-
resentation of the analyzed data, Schommer’s (1990) epistemological
beliefs were adjusted to present the relationships within each group,
serving as a framework to illustrate the patterns of these relationships.
150 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
Table 3. Basic Statistical Results by Subsets of Epistemological Belief
Dimension Subsets m sd
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 151
Figure 1. Types of Epistemological Beliefs Among Pre-service Elementary Teachers
152 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
tary and middle school teachers, and Park (2018b), who investigated
changes in epistemological beliefs before and after teaching practi-
cum among pre-service elementary teachers, both identified a group
of pre-service teachers with mixed belief types.
Cluster 2 in this study exhibits a distinctive characteristic in that
the tendencies within each of the five epistemological belief dimen-
sions are contrasting. While acknowledging variables such as Simple
Knowledge and Certain Knowledge, participants rejected the notion
of Innate Ability. This implies that Cluster 2, the Mixed group, under-
stands that knowledge to learn can develop progressively, yet they
firmly believe in the clear existence of the knowledge they need to
learn. The ambivalent responses towards Authority Source and Quick
Learning highlight the distinct characteristics of Cluster 2. Firstly, they
acknowledge that knowledge is established by authorities but do not
excessively rely on those authorities, rather embracing new perspec-
tives. Secondly, they demonstrate a nuanced stance on learning, as-
suming that if one possesses sufficient ability, rapid acquisition of
specific content is possible; however, they perceive that this does not
manifest effectively in actual learning situations.
The inconsistent response pattern of Cluster 2 may be attributed
to the previously mentioned issues with low item reliability in particu-
lar dimensions such as Authority Source, as discussed in Chapter III.
Firstly, the nature of the survey tool using a self-reported Likert scale
may have led to low response fidelity or internal inconsistency. Sec-
ondly, each area of the epistemological beliefs involves both knowl-
edge and understanding and an individual’s experiences and behav-
ioral characteristics based on those beliefs. Therefore, a gap between
an individual’s epistemological belief orientation and the manifesta-
tion of their responses can occur. Considering that all participants in
this study shared the identity of pre-service elementary teachers, it is
plausible that they consciously aligned their responses with societal
expectations of the belief expected of a teacher. This alignment could
contribute to the inconsistency observed within Cluster 2, given the
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 153
participants’ high sincerity in responding to the performance assess-
ment activities presented in the latter part of the survey.
F 30.17 27.67 41.47 31.29 34.61 21.54 15.80 7.82 40.49 57.08 4.54 6.63
ANOVA
p =.00 =.00 =.00 =.00 =.00 =.00 =.00 <.01 =.00 =.00 <.05 <.01
[Cluster 1] m 3.14 2.56 3.55 3.74 3.19 2.99 2.62 2.73 3.58 3.09 3.08 3.09
Naive
(n=37) sd 0.33 0.33 0.59 0.47 0.30 0.37 0.60 0.37 0.55 0.44 0.49 0.77
[Cluster 2] m 2.86 2.31 3.15 3.56 3.07 2.52 2.05 2.36 2.94 2.59 2.90 2.92
Mixed
(n=77) sd 0.34 0.34 0.58 0.46 0.27 0.42 0.50 0.50 0.48 0.32 0.57 0.73
[Cluster 3] m 2.51 1.99 2.36 2.96 2.64 2.33 2.02 2.51 2.58 2.19 2.67 2.47
Sophisticated
(n=36) sd 0.36 0.32 0.54 0.40 0.37 0.56 0.58 0.47 0.43 0.35 0.71 0.83
154 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
2. Epistemological beliefs in action
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 155
assessments. Among the seven categories of educational objectives,
the ‘Application (28.3%)’ area was most frequently mentioned as the
goal of performance assessments. This outcome aligns with the em-
phasis on reading various perspectives and utilizing them to solve
problems, as stated in the achievement standard itself. Notably, the
ratio of participants selecting the Knowledge area was 5.8%, contrast-
ing with these results. Also, the selection rates for the Understanding,
Analysis, and Evaluation areas were at similar levels.
Total N 37 77 36 150
n 11 9 6 26
Knowledge
In cluster (%) 29.7 11.7 16.7
n 23 36 19 78
Understanding
In cluster (%) 62.2 46.8 52.8
n 31 63 33 127
Application
In cluster (%) 83.8 81.8 91.7
n 21 39 20 80
Analysis
In cluster (%) 56.8 50.6 55.6
n 19 26 13 58
Synthesis
In cluster (%) 51.4 33.8 36.1
n 20 36 23 79
Evaluation
In cluster (%) 54.1 46.8 63.9
156 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
ter 2 (m=2.71; sd=1.11). Although the chi-square test revealed no sig-
nificant differences, the patterns of performance assessment goal-set-
ting in each cluster became more apparent through the cross-analysis
based on the epistemological belief types presented in Table 6.
All three groups predominantly selected objectives related to Un-
derstanding, Application, and Analysis for the specified achievement
criterion. However, Cluster 1 (29.7%) had a relatively higher propor-
tion of Knowledge objectives compared to Cluster 2 (11.79%) and
Cluster 3 (16.7%). Additionally, Cluster 3 (63.9%) had a relatively high-
er proportion of Evaluation objectives compared to Cluster 1 (54.1%)
and Cluster 2 (46.8%). Summarizing these results, the Naive (Cluster
1) group’s pre-service teachers exhibited a pattern of setting multiple
educational goals comprehensively for the performance assessment
task, including the Knowledge domain. On the other hand, pre-ser-
vice teachers in the Sophisticated (Cluster 3) group reflect higher-
level educational goals, such as Application, Analysis, and Evaluation,
in their tasks. The Mixed (Cluster 2) group, while having a smaller
number of selected areas, prioritized the attainment of goals related
to application.
Secondly, the response results regarding the anticipated difficulty
of performance assessments show that participants primarily expect-
ed a moderate level of difficulty for the performance assessments
they planned. Among the 150 participants, 91 pre-service teachers
(60.7%) anticipated a moderate difficulty level, while 39.3% (n=59)
expected a high difficulty level. No participants expected a low dif-
ficulty level for performance assessments. The chi-square test results
showed no significant difference in the pattern of difficulty level set-
tings for performance assessments based on epistemological belief
types (p=.696).
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 157
Table 7. Patterns of Task Types in Performance Assessments Planned by Pre-
Service Teachers
158 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
belief types: Response essay assessment (p<.05) and Other (p<.05).
Among these, only two participants from the Cluster 1 (Naive) group
selected the Other category, opting for discussion and video produc-
tion activities. In contrast, the results reveal cluster-based differences
in the use of the response essay assessment in spite of being chosen
by a majority of the total sample (44.7%). Among the three clusters,
the Sophisticated group selected the Response essay assessment type
at the highest rate (58.3%). While the Naive group also adopted this
type of task with a majority (51.4%), the Mixed group showed a lower
selection rate, with only 35.1% opting for it.
Lastly, the number of lesson hours allocated for the designed per-
formance assessments was investigated. Participants responded that
they would allocate an average of 2.9 sessions (sd=2.1) to assess the
specified achievement criteria. The ANOVA revealed no significant
difference in the allocation of sessions for performance assessments
based on epistemological belief types (F=1.425; p=.244). However,
among the three types, Cluster 1 (Naive) had the highest average
sessions allocated (m=3.30; sd=2.82), followed by Cluster 3 (Sophis-
ticated) with a higher average (m=2.93; sd=2.00). Finally, Cluster 2
(Mixed) had the lowest average sessions allocated (m=2.60; sd=1.71).
In summary, the quantitative analysis of various sub-factors that
can reveal the nature of performance assessment plans shows a lim-
ited significant difference based on epistemological belief types. An
overall trend, pre-service teachers in Korea designed performance as-
sessment tasks for 6th-grade students incorporating realistic problem-
solving and response essay-type tasks. They planned the task with an
average number of 2.9 session hours intending to observe students’
performance using multiple sessions. This constructed performance
assessment was expected to be of moderate to high difficulty for 6th-
grade students, focusing on achieving a composite Understanding,
Application, and Analysis of educational goals. The Naive group dem-
onstrated the most diverse selection of instructional goals for perfor-
mance assessment, often including lower-level educational objectives
encompassing Knowledge and Understanding domains. In contrast,
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 159
the Sophisticated group exhibited a higher proportion of goals de-
manding a higher dimension such as the Evaluation domain, actively
utilizing the Response essay assignment type. Differences were found
in the number, patterns, and types of instructional goals selected for
performance assessment, as well as in the types of assessment tasks,
based on epistemological belief groups.
Figure 2. Sample responses from the Naive Group, Mixed Group, and Sophisti-
cated Group corresponding to each category
160 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
The themes revealed by each group were classified by similar
characteristics based on categories and described according to Schom-
mer’s dimensions. Table 8 illustrates pre-service teachers’ task plan
patterns based on their responses in alignment with categories. Ad-
ditionally, to enhance the connection between sub-categories, themes
among each group, and their relevance to dimensions, a ‘contents’
column was added.
Common elements across all groups include the autonomy to
choose perspectives, allowing participants to express diverse view-
points, and exercising flexibility in their selections in the category of
Evaluation Tasks and Methods. These elements potentially align with
the explicitly indicated achievement standards of ‘presenting various
perspectives.’ A focus on the ability to read and comprehend dif-
ferent perspectives emerged as a trend among the participants, re-
flecting a common understanding of knowledge acquisition through
varied viewpoints. For example, all three groups equally emphasized
‘viewpoints/perspective analysis’ and ‘understanding perspectives’ by
indicating the need to “analyze perspectives in the given texts” or to
“understand viewpoints based on the presented situation.”
In the Mixed group, tasks and methods revolved around individu-
al perspective analysis and self-reflection, forming a common pattern
observed across all three groups. Notably, explicit presentations of
real-life situations were absent, and the proposal of multiple sessions
was not prominently featured. In the Evaluation Tasks and Methods
category, the group tended to provide related readings, exposing
participants to various perspectives, rather than presenting specific
real-life examples. Unlike the other two groups that provided specific
situations in real life, the Mixed group responses reflect a context
where perspectives are found within unspecified situations, such as
“presenting problem situations.” In terms of Specific Assessment El-
ements, the group consistently emphasized the use of ‘self-criteria’
for problem-solving, maintaining balance within Schommer’s (1990)
dimensions. Evaluation Criteria appeared less explicit in terms of the
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 161
number of proposed sessions compared to the other groups, which
aligns with the findings from the quantitative analysis. With a limited
number of proposed sessions and educational objectives, the group
showed a detailed focus on the establishment of personal criteria,
problem-solving judgment criteria, and a distinct resolution-oriented
approach.
The Naive group demonstrated a comprehensive approach
through tasks involving a realistic understanding of knowledge. Their
activities included the integration of mind maps, assessments span-
ning multiple sessions, idea boards, role-playing, discussions, and
writing to articulate personal viewpoints. In their approach to Evalu-
ation Tasks and Methods, the group demonstrated profound compre-
hension of the diversity of knowledge, specifically perspectives.
This approach reveals a strategy that goes beyond simplistic
knowledge acquisition, emphasizing the belief that diverse knowl-
edge can be acquired in real-life situations. In terms of Specific As-
sessment Elements, the Naive group exhibited a pattern akin to the
Mixed group, particularly in showcasing ‘Certain Knowledge’. Howev-
er, the distinction lies in the expression of personal viewpoints. While
both Mixed and Naive groups emphasize concrete personal perspec-
tives, the Naive group stands out in their approach. In understanding
knowledge, the presence of expressions like “critical reading” and
“accepting critically” in the context of ‘Certain Knowledge’ reveals a
recurrent theme of ‘critique’.
This pattern conflicts with Schommer’s (1990) description of the
Naive, as the group reflects knowledge not as an absolute transmis-
sion but rather as acquired through critical interpretation. It serves as
a noteworthy example of pre-service teachers adjusting their epis-
temological beliefs despite being in their developmental stage. This
intention can be interpreted as prioritizing the original purpose of
the KLE achievement standards, emphasizing an assessment of the
reading process that underscores learners’ critical interpretation and
perspective formation in educational execution. This aspect is evident
162 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
Table 8. Epistemological Beliefs in Patterns of Performance Assessment
Understanding perspectives,
Understanding perspectives,
Presenting various Knowledge acquired through presenting diverse methods,
Perspective Analysis structuring assessments over N Simple Knowledge
perspectives inference and logic. structuring assessments over
sessions
Evaluation N sessions
Tasks and
Methods Autonomy of choice Knowledge is not fixed. Organizing my perspectives Appropriation Finding viewpoints similar to mine Certain Knowledge
The ability to apply acquired The ability to apply knowledge Explaining personal choices on
Real-life application Ability to solve problems Innate Ability
knowledge in real life. in real-life scenarios perspective
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment
The capacity to transform and Effectively applying and Adequately perceiving situations
Observation in real-
apply acquired knowledge in connecting diverse viewpoints and articulating the perspective Acquiring knowledge without bias Innate Ability
life contexts
real life. in problem-solving clearly
163
in the Evaluation Criteria, where the assessment includes checking
whether the problems were comprehended and resolved critically.
Furthermore, this response underscores the practical application of
knowledge in real-life scenarios, emphasizing the prioritization of the
problem-solving process over mere resolution.
The Sophisticated group exhibited a pattern similar to that of the
Naive group in understanding perspectives, structuring assessments
over multiple sessions, and presenting real-life situations. This finding
focused on real-life applications aligns with the quantitative analysis
result that the Sophisticated group had a high tendency to choose the
Application domain in their task planning. However, in organizing
their viewpoints, the Sophisticated group employed expressions such
as “find/choose perspectives similar to their own,” contrasting with
the expressions used by the Naive and Mixed groups, which empha-
sized “establishing” and “making perspectives their own.”
This finding suggests a tendency in the Sophisticated group to
select viewpoints from the given knowledge, interpreting it as a pat-
tern of accepting knowledge as is, without transforming it, akin to
certain knowledge. In Specific Assessment Elements, expressions like
“explaining their choices” indicated an assessment pattern of choos-
ing knowledge from the given set without modifying it. Another no-
table difference lies in the emphasis on using narrative assessments
and guide materials for Evaluation Criteria. Given the nature of the
Sophisticated group, which perceives knowledge as uncertain, the
use of worksheets and textbooks, which require lengthy writing of
information, aligns with the authority source dimension, providing a
means to ascertain the diverse perspectives of students.
It is essential to acknowledge that epistemological beliefs are not
static; rather, they evolve through the interplay of personal develop-
ment and the surrounding contextual environment (Bromme et al.,
2010). Each dimension operates independently in terms of charac-
teristics and functions, and the developmental pace may vary across
dimensions. Building on Jo et al.’s (2009) insight that comprehending
164 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
an individual’s epistemological beliefs necessitates considering all di-
mensions collectively, it becomes apparent that a comprehensive ap-
proach is vital for a nuanced understanding.
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 165
evidence of pre-service teachers making efforts to plan assessments
that align with the objectives and intentions of Korean language
achievement standards, attempting to regulate their own epistemo-
logical beliefs. Sandoval et al. (2016) have defined epistemic cogni-
tion as the individual’s endeavor to contemplate their understanding,
the nature of knowledge, its practical application, and the methods
by which they ascertain the validity of their knowledge in interdis-
ciplinary fields. For example, instances from the Naive group that
emphasize critical interpretation align with the notion that knowledge
is acquired through nuanced understanding rather than passive ac-
ceptance, contrasting with Schommer’s (1990) definition. A compari-
son among the groups reveals differences in when they show their
beliefs in practical ways (i.e., performance assessment task) that these
nuances in their engagement with and interpretation of knowledge
demonstrate certain aspects of pre-service teachers’ epistemic cogni-
tion. Due to the limited research on teachers’ epistemological beliefs
in the domestic context, there is also a scarcity of studies examining
epistemic cognition. Therefore, if subsequent research focuses more
on the design of studies exploring epistemic cognition as a meta-be-
lief regulatory behavior, it could contribute to supporting the validity
of the results obtained in this study.
While all groups highlighted perspective analysis and understand-
ing, the Mixed group’s distinct expressions and the absence of real-life
scenarios indicate variations in their epistemological orientations. Al-
though the study concentrated on KLE, the findings hold potential for
broader application in other subjects or interdisciplinary contexts. Un-
derstanding these patterns is crucial for pre-service teacher education,
urging educators to recognize diverse epistemological perspectives
among students and tailor instruction to foster critical engagement
with knowledge, bridging the gap between theoretical understanding
and real-world application.
However, the study acknowledges a limitation arising from the
use of the original epistemological beliefs survey (Schommer, 1990).
166 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
The results might differ with a revised survey capturing developments
in epistemological beliefs over time. Specifically, confirmatory factor
analysis was not conducted to determine whether the survey instru-
ment was well-structured and applicable to Korean pre-service teach-
ers according to Schommer’s (1990) five factors. Due to the limited
sample size, there is also a possibility that it does not sufficiently
represent the entire population of pre-service elementary teachers in
Korea. Also, this study lacked items to assess the pre-service teachers’
background knowledge that might influence on their assessment task
planning. Despite these limitations, the study holds profound implica-
tions for understanding the dynamic relationship between pre-service
teachers’ epistemological beliefs in a natural context and their task
design in KLE, despite potential influences from coursework and the
potential applications of the relationships across diverse subjects and
disciplines. Furthermore, in order to ascertain whether the patterns
of assessment planning based on epistemological beliefs are unique
within the context of Korean language assessment, subsequent re-
search comparing other subject contexts should be conducted. Partic-
ularly, this study highlights the difference in competencies required,
as it encompasses all subjects for pre-service elementary teachers,
while pre-service secondary Korean language teachers focus specifi-
cally on KLE. Therefore, there is a need for follow-up research to
investigate the impact of epistemological beliefs among pre-service
secondary teachers.
This suggests that the study provides valuable insights that can in-
form future research and educational practices under the need for tai-
lored instructional strategies capable of accommodating diverse epis-
temological belief orientations and fostering critical engagement with
interdisciplinary knowledge. As the field progresses, further research
should delve deeper into the dynamics of epistemological beliefs,
offering a more comprehensive understanding of their development
and implications for effective teacher education. By discerning the in-
tricate connections between epistemology and assessment, educators
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 167
can refine teaching practices and better equip future teachers for the
multifaceted challenges of the classroom. It marks a significant step
toward unraveling the complex interplay between epistemology and
assessment in the context of pre-service teacher education.
* Submitted 2023.11.14.
First revision recieved 2023.11.21.
Accepted 2023.12.7.
168 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
REFERENCES
Atlı, H. H., & O’Dwyer, J. (2021). The contribution of personal epistemological beliefs
to uptake in in - service professional development: A case - study. Professional De-
velopment in Education, 0(0), 1 - 19.
Bock, A. K., & Erickson, K. A. (2015). The influence of teacher epistemology and prac-
tice on student engagement in literacy learning. Research and Practice for Per-
sons with Severe Disabilities, 40(2), 138 - 153.
Bromme, R., Pieschl, S., & Stahl, E. (2010). Epistemological beliefs are standards for
adaptive learning: A functional theory about epistemological beliefs and metacog-
nition. Metacognition and Learning, 5, 7 - 26.
Chenitz, W. C., & Swanson, J. M. (1986). From practice to grounded theory: Qualitative
research in nursing, Addison - Wesley.
Cheon, G. (1999). Performance assessment for reading. The Education of Korean Lan-
guage, 100, 201 - 224.
Cheon, G. (2001). Performance assessment and portfolio of Korean language arts, Ky-
oyookbook.
Cho, Y., & Yang, M. (2008). Secondary school teachers’ epistemological beliefs and
their relationship with teacher efficacy and instructional strategies. The Journal of
Yeolin Education, 16(1), 1 - 20.
Creswell, J. W. (2013). Qualitative inquiry research design: Choosing among five ap-
proaches, Sage.
Jang, Y., & Kwon, D. (2019). A study on the relationship between epistemological be-
liefs and learner - centered teaching orientation of the elementary school teachers.
The Journal of Elementary Education Studies, 26(1), 27 - 48.
Jo, J., Park, K., & Kang, I. (2009). The teacher’s epistemological belief and instructional
design practice. Journal of Educational Technology, 25(3), 1 - 33.
Ketabi, S., Zabihi, R., & Ghadiri, M. (2014). Pre - service English teachers’ epistemologi-
cal beliefs and their conceptions of teaching. International Journal of Research
Studies in Psychology, 3(1), 3 - 12.
Kim, N., & Yeo, S. (2022). Epistemological beliefs of elementary school teachers in sci-
ence class according to gender and teaching experience. Journal of the Korean
Association for Science Education, 42(2), 277 - 287.
Lee, S. (2008). The actual conditions and improvements of performance Assessment in
Elementary Korean Language Education. Korean Language Education Research,
32, 33 - 65.
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 169
Lunn Brownlee, J., Ferguson, L. E., & Ryan, M. (2017). Changing teachers’ epistemic
cognition: A new conceptual framework for epistemic reflexivity. Educational
Psychologist, 52(4), 242 - 252.
Maggioni, L., & Parkinson, M. M. (2008). The role of teacher epistemic cognition, epis-
temic beliefs, and calibration in instruction. Educational Psychology Review, 20,
445 - 461.
Ministry of Education (2022). Revised Korean language education instructional guid-
ance, Korea.
Mpofu, N. (2021). English language teaching in teacher education: A personal episte-
mology account. International Journal of Language Studies, 15(3), 89 - 106.
Newell, G. E., VanDerHeide, J., & Olsen, A. W. (2014). High school English language
arts teachers’ argumentative epistemologies for teaching writing. Research in the
Teaching of English, 49(2), 95 - 119.
Oh, S., & Lee, S. (2013). The effects of pre - service teachers’ epistemological beliefs
and self regulated learning on well - structured and ill - structured problem solving.
The Journal of Korean Teacher Education, 30(3), 75 - 99.
Park, K. (2018a). A study on elementary pre - service teachers’ change of epistemologi-
cal belief and conception of instruction through teaching practice. Journal of
Learner - Centered Curriculum and Instruction, 18(19), 109 - 126.
Park, K. (2018b). The relationship between elementary pre - service teachers’ epistemo-
logical belief and their instructional planning. The Journal of Curriculum Studies,
36(1), 25 - 44.
Ryu, S., Chung, H., & Min, B. (2021). Optimization behaviors of a teacher focusing on
curriculum - instruction - evaluation integration: A case study of constructive incon-
sistency in a Korean language class. The Journal of Curriculum Studies, 39(4),
61 - 90.
Sandoval, W. A., Greene, J. A., & Bråten, I. (2016). Understanding and promoting think-
ing about knowledge: Origins, issues, and future directions of research on epis-
temic cognition, Review of Research in Education, 40(1), 457 - 496.
Scardamalia, M., & Bereiter, C. (1987). Knowledge telling and knowledge transforming
in written composition. In S. Rosenberg (Eds.), Advances in applied psycholin-
guistics (Vol. 2): Reading, writing, and language learning (pp.142 - 175), Cam-
bridge University Press.
Schommer, M. (1990). Effects of beliefs about the nature of knowledge on comprehen-
sion. Journal of Educational Psychology, 82(3), 498 - 504.
Schommer, M. (1993). Epistemological development and academic performance among
secondary students. Journal of Educational Psychology, 85(3), 406 - 411.
170 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023
Schommer, M. (1994). Synthesizing epistemological belief research: tentative under-
standings and provocative confusions. Educational Psychology Review, 6(4), 293 -
319.
Schommer - Aikins, M. (2004). Explaining the epistemological belief system: Introducing
the embedded systemic model and coordinated research approach. Educational
Psychologist, 39(1), 19 - 29.
Soleimani, N. (2020). ELT teachers’ epistemological beliefs and dominant teaching
style: A mixed method research. Asian - Pacific Journal of Second and Foreign
Language Education, 5, 1 - 20.
Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and proce-
dures for developing grounded theory, Sage.
Sung, K., Shin, M., & Kim, E. (2020). An explorative analysis on the epistemological be-
liefs in science of elementary school students and teachers. School Science Jour-
nal, 14(4), 441 - 454.
Ubaque - Casallas, D. F., & Aguirre - Garzón, E. (2020). Re - signifying teacher episte-
mologies through lesson planning: A study on language student teachers. Profile:
Issues in Teachers Professional Development, 22(2), 131 - 144.
Viholainen, A., Asikainen, M., & Hirvonen, P. E. (2017). Mathematics student teachers’
epistemological beliefs about the nature of mathematics and the goals of math-
ematics teaching and learning in the beginning of their studies. Eurasia Journal
of Mathematics, Science and Technology Education, 10(2), 159 - 171.
Wolf, K. P. (1993). From informal to informed assessment: Recognizing the role of the
classroom teacher, Journal of Reading, 36(7), 518 - 523.
Yadav, A., & Koehler, M. (2007). The role of epistemological beliefs in preservice teach-
ers’ interpretation of video cases of early - grade literacy instruction. Journal of
Technology and Teacher Education, 15(3), 335 - 361.
Yilmaz, H., & Sahin, S. (2011). Pre - service teachers’ epistemological beliefs and con-
ceptions of teaching. Australian Journal of Teacher Education, 36(1), 73 - 88.
Unveiling Pre-Service Teachers’ Epistemological Beliefs in the Planning of Korean Language Assessment 171
ABSTRACT
172 KOREAN LANGUAGE EDUCATION RESEARCH / Vol. 58, No.5, Dec. 2023