1 s2.0 S2666920X22000170 Main
1 s2.0 S2666920X22000170 Main
1 s2.0 S2666920X22000170 Main
A R T I C L E I N F O
Keywords:
AI & learning
Preferred future for learning
Autonomous learner
Learning science
Multi-sensory engagement
Intelligent learning systems
https://doi.org/10.1016/j.caeai.2022.100062
Received 28 November 2021; Received in revised form 19 February 2022; Accepted 8 March 2022
Available online 18 March 2022
2666-920X/© 2022 Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
2
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
AIEd, Educational Data Mining, Computer-Based Education, and Some research studies (Pinkwart, 2016; Rummel et al., 2016; Schiff,
Learning Analytics. The findings relevant to this paper are that little 2020) have specifically focused on predicting a future for AIED. Pink
work had been conducted to bring deep learning technologies into wart (2016) presents two possible futures - a utopian vision and a
educational contexts; natural language processing (NLP) technologies dystopian vision. Comparing the two extreme scenarios, the author
were commonly adopted in educational contexts, while more advanced summarizes seven challenges AIED might have to face in the future:
techniques were rarely adopted and there was a lack of studies that both cultural context, practical impact, privacy, interaction methods,
employ AI technologies and engage deeply with educational theories. collaboration at scale, effectiveness in multiple domains, and the need
Their recommendations are to seek the potential of applying AI in for greater importance for the role of AIED in educational technology. In
physical classroom settings, spare efforts to recognize detailed entail our opinion, all seven are valid issues to be addressed if AIED is to
ment relationships between learners’ answers and the desired concep succeed at scale. The author does not present any systemic solution to
tual understanding within intelligent tutoring systems; pay more address the challenges.
attention to the adoption of advanced deep learning algorithms such as Rummel et al. (2016) similarly present areas of research they
generative adversarial network and deep neural network; seek the po consider important to avoid the pitfalls of a Dystopian view of the future
tential of NLP in promoting precision or personalized education; of adaptive collaborative learning support (ACLS). Specifically, they
combine biomedical detection and imaging technologies; and closely advocate the need to work towards a comprehensive instructional
incorporate the application of AI technologies with educational theories. framework building on educational theory in order to provide nuanced
We agree with many of their recommendations but have to issue a word and flexible (i.e. intelligent) ACLS to collaborative learners. We agree
of caution about the one suggesting greater adoption of deep learning with the basic premise of their recommendation – the need for nuanced
technologies. and flexible personalized learning support based on educational theory
The above reviews provide valuable summaries of the progress AIED and findings. In fact, the framework proposed in this paper reflects a
has made, especially in personalized and adaptive learning. Broadly the similar underlying rationale.
findings support the hypothesis that personalization makes a difference Schiff (2020) reviews the status of AIED, specifically intelligent
when learner characteristics and differences are carefully considered. tutoring systems and educational agents, and attempts to provide
The trend towards more explicit measurement of learning outcomes is development pathways for AIED in the future. The study notes in
healthy and much needed. In incorporating learning styles, extant particular that MOOCs didn’t succeed widely because of a mistaken
research with the exception of Srinivasan and Murthy (2021) does not assumption of technological linearity and their inability to reproduce
consider the beneficial impact of engaging multiple sensory channels. the in person teacher-student interaction. Overall, he points out that the
The extant research also does not explicitly propose a generalized previous round of educational technologies were not as successful
framework for integrating findings from learning science. Granular because of quality gaps in their implementation. Schiff (2020) presents
personalization governed by learning styles including the influence of two competing futures for AIED – one rooted in efficiency through
different sensory modes is integral to a more holistic AI-led learning automation and the second rooted in robust differentiation at a student
framework. level. In our opinion, we do not see them as competing. AI technologies
Another area that has attracted significant attention is essay grading/ can enable us to achieve both efficiency and individualized learning.
grading of open text responses. (Janda et al., 2019). However, most of In addition to the challenges identified by Pinkwart (2016), AIED
the solutions, if not all are black boxes and not considered viable or also has to address broader challenges with AI – explainability, tracta
effective. By relying on word based statistical models, none of the bility, reliability of data, and full context awareness, in adopting a
‘Automated Essay Evaluation’ systems capture the real meaning of the purely data driven approach to intelligence acquisition (Marcus, 2020;
essay and its relevance to the related learning content. They suffer from D’Amour et al., 2020; Srinivasan, 2017). No amount of data will ever be
other serious limitations – the need for large amount of data for training, complete (Srinivasan, 2017) and the resulting models will contain
the resulting bias, the lack of traceability and the lack of tractability. whatever biases the data has. Explainability will be critical for many
Since the model training is entirely dependent on the data set, they have AIED applications,. A third challenge is tractability. The only way to
been criticized for not being able to recognize gibberish essays [Kolo improve models purely dependent on data is to add more data and hope
wich, 2014] and essays that reflect divergent thinking. They are also not it will improve the model. Revised models with additional data may
configurable for course specific essay assignments since the rubric may change previous results which in some cases creates issues of repro
vary from course to course and there will not be enough data for training ducibility. Finally, in some areas like essay grading and natural language
a statistical model in such cases. Unfortunately, this has resulted in the processing, current technologies do not have the ability to retain full
use of multiple choice assessments and the use of ‘peer grading’ for open context. Neural language models like BERT (Bidirectional Encoder
text responses in online learning. Given the importance of ‘writing’ to Representation from Transformers) for example are word pattern based
reflect complete understanding, AIED needs to focus on automated and do not understand the text despite an attempt to incorporate word
evaluation of text responses with full understanding of the learning level distributional semantics using embeddings, see e.g., Bender and
objectives/rubric and learning material. Koller (2020).
An area of significant concern in developing and implementing AI Barring the issue of bias (Yang et. al., 2019), much of the AIED
applications is the potential misuse of AI, specifically the issue of ‘bias’ literature while extensive has not yet really recognized the implications
from reliance on data and the need for governance. Bias from data is a of these fundamental challenges in the use and adoption of AI for
significant issue which inherently makes all statistical deep learning learning. Some authors even suggest AIED research should adopt more
models unusable. Digital Promise [www.digitalpromise.org] has sophisticated methods like deep neural network models. In our view,
recently introduced a certification product which prioritizes racial eq blind focus on methods without rationale on why and how that would
uity by proactively identifying and minimizing racial bias in a product’s benefit learning will not lead to advances in the use of AI for learning.
algorithms and design. Yang et al. (2019) propose that AI can evolve into
human centered AI (HAI). In particular, they draw attention to how AI 2.2. The changing role of the teacher
can inhibit the human condition and advocate for an in-depth dialog
between technology and human-based researchers to improve under Since the days of the industrial revolution, the widely prevalent
standing of HAI from various perspectives. Yang et. al. (2019) however teaching/learning model used to center around a human teacher. As
do not recognize or provide any solutions to address the root causes of shown in Fig. 1, a good teacher had to be a subject matter expert and be
data driven bias. In our opinion, AIED needs to adopt explainable and current all the time, be an expert in the pedagogy relevant to that subject
tractable models of intelligence acquisition. and had to be an expert at effectively imparting the subject using the
3
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
4
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
Over the last few decades, there has been considerable advancement
in our understanding of how our brains construct and retain knowledge,
i.e., how we learn. A systematic integration of these findings offer a
tremendous opportunity to maximize the learning potential of every
learner.
Our brains are believed to store knowledge in structures commonly
referred to as schemas. It has also been found that our brains encode new
information that fits prior knowledge more efficiently than when in
formation is novel [van Kesteren et al., 2012]. Recent findings across
neuroscience [St Jacques et al., 2013], psychology [Roediger and
Mcdermott, 1995 and educational science [Castro Sotos et al., 2007]
suggest that when a schema becomes too strong it can end up facilitating
the formation of false memories and misconceptions. False memories
and misconceptions obviously signify a major burden for learning. Fig. 3. Knowledge construction in the brain.
In terms of the process of knowledge construction, our brains have
been found to follow a set of sequential processes to construct knowl timeline t, this episodic detail semanticizes where we start losing the rich
edge [Paller & Wagner, 2002]. First, new information becomes encoded detail. At some point, we will barely remember the specifics except for
into a memory. Right after encoding, a memory is usually episodically some aspect of the event if it made a very deep impression on us. The
detailed, containing details about time, place and context. Over time, process of episodic memory gradually being absorbed into long term
encoded memories are consolidated during sleep (and presumably also memory depends a lot on our pre-existing knowledge schema in our
during rest). It is generally believed that consolidation semanticizes brain. As we try to recall this episodic event over time, the degree of
memories such that episodic details fade away and what remains is a specificity of our recall will vary based on when along time we try our
more abstract version of the encoded memory. This is illustrated in recall. This is illustrated by the arrow from the timeline t to ‘3 Recall’.
Fig. 3. Generally, when memories are retrieved after consolidation, they
Fig. 3 shows an episode getting captured initially at the time we have a different neural architecture than when they were first encoded
witness it as episodic memory in rich detail. Over time, illustrated by the
5
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
[Dudai et al., 2015]. Moreover, they do not always contain the same oral texts ranging from 40,000 to over 100,000 words, numerous regions
details, showing that memories are altered over time beyond our in the brains of the pandits were dramatically larger than those of
conscious awareness and are not retrieved as a solid entity, but rather controls, with over 10 percent more grey matter across both cerebral
reconstructed depending on present cues. The act of retrieval is gener hemispheres, and substantial increases in cortical thickness (“the
ally thought to alter a memory again, updating it with previously and famous Sanskrit Effect”) [Hartzwell, 2018]. Textual memorization is
currently learned or retrieved information. Memories are then recon standard in India’s ancient learning methods and it is widely believed
solidated into existing schemas, and in this way, schemas are thought to that exactly memorizing and reciting the ancient scripts, enhances both
be continuously adjusted to optimize our understanding of the world memory and thinking. There are other studies [Gao et al., 2019; Kamal
around us and to allow prediction of future occurrences [Benoit et al., et al., 2013] which report a significant deactivation of certain areas of
2014]. the brain as a result of religious chanting indicating relaxation and a
Also, it is generally accepted that our brains have evolved to predict meditative impact.
what will happen next. Our brain is continuously absorbing information
from the environment to expand its world model and optimize its in
ternal predictive model. Conversely, detailed episodic memories are also 2.5. The constructivist theory of education
valuable as they can help to update the model when the world happens
to change. In terms of learning, the learner’s pre-existing world model as Educational psychologists have also attempted to recognize how
it relates to the material being learned will have a huge influence on how cognitive processes work and have advocated a theory of learning called
effectively they learn. Active learning [Bonwell & Eison, 1991] is widely the Constructivist Theory of Education [Pass, 2004, p. 74]. It refers to
regarded as a seminal attempt to reflect this process in learning. the idea that learners construct knowledge for themselves and such
Based on the above review of how our brains structure knowledge knowledge construction is dependent on what their existing knowledge
and incorporate new information, it would appear that the way to schema is. Such thinking has led to the idea of ‘Active Learning’.
optimize the learning potential for a learner will be to create the best Bonwell and Eison [1991] defined active learning as “instructional ac
possible memory with both semantic and episodic details. van Kesteren tivities involving students in doing things and thinking about what they
and Meeter [2020] summarize specific actions during encoding, are doing”. Approaches that promote active learning require that stu
consolidation and retrieval that can contribute to the best possible dents do something—read, discuss, write—that requires higher-order
memory for a learner. Many of these are summarized in Fig. 4. thinking. They also tend to place some emphasis on students’ explora
In a related vein, Ghazanfar and Schroeder (2006) also find that the tions of their own attitudes and values. Approaches that promote active
brain has evolved to operate optimally in multisensory environments. If learning often explicitly ask students to make connections between new
a classroom exercise stimulates more than one of the learner’s senses at information and their current mental models, extending their under
any given time, multiple channels of the brain work to process the same standing. Fig. 6 lists various techniques to achieve ‘Active Learning’ in
information, and the brain devotes more cognitive resources to that the physical class room.
information. In addition, the brain creates some interactivity between Techniques to replace some lecturing as part of active learning have
the two modes, essentially storing the information cross-referenced be also been suggested including case-based learning, concept maps
tween the channels [Clark et al., 1991]. Thus, multisensory engagement [Novak & Canas, 2008], student-generated test questions [Angelo &
may accelerate efficient knowledge construction in the brain. Cross, 1993]. There are also other active learning pedagogies many of
Researchers at the University of Waterloo [Forrin & MacLeod, 2017] which have strong following including team-based learning,
found that speaking text aloud helps to get words into long-term process-oriented guided inquiry learning, peer-led team learning, flip
memory. The study determined that it is the dual action of speaking ped classroom model and problem-based learning.
and hearing oneself that has the most beneficial impact on memory. Several of the techniques listed in Fig. 5 signal that writing is the
Very related is the practice of rote memorization where a learner repeats most effective way to reflect understanding. It is a very critical part of all
long passages of text from memory. While its standalone impact on three phases of knowledge construction – encoding, consolidation and
learning is not proven, its general beneficial impact in improving grey retrieval. In fact, complete understanding can only be assessed based on
matter is well established. In a study of India’s Vedic Sanskrit pandits essay and open text responses. Yet, in today’s instructional settings, few
who train for years to orally memorize and exactly recite 3000-year old courses incorporate open text assessments extensively; open text ques
tions have been replaced with multiple choice questions. This is because
6
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
teachers and institutions do not have the time to assess open text re learning science. These have not been explicitly reflected in the studies
sponses. Clearly, AI can play a significant role in this context. envisioning a future evolution of AIED or the AIED taxonomies proposed
Many of the Active Learning techniques are variations on findings by in the literature. While there are many successful instances in the real
neuroscience researchers. world where these findings have been used, it is largely left to the
teacher to incorporate them as they see fit. There has been no systematic
effort at the institutional level to integrate learning science techniques
2.6. Literature review summary into their curricula. One reason for this could be that it is difficult and
cumbersome to implement these techniques manually. AI holds out a
We have reviewed the literature in 4 areas that we believe are highly significant possibility to address this challenge.
relevant in the context of a holistic, integrated framework for a preferred In summary, while prior AIED research has made many valuable
AI-led future for learning. We summarize our overall findings here. contributions, we believe there is a need for conceptualizing a holistic
The AIED research reviewed in 2.1 has focused on applications of AI actionable framework reflecting the role of AI in learning.
to specific issues in learning and education. We have presented overall
findings of many of these studies as reported by several meta studies. 3. A preferred future for AI-Enabled learning
More important, we have highlighted throughout the review the limi
tations and challenges of AI applications in education. Some authors In this section, we present a preferred future for the role AI can play
have proposed taxonomies for organizing AIED research meaningfully in achieving effective learning at scale equitably. Our preferred future is
and a few have proposed their vision of a future for educational tech presented in the form of a comprehensive solution framework.
nology. Research on future pathways for AIED is partial or high level The framework approaches learning holistically and attempts to
without any specific actionable technology solution blueprint. integrate foundational learning, learning science and personalization. In
In section 2.2, research related to the changing role of teachers the process, it also addresses the gaps in the AIED literature identified in
validates their evolution as coach and facilitator but prior work in that the previous section. The framework comprises several components
field has not really integrated how AI technology can facilitate their each of which can scale specific aspects of learning irrespective of the
evolving role and scale quality education at scale. Further, there does subject. It comprises foundational components for learning combined
not appear to be any specific research related to how AI technology can with learning science optimized functional content for any topic or
address the knowledge gap created by the continuous flow of new subject or field. The framework brings together all the individual com
information. ponents through a Learning Orchestrator personalized to the individual
In section 2.3, we summarize the literature related to parental learner. Together, it provides a robust foundation that can act as a
involvement in student learning. Contrary to popular belief, the litera framework for any AIED application. The framework is also equally
ture does not seem uniformly conclusive about the beneficial impact of relevant to other stakeholders in the learning process – teachers, par
parental involvement. We did not find any direct study on how AI ents, peers, mentors, educational institution and other learning envi
technology can help parents be effective and potentially even obviate ronments such as corporations interested in re-skilling or up-skilling
the need for parents to play the role of teachers especially if they are not employees.
proficient with the subject. For the purposes of the framework, we define AI to be synonymous
Finally, section 2.4 reviews literature on knowledge construction and
7
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
with intelligent machines which can perform tasks that humans do. In compared algorithmically against a gold standard version. Discrepancies
telligence acquisition for these machines can be from data, from experts are analyzed presented at the syllable and phoneme level. Learners in
or from both. For most real world usage, intelligence acquisition will lower grades can use this feedback to improve their reading skills on
likely be a combination of expert intelligence and intelligence acquired their own. An adaptive personalizer presents appropriate practice pas
from data as shown in Fig. 6. We refer to this as ‘computational intel sages or words based on an analysis of areas where the learner is having
ligence’. Hence, we define AIED applications as those which incorporate difficulty consistently.
computational intelligence. Further, we propose that in the framework Another set of learners who will find this level of functionality
all AI models be explainable except in cases where explainability is not valuable are non-native (English) learners. For learners in higher grades,
needed. the Reading Assistant serves as a way of accelerating long-term memory
Explainable AI is where the specifics of the AI model, like its features, formation.
is clearly visible and understandable by subject matter experts. Deep
learning using neural networks produce black boxes which are not 3.2. Comprehension assistant
currently explainable. Methods like random forest, CART, natural lan
guage processing technologies like Gyan [www.gyanAI.com] which do The Comprehension Assistant (Fig. 8) is another foundational
not rely on statistical language models e.g., BERT and GPT3 (Generative component applicable to all content regardless of grade. The goal of this
Pre-trained Transfomer 3), are explainable. Deep neural networks may component is to accelerate understanding a word or concept, in context.
be acceptable in areas where it is not essential for the user or modeler to The Comprehension Assistant presents a ‘Meaning Graph’, which is a
understand model specifics or validate causality. network of concepts related to the word along with how they are related.
We also believe the framework must reduce reliance on the need for We believe presenting such a network of related concepts enables
large amounts of data by increasing reliance on expert knowledge where stronger memory formation.
available. A hybrid approach to knowledge acquisition can reduce the The Comprehension Assistant also allows the learner to become
dependence on large amounts of data and minimize data specific issues familiar with all the senses in which the word can be used and their
like bias. Tractability is another preferred aspect. If the only way to associated learning graphs or semantic network. Activity based learning
improve the model is to add more data without understanding whether methods and assessments can be based off of the full range of the word’s
it will improve or worsen the outcomes, it is less preferable. Again, if we semantic networks.
relied on expert knowledge for a priori feature engineering and used
explainable methods, the resulting models will be more tractable.
3.3. Cognitive learning optimizer
The framework components are briefly described below:
8
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
curriculum including materials and then an ongoing effort to integrate individual learner.
new material for existing courses and new courses. Another interesting area of future development is the possible
In a pioneering effort, Digital Promise has created Learner Models identification of the preferred learning mode for an individual learner by
rooted in research-based factors and strategies that honor the whole analyzing signals in brain waves through brain computer interfaces
child and adult learners to help instructors and edtech product de (BCI). Currently, BCI relies mostly on electroencephalography (EEG) for
velopers reach each learner in every learning environment (https://di monitoring the electrical activity of the brain. Using AI and non-invasive
gitalpromise.org/initiative/learner-variability-project/about/). Their sensors in wearable devices such as headbands and earbuds, it is now
models can be a starting point in the creation of automated AI algo becoming possible to analyze and extract relevant brain patterns (Rashid
rithms to optimize learning content. Of course, the framework needs to et al., 2020). Analysis of brain signals can be used for detecting
go beyond such learning models and adapt such models for each engagement levels and whether someone is focused or distracted. It can
9
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
10
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
findings.
GyanAI [www.gyanAI.com] has created a graphical representation
of content for the purpose of learning, ‘Learning Graphs’ (Fig. 11). We
illustrated a learning graph earlier in the context of the Comprehension
Assistant. Learning Graphs contain the essence of the document in a
graphical form in the form of a network of concepts and concept re
lationships. It is presented in layers to promote easy understanding. The
central theme of the document is displayed first along with other major
concepts in the document. The user can then expand the graph along the
path they want to learn or explore. For e.g., they allow the learner to
traverse a book in a non-linear fashion if desired. The idea is that some
learners are comfortable with reading long written text and others prefer
visualization of the ideas in the text. Learning Graphs are a variation of
Concept or Knowledge Graphs with a focus on helping the learner un
derstand and comprehend chunks of material at a time driven by
learner’s interest.
Learning graphs can also be aggregated across multiple documents to
create a synthesized learning graph. Fig. 11 illustrates a synthesized
learning graph across three documents. The combined learning graph
can enable a reader to understand the contents of multiple documents
Fig. 10. Multi-sensory engagement. without having to read through redundant concepts in each document.
knowledge, see Nickel et al. (2016). Knowledge graphs are however 3.4. Automated open text assessment/assisted writing
largely limited to definitional extensions of knowledge, encapsulating
relationships like ‘also known as’, ‘is a type of’ etc. Automated grading of essays/open text responses and assisted
Mayer [2010] present the results of their detailed experiments on writing are more or less two sides of the same coin. Effective writing is
ways of optimizing cognitive load by reducing extraneous processing. not only about communicating effectively to an audience but also about
For example, people can learn better from black-and-white line draw cementing memory formation and knowledge in the writer’s brain.
ings than from color photographs, when interesting but irrelevant stories Natural language processing technologies (BERT, GPT3) provide a less
are deleted, or when stunning but irrelevant video is deleted. A second than full context ability to generate text. We see them deployed in many
example is that a lesson on how the heart works is more effective when it email and short text writing environments where they guess the next
contains headings that correspond to each of the main steps in a process. word or a reply. But as Marcus (2020) points out they can also generate
Another example, in a figure depicting the human heart, is to place text nonsensical text since they do not really understand the full context and
describing each chamber next to the corresponding chamber. In gener lack the ability to do what we might refer to as ‘common sense infer
ating learning optimized versions of learning material, we envision the encing’. Besides these language models, there are many grammar
framework to be able to suggest changes to the content to reflect Mayer’s checkers, which attempt to identify grammatical errors in one’s writing
and in many cases, suggest corrections. A more complete, fully
11
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
contextual writing assistant will be able to guide the writer with the help Grader’s assessment. This grader can also be used as a Writing
of ‘Learning Graphs’ for any concept reflecting global knowledge about Assistant.
that concept and commonly accepted rhetorical rules about effective
writing. We envision such a Writing Assistant to be part of the 3.5. Personalized learning orchestrator
framework.
The same component can be used for open text assessment. Forma As reviewed earlier, there has been substantial AIED research on the
tive and ongoing assessments are an integral part of assessing the effi benefits of personalization. An adaptive personalization component is
cacy of the educational technology, pedagogy and content. Nowadays integral to any AIED framework. It should identify the learning prefer
many courses/curricula rely mostly on multiple choice questions and ences of every learner over time and attempt to personalize their
minimize open text questions. However, complete understanding of a learning experience and optimize their learning potential [Fig. 13]. The
concept or learning unit is only possible through open text responses. It Personalized Learning Orchestrator includes a personalizer and an
is widely recognized that the inability to do open text assessment at orchestrator with the former continually personalizing the learning
scale is holding back the growth of online learning [e.g., Haldi, 2020]. It content and the latter performing the orchestration with the learner. The
is also well understood that human grading of essays is fraught with component will also integrate multisensory engagement and a cognitive
inconsistencies and other human limitations such as recency bias. load optimizer. This can be done by creating an initial set of granular
Different graders of the same essay are quite likely to grade it differently. learning pathways for the course or learning unit, identifying the com
On top of the limitations of human grading, online learning has adopted bination of learning science mechanisms that work best for a learner and
‘peer grading’. being capable of multisensory engagement with the learner including
The open text assessment component should be configurable easily at contextually rich interactive conversation. The Personalizer should also
a course or learning unit level. It should also be able to analyze the be capable of accommodating personalization at a very granular level in
response in the context of the complete learning content the learner was the learning unit, say at an individual concept level.
exposed to. It should be completely explainable and not need large We envision the creation of a meta taxonomy of learning types over
amounts of data for training. time where each atomic learning item can be categorized into a more
We report results from an explainable, course-configurable Essay abstract learning type. This might allow us to understand learning
Grader at a prominent, globally respected higher educational institution preferences at a more abstract learning type level.
which currently uses peer grading in its online courses for open text At a more macro level, the Personalizer can also use machine
response assessment. The Essay Grader was tested on a sample question learning to see if there are systemic reasons for success in specific atomic
from an engineering course. The Grader was configured to reflect the learning items or in abstract learning types across a learning cohort like
professor’s course-level rubric for grading, and considered all the a class, school or a collection of schools. The Personalizer will track
reading materials relevant for the assignment. Fig. 12 displays a com where a learner is having difficulty and provide an appropriate inter
parison of the Grader’s automated score, peer grades, and grading by 3 vention. The intervention will require the framework to assess if the
teaching assistants (TAs) who graded the same essays manually. difficulty is due to lack of prerequisite knowledge and/or difficulty
As we can see, the peer graded scores were perfect for all 10 students. understanding the material. For the former, the framework should allow
The TA scores had a wide dispersion for the same essay. The automated for the learner to access prerequisite materials and become more pro
grader had a tighter dispersion of scores for the 10 students. For each of ficient where possible. For the latter, the framework should present
the automated assessments, a detailed reasoning report was provided to additional examples, practice problems to provide the learner an op
the professor/institution explaining how the Grader arrived at the final portunity for repetition. It can also incorporate these findings in the
score/grade. In all the cases, the professor and TAs agreed with the interleaving and spacing strategy for the remainder of the course. The
Fig. 12. The explainable essay grader example (Max score = 15).
12
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
course pathway becomes personalized for the learner with timely developments in their field.
remedial interventions. The framework envisions a continuous knowledge acquirer which
would discover new relevant knowledge dynamically and present it to
3.6. Parents/para educators the learner/teacher (Fig. 14). It will access relevant content from the
internet [or other sources] on any topic, auto-curate, auto-synthesize
Parent involvement has been a major cornerstone of several imme continuously on its own. The knowledge discovery feature can be
diate past Presidents educational initiatives - President Obama’s “Race applied to any concept or topic of interest. Depending on context, the
to the Top” initiative, former President Bush’s No Child Left Behind newly discovered content can be staged for the teacher/author to review
initiative, former President Clinton’s 1996 Elementary and Secondary before presenting to the learner.
Act, and former President Reagan’s Goals 2000: Educate America Act, GyanAI [www.gyanai.com] has developed the first on-demand
and is actively promoted in national programs and initiatives (e.g. Head continuous knowledge acquisition engine, Gyan which can provide
Start). However, previous research shows inconsistent relationships auto-curated, auto-synthesized knowledge on any topic any time. Fig. 15
between parent involvement and academic achievement. shows a snapshot from Gyan has automatically found the relevant arti
While we can debate the impact of parental involvement on chil cles for the user’s topic of interest, created an appropriate table of
dren’s education, the pandemic has forced increased involvement of contents, categorized relevant articles and also created a synthesized
parents. This has resulted in a need to train parents on how to be learning graph on the right.
effective in teaching and monitoring learning at home. The AI-enabled Gyan can continuously keep this knowledge updated for any or all
framework presented in the next section eases parental burden and en concepts in the learning graph.
ables effective learning even in a completely remote learning environ
ment. The framework envisions a personalized learning orchestrator 3.8. The complete framework
which can work in an interactive fashion with the learner. Parents do not
have to take on the role of a teacher unless they want to. The framework Fig. 16 combines all the components described in this section into a
also envisions peers and learning communities as part of the learning complete framework. We envision the following components:
network. This can also ease the burden on parents. Reading Assistant – enables read aloud of any content with the
ability for the learner to control their reading.
3.7. Continuous knowledge acquirer Comprehension Assistant – facilitates understanding of specific
concepts with learning graphs.
As pointed out earlier, knowledge is continuously growing on the Automated Grader – assesses open text response in a traceable
internet on every conceivable topic. While foundational concepts and manner providing the assessor/learner complete visibility into assess
facts may not change in most cases, it will be important to have access to ment reasoning. The grader can be configured to course/assessment
new knowledge on a continuous basis. This will serve three purposes. specific rubric.
First, additional material may be useful to enhance a learner’s under Dynamic Learning Optimized Content – integrates new content/
standing of the topic/concept as they are going through a learning knowledge with existing course content/curriculum using learning sci
program. Second, this is a way for the learner to keep learning contin ence algorithms and the human teacher’s input.
uously. Third, a teacher needs an easy way to be up to date with new Learning Science Algorithms/Learning Optimizer – converts content
13
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
to be optimized for learning reflecting learning science. Continuous Knowledge – acquires relevant knowledge continuously
Learning Lab Certification – educational institutions may need to on any set of topics from any collection of sources, auto synthesizes with
create a common competency to ensure that all their offerings are existing content in a variety of forms.
properly and consistently optimized for learning. There are other important actors including peers and learning com
Personalized Learning Orchestrator – orchestrates the learner’s munities whose role can also be facilitated by the framework
learning according to the learning objectives of the course leveraging the appropriately.
other components and personalizes to the learner using machine
learning based on the learner’s preferences, performance as the course
progresses.
14
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
4. Educational institution centric view existing content repositories and the public internet. We envision that in
the future, institutions will be substantially driven by a job market
The previous section has presented our vision of an AI-enabled future which is increasingly competency based. The institution will need to
for learning from a student centric point of view. An equivalent frame rapidly design learning content in response to such market demand at an
work can also be envisioned for the educational institution and for a industry or even a company specific level. The framework envisions the
corporation interested in up-skilling or re-skilling its employees or in use of AI in rapidly designing the required learning content.
continuous talent optimization. Fig. 17 presents a dynamic learning The second aspect is that of re-skilling or up-skilling or merely life
framework from an educational institution/corporation perspective. long learning. Here a learner needs to qualify for a specific job or role.
There are two aspects to note here. The first is the need for a dynamic Fig. 17 shows how the framework can support automated identification
course authoring framework which can find relevant content from of the learner’s current skill from their resume and the normalization of
15
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
such extracted skills with reference to a skills taxonomy. It also imagines Fourth, the intervention must be adapted to fit in the local envi
the determination of personalized learning pathways for the learner to ronment as suggested in the literature. Language, culture, practices in
achieve the competencies needed. Not all learners are at the same place. the local environment must be considered in the implementation plan.
The personalized learning pathways are determined by identifying the Finally, the framework can enable as much privacy as desired. Sensitive
learner’s skills from their resume, and matching it with the skills data like learner performance and learning style, can be protected where
required for the learning content and identifying a specific learning needed.
pathway. We have also illustrated implementations of several framework
The same framework is applicable for the corporation aiming to components individually and in combination - reading assistant,
optimize its talent pool or an individual wanting to re-skill or up-skill. comprehension assistant, multisensory engagement, cognitive load
optimization, continuous knowledge discovery and dynamic content
5. Summary creation.
16
V. Srinivasan Computers and Education: Artificial Intelligence 3 (2022) 100062
Chih-Hsiang, W., et al. (2013). A mindtool-based collaborative learning approach to Mayer, R. E. (2010). Applying the science of learning to medical education. Medical
enhancing students’ innovative performance in management courses. Australasian Education, 44, 543–549, 2010.
Journal of Educational Technology, 29(1). McNeal, R. E., Jr. (2014). Parent involvement, academic achievement and the role of
Clark, J., et al. (1991). Dual coding theory and education. Educational Psychology Review, student attitudes and behaviors as mediators. Universal Journal of Educational
3, 149–210. Research, 2(8), 564–576. https://doi.org/10.13189/ujer.2014, 2014 http://www.
CNBC. (2020). https://www.cnbc.com/2020/02/12/bill-and-melinda-gates-say-educat hrpub.org.
ion-philanthropy-is-not-having-impact.html. Muller, C. (1998). Gender differences in parental involvement and adolescents’
Coleman, J. (1991). Parent involvement in education. Policy perspective. Office of educational mathematics achievement. Sociology of Education, 71, 336–356.
research and improvement. Washington, D.C.: U.S. Department of Education. Nickel, M., et al. (2016). A review of relational machine learning for knowledge graphs.
D’Amour, et al. (2020). Underspecification presents challenges for credibility in modern Proceedings of the IEEE, 104(1), 11–33. Jan. 2016.
machine learning. https://arxiv.org/abs/2011.03395. arXiv.org. Novak, J. D., & Canas, A. J. (2008). The theory underlying concept maps and how to
Domina, T. (2005). Leveling the home advantage: Assessing the effectiveness of parent construct and use them. Technical Report IHMC.
involvement in elementary school. Sociology of Education, 78, 233–249. Paller, K. A., & Wagner, A. D. (2002). Observing the transformation of experience into
Dudai, Y., Karni, A., & Born, J. (2015). The consolidation and transformation of memory. memory. Trends in Cognitive Sciences, 6, 93–102, 2002.
Neuron, 88, 20–32. Pass, S. (2004). Parallel paths to constructivism: Jean Piaget and Lev Vygotsky. Information
El Nokali, N., Bachman, N., & Votruba-Drzal, E. (2010). Parent involvement and Age Publishing, ISBN 1593111452.
children’s academic and social development in elementary school. Child Patel, N. (2006). Perceptions of student ability: Effects on parent involvement in middle
Development, 81(3), 988–1005. school. Dissertation Abstracts International: Section A. Humanities and Social Sciences,
Epstein, J. (1991). Effects on student achievement of teachers’ practices of parent 67(3-A), 838.
involvement. Advances in Reading, 5, 261–276. Pinkwart, N. (2016). Another 25 years of AIED? Challenges and opportunities for
Forrin, N. D., & MacLeod, C. M. (2017). This time it’s personal: The memory benefit of intelligent educational technologies of the future. International Journal of Artificial
hearing oneself, in memory. https://doi.org/10.1080/09658211.2017.1383434. Intelligence in Education, 26(2), 771–783. https://doi.org/10.1007/s40593-016-
October 2 2017. 0099-7, 2016.
Gao, J., Leung, et al. (2019). The neurophysiological correlates of religious chanting. Popenici, S. A. D., & Kerr, S. (2017). Exploring the impact of artificial intelligence on
Scientific Reports, 9, 4262. https://doi.org/10.1038/s41598-019-40200-w, 2019. teaching and learning in higher education. Research and Practice in Technology
Ghazanfar, A. A., & Schroeder, C. E. (2006). Is neocortex essentially multisensory? Trends Enhanced Learning, 12(22), 1–13, 2017.
in Cognitive Sciences, 10(6), 278–285. Popova, A., Evans, D., & Arancibia, V. (2016). Training teachers on the job : What works
Guan, C., et al. (2020). Artificial intelligence innovation in education: A twenty-year and how to measure it (English). World Bank Group. Policy Research working paper
data-driven historical analysis. International Journal of Innovation Studeies, 4(4), no. WPS 7834;WDR 2018 background paper Washington, D.C http://documents.wor
134–147, 2020. ldbank.org/curated/en/122031474915232609/Training-teachers-on-the-job-what
Haldi, T. C. (2020). Online learning’s grading challenge. Blog post. https://intelligentmach -works-and-how-to-measure-it.
ineslab.com/online-learnings-grading-challenge/. (Accessed 18 August 2020). Rashid, M., Sulaiman, N., et al. (2020). Current challenges, and possible solutions of
Hartzwell, J. (2018). A neuroscientist explores the "Sanskrit effect. Scientific American. Jan EEG-based brain-computer interface: A comprehensive review. Frontiers in
2, 2018. Neurorobotics. https://doi.org/10.3389/fnbot.2020.00025, 03 June 2020.
Henderson, A. (1991). The evidence continues to grow: Parent involvement improves student Roediger, H. L., & Mcdermott, K. B. (1995). Creating false memories—remembering
achievement. Washington, D.C: National Committee for Citizens in Education. words not presented in lists. Journal of Experimental Psychology Learning, 21,
Hill, N., et al. (2004). Parent academic involvement as related to school behavior, 803–814, 1995.
achievement, and aspirations: Demographic variation across adolescence. Child Rummel, N., Walker, E., & Aleven, V. (2016). Different futures of adaptive collaborative
Development, 75(5), 1491–1509. learning support. International Journal of Artificial Intelligence in Education, 26(2),
Hwang, G. (2003). A conceptual map model for developing Intelligent Tutoring Systems. 784–795. https://doi.org/10.1007/s40593-016-0102-3, 2016.
Computer Education, 40(3), 217–235, 2003 https://doi: 10.1016/S0360-1315(02) Schiff, D. (2020). Out of the laboratory and into the classroom: The future of artificial
00121-5. intelligence in education. AI & Society, 1–18, 2020 Aug 9.
Hwang, G. (2014). Definition, framework and research issues of smart learning Schramma, E. (2016). Multisensory learning and technology in the acquisition of English as a
environments – a context-aware learning perspective. Smart Learning Environments, 1 second language, working paper. EnglishHelper Inc.. Jan 2016.
(4). Nov 2104. Srinivasan, V., & Murthy, H. (2021). Improving reading and comprehension in K-12:
Hwang, G. (2020). Vision, challenges, roles and research of artificial intelligence in Results for a large scale AI intervention in India. Computers & Education: Artificial
education. Computers & Education: Artificial Intelligence, 1, 100001, 2020. Intelligence, 2(2021), 100019. https://doi.org/10.1016/j.caeai.2021.100019
Iiyoshi, T., & Vijay Kumar, M. S. (2010). In Iiyoshi, & V. Kumar (Eds.), Opening up Srinivasan, V. (2017). The Intelligent Enterprise in the Era of Big Data. NY: John wiley &
education: The collective advancement of eucation through open technology, open content sons.
and open knowledge. MIT Press, 2010. St Jacques, P. L., Olm, C., & Schacter, D. L. (2013). Neural mechanisms of reactivation
Janda, H. K., Pawar, A., Du, S., & Mago, V. (2019). Syntactic, semantic and sentiment induced updating that enhance and distort memory. Proceedings of the National
analysis: The joint effect on automated essay evaluation. IEEE Access, 7, Academy of Sciences of the United States of America, 110, 19671–19678, 2013.
108486–108503, 2019. Tseng, J. C. R., et al. (2008). Development of an adaptive learning system with two
Johnson, B. G., Phillips, F., & Chase, L. G. (2009). An intelligent tutoring system for the sources of personalization information. Computers and Education, 51(2), 776–786.
accounting cycle: Enhancing textbook homework with artificial intelligence. Journal https://en.unesco.org/news/covid-19-school-closures-around-world-will-hit-girls-hard
of Accounting Education, 27, 30–39, 2009. est, (2020).
Kamal, N. F., Mahmood, N. H., & Zakaria, N. A. (2013). Modeling brain activities during van Kesteren, M. T. R., et al. (2012). How schema and novelty augment memory
reading working memory task : Comparison between reciting Quran and reading formation. Trends in Neurosciences, 35, 211–219.
book. Procedia - Social and Behavioral Sciences, 97, 83–89, 2013. van Kesteren, M. T. R., & Meeter, M. (2020). How to optimize knowledge construction in
Kao, G. (2004). Parental influences on the educational outcomes of immigrant youth. the brain”, npj Science of Learning (2020) 5:5 https://doi.org/10.1038/s41539-020
International Migration Review, 38, 427–450. -0064-y.
Kolowich, S. (2014 April 28). Writing instructor, skeptical of automated grading, pits Xie, H., et al. (2019). Trends and development in technology-enhanced adaptive/
machine vs. machine. The Chronicle of Higher Education. personalized learning: A systematic review of journal publications from 2007 to
Lee, J., & Bowen, N. (2006). Parent involvement, cultural capital, and the achievement 2017. Computers & Education, 140, 103599, 2019.
gap among elementary school children. American Educational Research Journal, 43 Yang, et al. (2019). Trends in artificial intelligence-supported elearning: A systematic
(2), 193–218. review and co-citation network analysis (1998–2019). Interactive Learning
Marcus, G. (2020). The next decade in AI: Four steps towards robust artificial Environments. https://doi.org/10.1080/10494820.2021.1875001
intelligence. https://arxiv.org/abs/2002.06177. arXiv.org.
17