I'm a Professor at Learning and Educational Technologies Research Unit, the Academic Center for Computing and Media Studies, and the Graduate School of Informatics at Kyoto University, Japan.
Despite efforts have been invested in using digital technologies to enhance learners' language le... more Despite efforts have been invested in using digital technologies to enhance learners' language learning, rarely explored are studies aiming at bridging in-class vocabulary learning with real-life learning experiences in primary school education. This study aims at investigating what primary students learned by linking in-class and real life English vocabulary learning mediated by a mobile learner-generated content (m-LGC) tool; and what students' perception of the m-LGC use was. Case study approach was adopted. Data collection included student created learning logs and questionnaire. Both qualitative and quantitative methods were used to analyze data. The results show that students not only were able to apply the newly learned vocabulary to real life, but also were able to learn from peers about the vocabulary, and related culture. In the meantime, issues were identified, and future work is explored.
Interactive visual data analysis is a well-established class of methods to gather knowledge from ... more Interactive visual data analysis is a well-established class of methods to gather knowledge from raw and complex data. A broad variety of examples can be found in literature presenting its applicability in various ways and different scientific domains. However, fully fledged solutions for visual analysis addressing learning analytics are still rare. Therefore, this paper will discuss visual and interactive data analysis for learning analytics by presenting best practices followed by a discussion of a general architecture combining interactive visualization employing the Information Seeking Mantra in conjunction with the paradigm of coordinated multiple views. Finally, by presenting a use case for ubiquitous learning analytics its applicability will be demonstrated with the focus on temporal and spatial relation of learning data. The data is gathered from a ubiquitous learning scenario offering information for students to identify learning partners and provides information to teachers enabling the adaption of their learning material.
In this paper, we present a method of identifying learning activities that are important for stud... more In this paper, we present a method of identifying learning activities that are important for students to achieve good grades. For this purpose, the data of 99 students were collected from a learning management system and an e-book system, including attendance, time on preparation and review, submission of reports, and quiz scores. We applied a support vector machine to these data to calculate a score of importance for each learning activity reflecting its contribution to the attainment of an A grade. Selecting certain important learning activities by following several evaluation measures, we verified that these learning activities played a crucial role in predicting final student achievements. One of the obtained results implies that time on preparation and review in the middle part of a course influences a student's final achievement.
In this paper, we propose a novel method to make a summary set of lecture slides for supporting s... more In this paper, we propose a novel method to make a summary set of lecture slides for supporting students' review study. Quizzes are often conducted in a lecture to check students' understanding level. The aim of our study is to support a student who wrongly answers the quiz. The quiz statement is analyzed to extract nouns in the statement. Then, text mining is performed to find the pages related to the quiz statement in the relevant lecture materials. The proposed SummaryRank algorithm evaluates the topic similarity among pages in material with emphasizing the related page to the quiz statement. In addition, our proposed method considers the preview status of each student, resulting in the generation of adaptive review materials tailored for each student. Through experiments, we confirmed that the proposed method could find appropriate pages with respect to the quiz statements.
In this paper, we present a meaningful learning environment to visually support e-book learners t... more In this paper, we present a meaningful learning environment to visually support e-book learners to effectively construct their knowledge framework. This personalized visualization support is intended to encourage learners to actively locate new knowledge in their own knowledge framework and check the logical consistency of their ideas for clearing up misunderstandings. On the other hand, we also propose to visually support e-book instructors to decide the group distribution for collaborative learning activities based on knowledge structure of learners. To facilitate those visualization supports, we present a method to semi-automatically construct a course-centered ontology to describe the required information in a map structure.
Learning environment with e-book enables learners to learn anytime and anywhere they like accordi... more Learning environment with e-book enables learners to learn anytime and anywhere they like according to their own pace. There is a large expectation on e-book as personal learning tool. Understanding and grasping the learning status of students is crucial matter for teachers and for the learning system. Access log of e-books should be basis for analyzing the learning behavior. The authors are constructing an analysis system of learning logs kept in BookLooper system operated in Kyushu University. The present paper overviews the system and shows some "learning log graphs" which represent the learning process of students. The graphs tell which pages a student had difficulties and if the student grasps the thread of course as the teacher expected.
This paper explores a recommendation method in the context of real-world language learning based ... more This paper explores a recommendation method in the context of real-world language learning based on ubiquitous learning logs. Ubiquitous learning log stands for a digital record of what they have learned in the daily life using ubiquitous technologies. One of the issues of ubiquitous learning analytics is how we should detect or mine effective and efficient learning patterns from many learning data accumulated in a ubiquitous learning system. To tackle this issues, this paper proposes a visualization and analysis system called VASCORLL (Visualization and Analysis system for COnnecting Relationships of Learning Logs) in order to link learners in the real world and learning logs that are accumulated in a cyber space by a ubiquitous learning system called SCROLL (System for Capturing and Reminding of Learning Log). Using VASCORLL, learners can predict their next learning steps and then find learning patterns related to their current learning situation. The initial evaluation was conducted to measure whether VASCORLL can increase learners' learning opportunities and whether the recommended learning patterns are appropriate for learners or not. In this evaluation, we found important criteria for recommending appropriate learning patterns for learners in the real-world language learning. In addition, VASCORLL succeeded in increasing learners' learning opportunities.
Many universities choose the C programming language (C) as the first programming language to teac... more Many universities choose the C programming language (C) as the first programming language to teach to students. As novice programmers, students frequently make simple mistakes such as syntax and typographical errors. Students often find it difficult to locate these errors, as students are not yet thoroughly familiar with C's syntax. Usually educational materials are very useful tools for students to locate errors and find solutions. This study aims to facilitate teaching and learning of C. We propose a system that undergraduate novice programmers may use to easily locate syntax errors in C and get recommendations from educational materials. We analyze error logs of programming and reading logs of educational materials, with the learning by doing mode (learning-practicing-reflection) to discuss key findings and their implications for programming education.
This paper proposes a new tool called Cubic Gantt Chart, 3D version of Gantt Chart for visualizin... more This paper proposes a new tool called Cubic Gantt Chart, 3D version of Gantt Chart for visualizing e-learning activity data such as how long and how often students look at each page of an e-learning material like PowerPoint slides. Using a dedicated tool called BookLooper can collect these activity data. The analysis of e-learning activity data is significant for instructors to understand students' learning states and the difficulty levels of e-learning materials because those can suggest more efficient instructional ways. So, in this paper, the authors propose Cubic Gantt Chart as a visualization tool for the analysis of students' e-learning activity data and justify its usefulness by showing visualization examples of actual data collected by BookLooper.
The analysis of learning behavior and identification of learning style from learning logs are exp... more The analysis of learning behavior and identification of learning style from learning logs are expected to benefit instructors and learners. This study describes methods for processing learning logs, such as data collection, integration, and cleansing, developed in Kyushu University. The research aims to analyze learning behavior and identify students' learning style using student's learning logs. Students were clustered into four groups using k-means clustering, and features of their learning behavior were analyzed in detail. We found that Digital Backtrack Learning style is better than Digital Sequential Learning style.
This paper proposes a method to analyze preview behaviors of students using a learning management... more This paper proposes a method to analyze preview behaviors of students using a learning management system (LMS) and an e-book system. We collected a large number of operation logs from e-books to analyze the process of learning. In addition, we conducted a quiz to test the level of understanding. This study especially focuses on an analysis of the relationship between learning behavior in preview and its effectiveness in the corresponding quiz. We apply a machine learning and classification methodology for behavior analysis. Experimental results report that students who undertake good preview achieve better scores in quizzes.
Seamless learning is an approach in which learners can create relationships between their formal ... more Seamless learning is an approach in which learners can create relationships between their formal and informal learning. To support seamless learning, some seamless learning systems have been proposed. However, conventional systems are mainly based on the relationships and contexts for learners, such as location and time, while their teaching materials are not mentioned in detail. Because most of learners use some textbooks when they learn both inside and outside of the class, textbooks have an important part to support seamless learning. This paper describes a seamless learning system that based on the learners' textbooks (teaching materials) and creates relationships between their formal and informal learning. Through this system, improvement of the learning environment using a wider range of information is expected.
The purpose of this study is to investigate the relationship between academic achievement and lea... more The purpose of this study is to investigate the relationship between academic achievement and learning patterns of students using e-book logs. Specifically, we examined how students who maintain good academic achievement link among knowledge of different e-books. We hypothesized that good achievers might access e-books sequentially those were used in the same class session and/or consecutive class sessions, for systematically linking among the different knowledge of related e-books. Logs were collected from first-year students in an information science course at Kyushu University. The present study revealed that the good achievers more frequently linked e-books which were used in the same class sessions than the poor achievers. This result suggests that the good achievers more frequently linked knowledge of e-books which deeply related each other.
This paper presents a method for visualizing students' learning logs using discrete graphs. These... more This paper presents a method for visualizing students' learning logs using discrete graphs. These logs contain the following four items: attendance, time spent browsing slides, submission of a report and the quiz score for each lesson. The data were collected using learning management systems and the e-text systems. By using these data, we construct graphs for each grade of which the nodes represent all combinations of achievements and failures for the four items. The graphs enable us to observe the features of students' learning activities for each obtained grade. The order in which the above four items are presented changes the visual features of the graph. Moreover, the construction of a graph from the data of the same class held previously enables us to inform students of the learning activities they should avoid. Finally, future research plans regarding this method are presented.
In recent years, ubiquitous learning systems based on CSUL (Computer Supported Ubiquitous Learnin... more In recent years, ubiquitous learning systems based on CSUL (Computer Supported Ubiquitous Learning) and u-learning have been constructed using ubiquitous technologies such as mobile devices, RFID tags, QR codes and wireless networks. These types of learning takes place not only in-class learning but also in a variety of out-class learning spaces such as home, library and museum. However, learning materials provided by ubiquitous learning systems are in most cases, prepared by teachers or instructional designers. It makes it difficult to find relationships between a learner and other learners in different contexts. In order to link learners in the real world and learning logs that are accumulated in a cyber space by a ubiquitous learning system called SCROLL (System for Capturing and Reminding of Learning Log), this paper proposes a visualization and analysis system called VASCORLL (Visualization and Analysis system for COnnecting Relationships of Learning Logs). Using VASCORLL, learners can find other contexts where can be applied to their own learning experiences. The initial evaluation was conducted to examine whether VASCORLL can increase learners' learning opportunities and learners can apply their own experiences to different contexts.
Analyses on students' learning behaviors comprise an important thrust in education research. This... more Analyses on students' learning behaviors comprise an important thrust in education research. This study focused on e-books system used in the classroom and this system recorded students' learning logs in their daily academic life. These learning logs can be used to analysis students' learning behaviors. By performing partial correlation analysis, the study found that a number of learning behaviors have a significant relation with students' test scores.
Many universities choose the C programming language (C) as the first programming language to teac... more Many universities choose the C programming language (C) as the first programming language to teach to students. As novice programmers, students frequently make simple mistakes such as syntax and typographical errors. Students often find it difficult to locate these errors, as students are not yet thoroughly familiar with C's syntax. This situation often causes students to consider programming very dull. It is therefore critical to provide clearer explanation in class, to prevent students losing interest in programming. This study aims to facilitate teaching and learning of C. We propose a system that undergraduate novice programmers may use to locate syntax errors in C. We analyze error types and resolutions using data collected during a programming course, and discuss key findings and their implications for programming education.
This paper provides an overview of the Educational Big Data research project at Kyushu University... more This paper provides an overview of the Educational Big Data research project at Kyushu University, Japan. This project uses an e-book system called BookLooper. which allows students to browse e-books in Web browser, PC, mobile devices such as smartphone. This paper shows research issues in this project. Currently, about 2,700 first-year students are using the e-book system and approximately 2.2 million log data have been accumulated as of May 20, 2015. This paper describes why we introduce e-book in the University education and initial findings.
Despite efforts have been invested in using digital technologies to enhance learners' language le... more Despite efforts have been invested in using digital technologies to enhance learners' language learning, rarely explored are studies aiming at bridging in-class vocabulary learning with real-life learning experiences in primary school education. This study aims at investigating what primary students learned by linking in-class and real life English vocabulary learning mediated by a mobile learner-generated content (m-LGC) tool; and what students' perception of the m-LGC use was. Case study approach was adopted. Data collection included student created learning logs and questionnaire. Both qualitative and quantitative methods were used to analyze data. The results show that students not only were able to apply the newly learned vocabulary to real life, but also were able to learn from peers about the vocabulary, and related culture. In the meantime, issues were identified, and future work is explored.
Interactive visual data analysis is a well-established class of methods to gather knowledge from ... more Interactive visual data analysis is a well-established class of methods to gather knowledge from raw and complex data. A broad variety of examples can be found in literature presenting its applicability in various ways and different scientific domains. However, fully fledged solutions for visual analysis addressing learning analytics are still rare. Therefore, this paper will discuss visual and interactive data analysis for learning analytics by presenting best practices followed by a discussion of a general architecture combining interactive visualization employing the Information Seeking Mantra in conjunction with the paradigm of coordinated multiple views. Finally, by presenting a use case for ubiquitous learning analytics its applicability will be demonstrated with the focus on temporal and spatial relation of learning data. The data is gathered from a ubiquitous learning scenario offering information for students to identify learning partners and provides information to teachers enabling the adaption of their learning material.
In this paper, we present a method of identifying learning activities that are important for stud... more In this paper, we present a method of identifying learning activities that are important for students to achieve good grades. For this purpose, the data of 99 students were collected from a learning management system and an e-book system, including attendance, time on preparation and review, submission of reports, and quiz scores. We applied a support vector machine to these data to calculate a score of importance for each learning activity reflecting its contribution to the attainment of an A grade. Selecting certain important learning activities by following several evaluation measures, we verified that these learning activities played a crucial role in predicting final student achievements. One of the obtained results implies that time on preparation and review in the middle part of a course influences a student's final achievement.
In this paper, we propose a novel method to make a summary set of lecture slides for supporting s... more In this paper, we propose a novel method to make a summary set of lecture slides for supporting students' review study. Quizzes are often conducted in a lecture to check students' understanding level. The aim of our study is to support a student who wrongly answers the quiz. The quiz statement is analyzed to extract nouns in the statement. Then, text mining is performed to find the pages related to the quiz statement in the relevant lecture materials. The proposed SummaryRank algorithm evaluates the topic similarity among pages in material with emphasizing the related page to the quiz statement. In addition, our proposed method considers the preview status of each student, resulting in the generation of adaptive review materials tailored for each student. Through experiments, we confirmed that the proposed method could find appropriate pages with respect to the quiz statements.
In this paper, we present a meaningful learning environment to visually support e-book learners t... more In this paper, we present a meaningful learning environment to visually support e-book learners to effectively construct their knowledge framework. This personalized visualization support is intended to encourage learners to actively locate new knowledge in their own knowledge framework and check the logical consistency of their ideas for clearing up misunderstandings. On the other hand, we also propose to visually support e-book instructors to decide the group distribution for collaborative learning activities based on knowledge structure of learners. To facilitate those visualization supports, we present a method to semi-automatically construct a course-centered ontology to describe the required information in a map structure.
Learning environment with e-book enables learners to learn anytime and anywhere they like accordi... more Learning environment with e-book enables learners to learn anytime and anywhere they like according to their own pace. There is a large expectation on e-book as personal learning tool. Understanding and grasping the learning status of students is crucial matter for teachers and for the learning system. Access log of e-books should be basis for analyzing the learning behavior. The authors are constructing an analysis system of learning logs kept in BookLooper system operated in Kyushu University. The present paper overviews the system and shows some "learning log graphs" which represent the learning process of students. The graphs tell which pages a student had difficulties and if the student grasps the thread of course as the teacher expected.
This paper explores a recommendation method in the context of real-world language learning based ... more This paper explores a recommendation method in the context of real-world language learning based on ubiquitous learning logs. Ubiquitous learning log stands for a digital record of what they have learned in the daily life using ubiquitous technologies. One of the issues of ubiquitous learning analytics is how we should detect or mine effective and efficient learning patterns from many learning data accumulated in a ubiquitous learning system. To tackle this issues, this paper proposes a visualization and analysis system called VASCORLL (Visualization and Analysis system for COnnecting Relationships of Learning Logs) in order to link learners in the real world and learning logs that are accumulated in a cyber space by a ubiquitous learning system called SCROLL (System for Capturing and Reminding of Learning Log). Using VASCORLL, learners can predict their next learning steps and then find learning patterns related to their current learning situation. The initial evaluation was conducted to measure whether VASCORLL can increase learners' learning opportunities and whether the recommended learning patterns are appropriate for learners or not. In this evaluation, we found important criteria for recommending appropriate learning patterns for learners in the real-world language learning. In addition, VASCORLL succeeded in increasing learners' learning opportunities.
Many universities choose the C programming language (C) as the first programming language to teac... more Many universities choose the C programming language (C) as the first programming language to teach to students. As novice programmers, students frequently make simple mistakes such as syntax and typographical errors. Students often find it difficult to locate these errors, as students are not yet thoroughly familiar with C's syntax. Usually educational materials are very useful tools for students to locate errors and find solutions. This study aims to facilitate teaching and learning of C. We propose a system that undergraduate novice programmers may use to easily locate syntax errors in C and get recommendations from educational materials. We analyze error logs of programming and reading logs of educational materials, with the learning by doing mode (learning-practicing-reflection) to discuss key findings and their implications for programming education.
This paper proposes a new tool called Cubic Gantt Chart, 3D version of Gantt Chart for visualizin... more This paper proposes a new tool called Cubic Gantt Chart, 3D version of Gantt Chart for visualizing e-learning activity data such as how long and how often students look at each page of an e-learning material like PowerPoint slides. Using a dedicated tool called BookLooper can collect these activity data. The analysis of e-learning activity data is significant for instructors to understand students' learning states and the difficulty levels of e-learning materials because those can suggest more efficient instructional ways. So, in this paper, the authors propose Cubic Gantt Chart as a visualization tool for the analysis of students' e-learning activity data and justify its usefulness by showing visualization examples of actual data collected by BookLooper.
The analysis of learning behavior and identification of learning style from learning logs are exp... more The analysis of learning behavior and identification of learning style from learning logs are expected to benefit instructors and learners. This study describes methods for processing learning logs, such as data collection, integration, and cleansing, developed in Kyushu University. The research aims to analyze learning behavior and identify students' learning style using student's learning logs. Students were clustered into four groups using k-means clustering, and features of their learning behavior were analyzed in detail. We found that Digital Backtrack Learning style is better than Digital Sequential Learning style.
This paper proposes a method to analyze preview behaviors of students using a learning management... more This paper proposes a method to analyze preview behaviors of students using a learning management system (LMS) and an e-book system. We collected a large number of operation logs from e-books to analyze the process of learning. In addition, we conducted a quiz to test the level of understanding. This study especially focuses on an analysis of the relationship between learning behavior in preview and its effectiveness in the corresponding quiz. We apply a machine learning and classification methodology for behavior analysis. Experimental results report that students who undertake good preview achieve better scores in quizzes.
Seamless learning is an approach in which learners can create relationships between their formal ... more Seamless learning is an approach in which learners can create relationships between their formal and informal learning. To support seamless learning, some seamless learning systems have been proposed. However, conventional systems are mainly based on the relationships and contexts for learners, such as location and time, while their teaching materials are not mentioned in detail. Because most of learners use some textbooks when they learn both inside and outside of the class, textbooks have an important part to support seamless learning. This paper describes a seamless learning system that based on the learners' textbooks (teaching materials) and creates relationships between their formal and informal learning. Through this system, improvement of the learning environment using a wider range of information is expected.
The purpose of this study is to investigate the relationship between academic achievement and lea... more The purpose of this study is to investigate the relationship between academic achievement and learning patterns of students using e-book logs. Specifically, we examined how students who maintain good academic achievement link among knowledge of different e-books. We hypothesized that good achievers might access e-books sequentially those were used in the same class session and/or consecutive class sessions, for systematically linking among the different knowledge of related e-books. Logs were collected from first-year students in an information science course at Kyushu University. The present study revealed that the good achievers more frequently linked e-books which were used in the same class sessions than the poor achievers. This result suggests that the good achievers more frequently linked knowledge of e-books which deeply related each other.
This paper presents a method for visualizing students' learning logs using discrete graphs. These... more This paper presents a method for visualizing students' learning logs using discrete graphs. These logs contain the following four items: attendance, time spent browsing slides, submission of a report and the quiz score for each lesson. The data were collected using learning management systems and the e-text systems. By using these data, we construct graphs for each grade of which the nodes represent all combinations of achievements and failures for the four items. The graphs enable us to observe the features of students' learning activities for each obtained grade. The order in which the above four items are presented changes the visual features of the graph. Moreover, the construction of a graph from the data of the same class held previously enables us to inform students of the learning activities they should avoid. Finally, future research plans regarding this method are presented.
In recent years, ubiquitous learning systems based on CSUL (Computer Supported Ubiquitous Learnin... more In recent years, ubiquitous learning systems based on CSUL (Computer Supported Ubiquitous Learning) and u-learning have been constructed using ubiquitous technologies such as mobile devices, RFID tags, QR codes and wireless networks. These types of learning takes place not only in-class learning but also in a variety of out-class learning spaces such as home, library and museum. However, learning materials provided by ubiquitous learning systems are in most cases, prepared by teachers or instructional designers. It makes it difficult to find relationships between a learner and other learners in different contexts. In order to link learners in the real world and learning logs that are accumulated in a cyber space by a ubiquitous learning system called SCROLL (System for Capturing and Reminding of Learning Log), this paper proposes a visualization and analysis system called VASCORLL (Visualization and Analysis system for COnnecting Relationships of Learning Logs). Using VASCORLL, learners can find other contexts where can be applied to their own learning experiences. The initial evaluation was conducted to examine whether VASCORLL can increase learners' learning opportunities and learners can apply their own experiences to different contexts.
Analyses on students' learning behaviors comprise an important thrust in education research. This... more Analyses on students' learning behaviors comprise an important thrust in education research. This study focused on e-books system used in the classroom and this system recorded students' learning logs in their daily academic life. These learning logs can be used to analysis students' learning behaviors. By performing partial correlation analysis, the study found that a number of learning behaviors have a significant relation with students' test scores.
Many universities choose the C programming language (C) as the first programming language to teac... more Many universities choose the C programming language (C) as the first programming language to teach to students. As novice programmers, students frequently make simple mistakes such as syntax and typographical errors. Students often find it difficult to locate these errors, as students are not yet thoroughly familiar with C's syntax. This situation often causes students to consider programming very dull. It is therefore critical to provide clearer explanation in class, to prevent students losing interest in programming. This study aims to facilitate teaching and learning of C. We propose a system that undergraduate novice programmers may use to locate syntax errors in C. We analyze error types and resolutions using data collected during a programming course, and discuss key findings and their implications for programming education.
This paper provides an overview of the Educational Big Data research project at Kyushu University... more This paper provides an overview of the Educational Big Data research project at Kyushu University, Japan. This project uses an e-book system called BookLooper. which allows students to browse e-books in Web browser, PC, mobile devices such as smartphone. This paper shows research issues in this project. Currently, about 2,700 first-year students are using the e-book system and approximately 2.2 million log data have been accumulated as of May 20, 2015. This paper describes why we introduce e-book in the University education and initial findings.
Uploads
Papers by Hiroaki Ogata