review-article

Applications of convolutional neural networks in education: : A systematic literature review

Authors:

Lenardo Chaves e Silva,

Álvaro Alvares de Carvalho César Sobrinho,

Thiago Damasceno Cordeiro,

Rafael Ferreira Melo,

Ig Ibert Bittencourt,

Leonardo Brandão Marques,

Diego Dermeval Medeiros da Cunha Matos,

Alan Pedro da Silva,

Seiji IsotaniAuthors Info & Claims

Volume 231, Issue C

https://doi.org/10.1016/j.eswa.2023.120621

Published: 30 November 2023 Publication History

Abstract

Applying artificial intelligence in education is relevant to addressing the current educational crises. Many available solutions apply Convolutional Neural Networks (CNNs) to help improve educational outcomes. Therefore, a series of works have been developed integrating techniques in different educational contexts, for instance, in online teaching practices. Given the various studies and the relevance of CNNs for educational applications, this paper presents a systematic literature review to discuss the state-of-the-art. We reviewed 133 papers from the IEEE Xplore, ACM Digital Library, and Scopus databases. Based on our revision, we discuss characteristics of studies such as publication venues, educational context, datasets, types of CNNs models, and performance of models. We evidence that the literature regarding CNNs still misses more studies discussing educational problems faced by Global South students, considering both teaching and learning perspectives. Such a population cannot be neglected during experiments due to specific educational weaknesses (for example, basic skills) demanding personalized solutions.

Highlights

•

A systematic literature review of 133 published papers.

•

China covered most publications, followed by India.

•

There is a research gap regarding using CNNs in some regions of the Global South.

•

The main educational context with CNN applications is students’ performance.

References

[1]

Agrawal A., Garg M., Prakash S., Joshi P., Srivastava A.M., Hand down, face up: Innovative mobile attendance system using face recognition deep learning, in: Proceedings of 3rd International Conference on Computer Vision and Image Processing, Springer Singapore, 2019, pp. 363–375,.

[2]

Ali N.B., Petersen K., Wohlin C., A systematic literature review on the industrial use of software process simulation, Journal of Systems and Software 97 (2014) 65–85,.

Digital Library

[3]

Aljarrah A., Ababneh M., Karagozlu D., Ozdamli F., Artificial intelligence techniques for distance education: A systematic literature review, TEM Journal - Technology, Education, Management, Informatics 10 (4) (2021) 1621–1629,.

[4]

An L., Li A., Design and implementation of a student archive retrieval method based on image processing, Revue d’Intelligence Artificielle 34 (4) (2020) 487–494,.

[5]

Andrian R., Supangkat S.H., Comparative analysis of deep convolutional neural networks architecture in facial expression recognition: A survey, in: 2020 International Conference on ICT for Smart Society, 2020, pp. 1–6,.

[6]

Ara N.M., Simul N.S., Islam M.S., Convolutional neural network approach for vision based student recognition system, in: 2017 20th International Conference of Computer and Information Technology, 2017, pp. 1–6,.

[7]

Ashwin T.S., Guddeti R.M.R., Unobtrusive behavioral analysis of students in classroom environment using non-verbal cues, IEEE Access 7 (2019) 150693–150709,.

[8]

Balmik A., Kumar A., Nandy A., Efficient face recognition system for education sectors in COVID-19 pandemic, in: 2021 12th International Conference on Computing Communication and Networking Technologies, 2021, pp. 1–8,.

[9]

Bejuri W.M.Y.W., Zakaria N., Mohamad M., Mohamed W., Ahmad S., Ngo H.C., Sign language detection using convolutional neural network for teaching and learning application, Indonesian Journal of Electrical Engineering and Computer Science 28 (2022) 358,.

[10]

Bian C., Zhang Y., Yang F., Bi W., Lu W., Spontaneous facial expression database for academic emotion inference in online learning, IET Computer Vision 13 (3) (2019) 329–337,.

Digital Library

[11]

Binh H.T., Trung N.Q., Nguyen H.-A.T., Duy B.T., Detecting student engagement in classrooms for intelligent tutoring systems, in: 2019 23rd International Computer Science and Engineering Conference, 2019, pp. 145–149,.

[12]

Boaye Belle A., Zhao Y., Evidence-based decision-making: On the use of systematicity cases to check the compliance of reviews with reporting guidelines such as PRISMA 2020, Expert Systems with Applications 217 (2023),.

Digital Library

[13]

Boulanger D., Dewan M.A.A., Kumar V.S., Lin F., Lightweight and interpretable detection of affective engagement for online learners, in: 2021 IEEE intl conf on dependable, autonomic and secure computing, intl conf on pervasive intelligence and computing, intl conf on cloud and big data computing, intl conf on cyber science and technology congress, 2021, pp. 176–184,.

[14]

Brereton P., Kitchenham B.A., Budgen D., Turner M., Khalil M., Lessons from applying the systematic literature review process within the software engineering domain, Journal of Systems and Software 80 (4) (2007) 571–583,.

Digital Library

[15]

Cadena L., Rógel X.D., Chavez D., Patiño K., Abad J., Implementation of recognition system of people and computers in a classroom through artificial vision, in: Systems and information sciences, Springer International Publishing, 2020, pp. 107–120,.

[16]

Cao X., Zhang Y., Pan M., Zhou H., Experimental study on deep learning oriented to learning engagement recognition, in: Advances in intelligent systems and computing, Springer International Publishing, 2018, pp. 283–295,.

[17]

Castillo R.V.C., john T. Catanaoan M., Obliopas J.F.E., Linsangan N.B., Class attendance generation through multiple facial detection and recognition using artificial neural network, in: Proceedings of the 2018 international conference on machine learning and machine intelligence, in: MLMI2018, Association for Computing Machinery, New York, NY, USA, 2018, pp. 38–42,.

Digital Library

[18]

Chatbri H., McGuinness K., Little S., Zhou J., Kameyama K., Kwan P., O’Connor N.E., Automatic MOOC video classification using transcript features and convolutional neural networks, in: Proceedings of the 2017 ACM workshop on multimedia-based educational and knowledge technologies for personalized and social online training, Association for Computing Machinery, New York, NY, USA, 2017, pp. 21–26,.

Digital Library

[19]

Chatbri H., Oliveira M., McGuinness K., Little S., Kameyama K., Kwan P., Sutherland A., O’Connor N.E., Educational video classification by using a transcript to image transform and supervised learning, in: 2017 Seventh international conference on image processing theory, tools and applications, 2017, pp. 1–6,.

[20]

Chau V.T.N., Phung N.H., Enhanced CNN models for binary and multiclass student classification on temporal educational data at the program level, Vietnam Journal of Computer Science 08 (02) (2021) 311–335,.

[21]

Che B., Li X., Sun Y., Yang F., Liu P., Lu W., A database of students’ spontaneous actions in the real classroom environment, Computers & Electrical Engineering 101 (2022),.

Digital Library

[22]

Che L., Zuo Y., Zhang L., Application of three-layer stacked LSTM model assisted by educational robots in children’s learning, International Journal of Humanoid Robotics 19 (03) (2022),.

[23]

Chen J., Chen Y., Lin J., Souri A., Chen M.-Y., Application of internet of things intelligent image-positioning studio classroom in english teaching, Journal of High Speed Networks 27 (3) (2021) 279–289,.

Digital Library

[24]

Chen L., Ding B.Y., Evaluation technology of classroom students’ learning state based on deep learning, Computational Intelligence and Neuroscience 2021 (2021),.

Digital Library

[25]

Chen Q., Dong M., Sun G., Design of assessment judging model for physical education professional skills course based on convolutional neural network and few-shot learning, Computational Intelligence and Neuroscience 2022 (2022),.

Digital Library

[26]

Chen Q., Dong M., Sun G., Real time facial expression recognition for online lecture, Wireless Communications and Mobile Computing 2022 (2022),.

Digital Library

[27]

Chen L., Li S., Bai Q., Yang J., Jiang S., Miao Y., Review of image classification algorithms based on convolutional neural networks, Remote Sensing 13 (22) (2021),.

[28]

Cheng Y., Ma S., Chen J., Zhao Y., Chen Y., Wang J., Xing J., Guo W., Jing Y., Wu G., Zhu W., Towards web-based etymological hanzi learning, in: Companion proceedings of the web conference 2020, Association for Computing Machinery, New York, NY, USA, 2020, pp. 158–162,.

Digital Library

[29]

Cheng Q., Rong B., Sun B., He J., Class attendance checking system based on deep learning and global optimization, in: Proceedings of the 2019 8th international conference on computing and pattern recognition, Association for Computing Machinery, New York, NY, USA, 2020, pp. 331–336,.

Digital Library

[30]

Cuadrado L.-E.I., Riesco Á.M., de la Paz López F., FER in primary school children for affective robot tutors, in: Vicente J.M.F., Álvarez-Sánchez J.R., de la Paz López F., Moreo J.T., Adeli H. (Eds.), From bioinspired systems and biomedical applications to machine learning, Springer International Publishing, Cham, 2019, pp. 461–471.

[31]

de Andrés-Sánchez J., A systematic review of the interactions of fuzzy set theory and option pricing, Expert Systems with Applications 223 (2023),.

Digital Library

[32]

Dong Z., Li Q., Educational behaviour analysis using convolutional neural network and particle swarm optimization algorithm, Advances in MultiMedia 2022 (2022),.

Digital Library

[33]

Erdem D., Beke A., Kumbasar T., A deep learning-based pipeline for teaching control theory: Transforming feedback control systems on whiteboard into MATLAB, IEEE Access 8 (2020) 84631–84641,.

[34]

Escobanez J.C.S., Comendador B.E., Student physical violence detection using convolutional neural networks, in: Proceedings of the 12th international conference on information communication and management, Association for Computing Machinery, New York, NY, USA, 2022, pp. 34–38,.

Digital Library

[35]

Esther B.Z., Vadapalli H., Estimating student learning affect using facial emotions, in: 2020 2nd International multidisciplinary information technology and engineering conference, 2020, pp. 1–6,.

[36]

Fardian F., Mawarpury M., Munadi K., Arnia F., Thermography for emotion recognition using deep learning in academic settings: A review, IEEE Access (2022) 1,.

[37]

Fu R., Wu T., Luo Z., Duan F., Qiao X., Guo P., Learning behavior analysis in classroom based on deep learning, in: 2019 Tenth international conference on intelligent control and information processing, 2019, pp. 206–212,.

[38]

Fujii K., Marian P., Clark D., Okamoto Y., Rekimoto J., Sync class: Visualization system for in-class student synchronization, in: Proceedings of the 9th augmented human international conference, Association for Computing Machinery, New York, NY, USA, 2018,.

Digital Library

[39]

Gamage M.A., Arachchi R.M., Naotunna S., Rubasinghe T., Silva C., Siriwardana S., Academic depression detection using behavioral aspects for Sri Lankan university students, in: 2021 3rd International conference on advancements in computing, 2021, pp. 335–340,.

[40]

González-Hernández F., Zatarain-Cabada R., Barrón-Estrada M.L., Rodríguez-Rangel H., Recognition of learning-centered emotions using a convolutional neural network, Pinto D., Singh V.K., Villavicencio A., Mayr-Schlegel P., Stamatatos E. (Eds.), Journal of Intelligent & Fuzzy Systems 34 (5) (2018) 3325–3336,.

Digital Library

[41]

Goud S., Abhiram R., Nayak P., Kaushal P., Smart attendance monitoring system for online classes using facial recognition, in: International conference on innovative computing and communications, Springer Nature Singapore, 2022, pp. 193–203,.

[42]

Greer R., Dubnov S., Restoring eye contact to the virtual classroom with machine learning, in: Proceedings of the 13th international conference on computer supported education - Volume 1: CSME, INSTICC, SciTePress, 2021, pp. 698–708,.

[43]

Gu Y., Hu J., Zhou Y., Lu L., Online teaching gestures recognition model based on deep learning, in: 2020 International conference on networking and network applications, 2020, pp. 410–416,.

[44]

Gu J., Wang Z., Kuen J., Ma L., Shahroudy A., Shuai B., Liu T., Wang X., Wang G., Cai J., Chen T., Recent advances in convolutional neural networks, Pattern Recognition 77 (2018) 354–377,.

Digital Library

[45]

Gupta R.K., Lakhlani S., Khedawala Z., Chudasama V., Upla K.P., A deep learning paradigm for automated face attendance, in: Communications in computer and information science, Springer Singapore, 2019, pp. 39–50,.

[46]

Gushchina O.M., Ochepovsky A.V., Rogova N.N., Pupykina A.A., Ar-powered educational application based upon convolutional neural network, Journal of Physics: Conference Series 1278 (1) (2019),.

[47]

Haghighi M.S., Sheikhjafari A., Jolfaei A., Farivar F., Ahmadzadeh S., Automation of recording in smart classrooms via deep learning and Bayesian maximum a posteriori estimation of instructor’s pose, IEEE Transactions on Industrial Informatics 17 (4) (2021) 2813–2820,.

[48]

Hammoumi O.E., Benmarrakchi F., Ouherrou N., Kafi J.E., Hore A.E., Emotion recognition in E-learning systems, in: 2018 6th International conference on multimedia computing and systems, 2018, pp. 1–6,.

[49]

Hasan H.M., Rahman M.M., Khan M.A.-A., Meghla T.I., Mamun S.A., Kaiser M.S., Implementation of real-time automated attendance system using deep learning, in: Proceedings of the third international conference on trends in computational and cognitive engineering, Springer Nature Singapore, 2022, pp. 121–132,.

[50]

He K., Zhang X., Ren S., Sun J., Deep residual learning for image recognition, in: 2016 IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778,.

[51]

Hu S., Bhattacharya H., Chattopadhyay M., Aslam N., Shum H.P.H., A dual-stream recurrent neural network for student feedback prediction using kinect, in: 2018 12th International conference on software, knowledge, information management & applications, 2018, pp. 1–8,.

[52]

Huang Y.-M., Cheng A.-Y., Wu T.-T., Analysis of learning behavior of human posture recognition in maker education, Frontiers in Psychology 13 (2022),.

[53]

Huang Z., Liu Q., Chen E., Zhao H., Gao M., Wei S., Su Y., Hu G., Question difficulty prediction for READING problems in standard tests, in: Proceedings of the AAAI conference on artificial intelligence, Vol. 31, 2017,.

[54]

Hung J.C., Lin K.-C., Lai N.-X., Recognizing learning emotion based on convolutional neural networks and transfer learning, Applied Soft Computing 84 (2019),.

Digital Library

[55]

Indolia S., Goswami A.K., Mishra S., Asopa P., Conceptual understanding of convolutional neural network - A deep learning approach, Procedia Computer Science 132 (2018) 679–688,.

Digital Library

[56]

Jagadeesh M., Baranidharan B., Facial expression recognition of online learners from real-time videos using a novel deep learning model, Multimedia Systems 28 (6) (2022) 2285–2305,.

Digital Library

[57]

Jain A., Sah H.R., Student’s feedback by emotion and speech recognition through deep learning, in: 2021 International conference on computing, communication, and intelligent systems, 2021, pp. 442–447,.

[58]

Jiang B., Xu W., Guo C., Liu W., Cheng W., A classroom concentration model based on computer vision, in: Proceedings of the ACM turing celebration conference - China, in: ACM TURC ’19, Association for Computing Machinery, New York, NY, USA, 2019,.

Digital Library

[59]

Jin Y., Teachers’ teaching ability promotion strategies based on lightweight deep learning combined with target detection algorithm, Computational Intelligence and Neuroscience 2022 (2022),.

Digital Library

[60]

Jun H., Jinming S., Shuai L., Yue L., Jingwei W., Peng J., Design of distance education authentication system based on deep convolutional neural netework, in: 2018 Chinese automation congress, 2018, pp. 4113–4119,.

[61]

Karayaneva Y., Hintea D., Object recognition algorithms implemented on NAO robot for children’s visual learning enhancement, in: Proceedings of the 2018 2nd international conference on mechatronics systems and control engineering, in: ICMSCE 2018, Association for Computing Machinery, New York, NY, USA, 2018, pp. 86–92,.

Digital Library

[62]

Khaleel M.F., Sharkh M.A., Kalil M., A cloud-based architecture for automated grading of computer-aided design student work using deep learning, in: 2020 IEEE Canadian conference on electrical and computer engineering, 2020, pp. 1–5,.

[63]

Kitchenham B., Charters S., Guidelines for performing systematic literature reviews in software engineering, Schoolf of Computer Science and Mathematics, Keele University, 2007.

Digital Library

[64]

Klaiber M., Sauter D., Baumgartl H., Buettner R., A systematic literature review on transfer learning for 3D-CNNs, in: 2021 International joint conference on neural networks, 2021, pp. 1–10,.

[65]

Klein R., Celik T., The wits intelligent teaching system: Detecting student engagement during lectures using convolutional neural networks, in: 2017 IEEE international conference on image processing, 2017, pp. 2856–2860,.

Digital Library

[66]

Kohli S., Jannaj Y., Maanan M., Rhinane H., Deep learning: new approach for detecting scholar exams fraud, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLVI-4/W3-2021 (2022) 103–107,.

[67]

Krishnapillai L., Veluppillai S., Akilan A., Saumika V.N., Silva K.P.D.H.D., Gamage M.P.A.W., Smart attendance and progress management system, in: Lecture notes in electrical engineering, Springer Singapore, 2021, pp. 771–785,.

[68]

Kulik J.A., Kulik C.-L.C., The concept of meta-analysis, International Journal of Educational Research 13 (3) (1989) 227–340,.

[69]

Kumar L., Goyal P., Malik K., Kumar R., Shrivastav D., Using machine learning, image processing and neural networks to sense bullying in K-12 schools: Enhanced, in: Data engineering for smart systems, Springer Singapore, 2021, pp. 1–12,.

[70]

Lasri I., olh S.R., Belkacemi M.E., Facial emotion recognition of students using convolutional neural network, in: 2019 Third international conference on intelligent computing in data sciences, 2019, pp. 1–6,.

[71]

Lecun Y., Bottou L., Bengio Y., Haffner P., Gradient-based learning applied to document recognition, Proceedings of the IEEE 86 (11) (1998) 2278–2324,.

[72]

Leong F.H., Deep learning of facial embeddings and facial landmark points for the detection of academic emotions, in: Proceedings of the 5th international conference on information and education innovations, Association for Computing Machinery, New York, NY, USA, 2020, pp. 111–116,.

Digital Library

[73]

Li X., He Z., Xian H., Situ H., Zhou Y., An intelligent total score calculation system for test paper, in: 2019 International conference on wavelet analysis and pattern recognition, 2019, pp. 1–5,.

[74]

Li L., Li L., Design and application of the piano teaching system integrating videos and images, Scientific Programming 2022 (2022),.

Digital Library

[75]

Li B., Minematsu T., Taniguchi Y., Okubo F., Shimada A., How does analysis of handwritten notes provide better insights for learning behavior?, in: LAK22: 12th international learning analytics and knowledge conference, in: LAK22, Association for Computing Machinery, New York, NY, USA, 2022, pp. 549–555,.

Digital Library

[76]

Li X., Yue R., Jia W., Wang H., Zheng Y., Recognizing students’ emotions based on facial expression analysis, in: 2021 11th international conference on information technology in medicine and education, 2021, pp. 96–100,.

[77]

jian Li Z., tao Zeng W., qin Zhang X., Research on student’s learning efficiency based on classroom facial expression analysis, in: 2021 2nd International conference on computing, networks and internet of things, Association for Computing Machinery, New York, NY, USA, 2021,.

Digital Library

[78]

Li Z., Zhan Z., Integrated infrared imaging techniques and multi-model information via convolution neural network for learning engagement evaluation, Infrared Physics & Technology 109 (2020),.

[79]

Lin S.-Y., Wu C.-M., Chen S.-L., Lin T.-L., Tseng Y.-W., Continuous facial emotion recognition method based on deep learning of academic emotions, Sensors and Materials 32 (10) (2020) 3243–3259,.

[80]

Lin Y., Zheng L., Chen F., Sun S., Lin Z., Chen P., Design and implementation of intelligent scoring system for handwritten short answer based on deep learning, in: 2020 IEEE international conference on artificial intelligence and information systems, 2020, pp. 184–189,.

[81]

Liu H., Ao W., Hong J., Student abnormal behavior recognition in classroom video based on deep learning, in: Proceedings of the 2021 5th international conference on electronic information technology and computer engineering, in: EITCE 2021, Association for Computing Machinery, New York, NY, USA, 2022, pp. 664–671,.

Digital Library

[82]

Liu T., Chen Z., Wang X., Automatic instructional pointing gesture recognition by machine learning in the intelligent learning environment, in: Proceedings of the 2019 4th international conference on distance education and learning, in: ICDEL 2019, Association for Computing Machinery, New York, NY, USA, 2019, pp. 153–157,.

Digital Library

[83]

Liu Q., Huang Z., Huang Z., Liu C., Chen E., Su Y., Hu G., Finding similar exercises in online education systems, in: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, Association for Computing Machinery, New York, NY, USA, 2018, pp. 1821–1830,.

Digital Library

[84]

Liu Y., Li Q., Improved convolutional neural networks for course teaching quality assessment, Advances in Multimedia 2022 (2022),.

Digital Library

[85]

Llanda C.J.R., Video tutoring system with automatic facial expression recognition: An enhancing approach to E-learning environment, in: Proceedings of the 2019 4th international conference on intelligent information technology, Association for Computing Machinery, New York, NY, USA, 2019, pp. 5–9,.

Digital Library

[86]

Logeshvar L., Premnath A.B., Geethan R., Suganya R., AI based examination assessment mark management system, in: 2021 2nd International conference on secure cyber computing and communications, 2021, pp. 144–149,.

[87]

Long D.T., A facial expressions recognition method using residual network architecture for online learning evaluation, Journal of Advanced Computational Intelligence and Intelligent Informatics 25 (6) (2021) 953–962,.

[88]

Lu L., Pei-liang Y., Wei-wei S., Jian-wei M., Similar handwritten Chinese character recognition based on CNN-svm, in: Proceedings of the 1st international conference on graphics and signal processing, Association for Computing Machinery, New York, NY, USA, 2017, pp. 16–20,.

Digital Library

[89]

Mangaroska K., Giannakos M., Learning analytics for learning design: A systematic literature review of analytics-driven design to enhance learning, IEEE Transactions on Learning Technologies 12 (4) (2019) 516–534,.

Digital Library

[90]

Marceddu A.C., Pugliese L., Sini J., Espinosa G.R., Solouki M.A., Chiavassa P., Giusto E., Montrucchio B., Violante M., Pace F.D., A novel redundant validation IoT system for affective learning based on facial expressions and biological signals, Sensors 22 (7) (2022),.

[91]

Matcha W., Uzir N.A., Gašević D., Pardo A., A systematic review of empirical studies on learning analytics dashboards: A self-regulated learning perspective, IEEE Transactions on Learning Technologies 13 (2) (2019) 226–245.

Digital Library

[92]

Medida L.H., Ramani K., Impact of deep learning on localizing and recognizing handwritten text in lecture videos, International Journal of Advanced Computer Science and Applications 12 (4) (2021),.

[93]

Mengting S., Gang C., Wen Z., Runkai Z., Yaqin L., Design of children’s education auxiliary system based on CNN, in: 2020 15th International conference on computer science & education, 2020, pp. 325–330,.

[94]

Methley A.M., Campbell S., Chew-Graham C., McNally R., Cheraghi-Sohi S., PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews, BMC Health Services Research 14 (579) (2014) 1–10,.

[95]

Mor N.S., Dardeck K., Applying a convolutional neural network to screen for specific learning disorder, Learning Disabilities: A Contemporary Journal 19 (2) (2021) 161–169.

[96]

Naqvi N., Islam M.S., Iqbal M., Kanwal S., Khan A., Ye Z., Deep neural combinational model (DNCM): Digital image descriptor for child’s independent learning, Multimedia Tools Appl. 81 (21) (2022) 29955–29975,.

Digital Library

[97]

Nazaretsky T., Bar C., Walter M., Alexandron G., Empowering teachers with AI: Co-designing a learning analytics tool for personalized instruction in the science classroom, in: LAK22: 12th international learning analytics and knowledge conference, in: LAK22, Association for Computing Machinery, New York, NY, USA, 2022, pp. 1–12,.

Digital Library

[98]

Nobre G.C., Valentini N.C., Nobre F.S.S., Fundamental motor skills, nutritional status, perceived competence, and school performance of Brazilian children in social vulnerability: Gender comparison, Child Abuse & Neglect 80 (2018) 335–345,.

[99]

Paidja A.N.R., Bachtiar F.A., Engagement emotion classification through facial landmark using convolutional neural network, in: 2022 2nd International conference on information technology and education, 2022, pp. 234–239,.

[100]

Pei J., Shan P., A micro-expression recognition algorithm for students in classroom learning based on convolutional neural network, Traitement Du Signal 36 (6) (2019) 557–563,.

[101]

Pei Z., Shang H., Su Y., Ma M., Peng Y., Convolutional neural networks for class attendance, in: 2017 13th International conference on natural computation, fuzzy systems and knowledge discovery, 2017, pp. 809–814,.

[102]

Phyo, C. N., Zin, T. T., Kamada, H., & Toriu, T. (2018). Image Technology based Students’ Feedbacks Analyzing System using Deep Learning. In Lecture notes in engineering and computer science: Proceedings of the international multiconference of engineers and computer scientists (pp. 330–333). Hong Kong.

[103]

Pilania U., Singh S., Implementation of image-based attendance system, in: 2022 3rd International conference on electronics and sustainable communication systems, 2022, pp. 937–941,.

[104]

Ping C., Da-Peng H., Zu-Ying L., Automatic attendance face recognition for real classroom environments, in: Proceedings of the 2018 2nd international conference on big data and internet of things, in: BDIOT 2018, Association for Computing Machinery, New York, NY, USA, 2018, pp. 65–70,.

Digital Library

[105]

Poudyal S., Mohammadi-Aragh M.J., Ball J.E., Prediction of student academic performance using a hybrid 2D cnn model, Electronics 11 (7) (2022) 1005,.

[106]

Prangchumpol D., Face recognition for attendance system using neural networks technique, in: Proceedings of the 2019 3rd international symposium on computer science and intelligent control, in: ISCSIC 2019, Association for Computing Machinery, New York, NY, USA, 2020,.

Digital Library

[107]

Rajalakshmi M., Saranya P., Shanmugavadivu P., Pattern recognition-recognition of handwritten document using convolutional neural networks, in: 2019 IEEE international conference on intelligent techniques in control, optimization and signal processing, IEEE, Tamilnadu, India, 2019, pp. 1–7,.

[108]

Rajamanogaran M., Subha S., Priya S.B., Sivasamy J., Contactless attendance management system using artificial intelligence, Journal of Physics: Conference Series 1714 (1) (2021),.

[109]

Remaida, A., Moumen, A., Idrissi, Y. E. B. E., & Sabri, Z. (2020). Handwriting recognition with artificial neural networks a decade literature review. In Proceedings of the 3rd international conference on networking, information systems & security (pp. 1–5).

[110]

Reyes A., Vallejo-Huanga D., Automatic recognition of pictograms with convolutional neural network approach for literacy, in: Smart technologies, systems and applications, Springer International Publishing, 2022, pp. 219–231,.

[111]

Romero C., Ventura S., Educational data mining and learning analytics: An updated survey, Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 10 (3) (2020).

[112]

Russakovsky O., Deng J., Hao Su J.K., Satheesh S., Ma S., Huang Z., Karpathy A., Khosla A., Bernstein M., Berg A.C., Fei-Fei L., ImageNet large scale visual recognition challenge, International Journal of Computer Vision 115 (3) (2015) 211–252,.

Digital Library

[113]

S. A.T., Guddeti R.M.R., Automatic detection of students’ affective states in classroom environment using hybrid convolutional neural networks, Education and Information Technologies 25 (2020) 1387–1415,.

[114]

Salehin I., Nessa N., Talha I., Hasan M., Nur F., Hakim M., Haque A., Analysis of student sentiment during video class with multi- layer deep learning approach, International Journal of Electrical and Computer Engineering 13 (2022) 3981–3993,.

[115]

Savchenko A.V., Savchenko L.V., Makarov I., Classifying emotions and engagement in online learning based on a single facial expression recognition neural network, IEEE Transactions on Affective Computing 13 (4) (2022) 2132–2143,.

[116]

Sethi K., Jaiswal V., PSU-CNN: Prediction of student understanding in the classroom through student facial images using convolutional neural network, Materials Today: Proceedings 62 (2022) 4957–4964,.

[117]

Shaghaghi N., Khadadeh M., McGinnis M., Liang L., Calle A., Classroom configuration identifier (CCID), in: 2019 IEEE 11th international conference on engineering education, 2019, pp. 204–209,.

[118]

Shaikh E., Mohiuddin I., Manzoor A., Latif G., Mohammad N., Automated grading for handwritten answer sheets using convolutional neural networks, in: 2019 2nd International conference on new trends in computing sciences, 2019, pp. 1–6,.

[119]

Sharma A., Jayagopi D.B., Automated grading of handwritten essays, in: 2018 16th International conference on frontiers in handwriting recognition, 2018, pp. 279–284,.

[120]

Sharma A., Mansotra V., Deep learning based student emotion recognition from facial expressions in classrooms, International Journal of Engineering and Advanced Technology 8 (6) (2019) 4691–4699,.

[121]

Sharma A., Mansotra V., Multimodal decision-level group sentiment prediction of students in classrooms, International Journal of Innovative Technology and Exploring Engineering 8 (12) (2019) 4902–4909,.

[122]

Shi Z., Zhang Y., Bian C., Lu W., Automatic academic confusion recognition in online learning based on facial expressions, in: 2019 14th International conference on computer science & education, 2019, pp. 528–532,.

[123]

Siam S.C., Faisal A., Mahrab N., Haque A.B., Suvon M.N.I., Automated student review system with computer vision and convolutional neural network, in: 2021 International conference on computing, communication, and intelligent systems, 2021, pp. 493–497,.

[124]

Simonyan K., Zisserman A., Very deep convolutional networks for large-scale image recognition, in: Bengio Y., LeCun Y. (Eds.), 3rd International conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015.

[125]

Sinha S., Mishra S.K., Bilgaiyan S., Emotion analysis to provide counseling to students fighting from depression and anxiety by using CCTV surveillance, in: Machine learning and information processing, Springer Singapore, 2020, pp. 81–94,.

[126]

Smith A.J., Wyk B.J.V., Du S., CNNs and transfer learning for lecture venue occupancy and student attention monitoring, in: Advances in visual computing, Springer International Publishing, 2019, pp. 383–393,.

Digital Library

[127]

Smyth J.A., The origins of the international standard classification of education, Peabody Journal of Education 83 (1) (2008) 5–40,.

[128]

Staples M., Niazi M., Experiences using systematic review guidelines, Journal of Systems and Software 80 (9) (2007) 1425–1437,.

Digital Library

[129]

Sun A., Li Y., Huang Y.-M., Li Q., The exploration of facial expression recognition in distance education learning system, in: Lecture notes in computer science, Springer International Publishing, 2018, pp. 111–121,.

[130]

Sun H., an Zhu G., Cui X., Wang J.-X., Kinect-based intelligent monitoring and warning of students’ sitting posture, in: 2021 6th International conference on automation, control and robotics engineering, 2021, pp. 338–342,.

[131]

Sutabri T., Pamungkur G., Kurniawan A., Saragih R.E., Automatic attendance system for university student using face recognition based on deep learning, International Journal of Machine Learning and Computing 9 (5) (2019) 668–674,.

[132]

Szegedy C., Liu W., Jia Y., Sermanet P., Reed S., Anguelov D., Erhan D., Vanhoucke V., Rabinovich A., Going deeper with convolutions, in: 2015 IEEE conference on computer vision and pattern recognition, 2015, pp. 1–9,.

[133]

Tabassum T., Allen A.A., De P., Non-intrusive identification of student attentiveness and finding their correlation with detectable facial emotions, in: Proceedings of the 2020 ACM southeast conference, in: ACM SE ’20, Association for Computing Machinery, New York, NY, USA, 2020, pp. 127–134,.

Digital Library

[134]

Tang Y., Liu L., A novel deep learning technique for higher education system, Mathematical Problems in Engineering 2022 (2022),.

[135]

Tavares J.F., Costa Y.M.G., Colanzi T.E., Classification of UML diagrams to support software engineering education, in: 2021 36th IEEE/ACM international conference on automated software engineering workshops, 2021, pp. 102–107,.

[136]

Thejeshwar S.S., Shivapooja A.V., Understanding the student behavioural pattern in an elearning environment, in: 2020 International conference for emerging technology, 2020, pp. 1–5,.

[137]

Thiruthuvanathan M., Krishnan B., Rangaswamy M., Engagement detection through facial emotional recognition using a shallow residual convolutional neural networks, International Journal of Intelligent Engineering and Systems 14 (2) (2021) 236–247.

[138]

Tian H., Optimization of hybrid multimedia art and design teaching mode in the era of big data, Scientific Programming 2021 (2021),.

Digital Library

[139]

T.S. A., Guddeti R.M.R., Affective database for e-learning and classroom environments using Indian students’ faces, hand gestures and body postures, Future Generation Computer Systems 108 (2020) 334–348,.

[140]

Vashist P.C., Pandey A., Tripathi A., A comparative study of handwriting recognition techniques, in: 2020 International conference on computation, automation and knowledge management, IEEE, 2020, pp. 456–461.

[141]

Vijay M., Devika R., Priyangha B.S., Group face recognition smart attendance system using convolution neural network, in: 2022 International conference on wireless communications signal processing and networking, 2022, pp. 89–93,.

[142]

Vo C., Nguyen H.P., An enhanced CNN model on temporal educational data for program-level student classification, in: Nguyen N.T., Jearanaitanakij K., Selamat A., Trawiński B., Chittayasothorn S. (Eds.), Intelligent information and database systems, Springer International Publishing, Cham, 2020, pp. 442–454.

[143]

Wang F., AI-based english teaching cross-cultural fusion mechanism, Evolutionary Intelligence (2022),.

[144]

Wang P., Construction of a prediction model for distance education quality assessment based on convolutional neural network, Cao N. (Ed.), Computational Intelligence and Neuroscience 2022 (2022) 1–10,.

Digital Library

[145]

Wang Y., Sun Y., Song W., Gao S., Huang Y., Chen Z., Ge W., Zhang W., Dpcnet: Dual path multi-excitation collaborative network for facial expression representation learning in videos, in: Proceedings of the 30th ACM international conference on multimedia, Association for Computing Machinery, New York, NY, USA, 2022, pp. 101–110,.

Digital Library

[146]

Wu T.-W., Zhang H., Peng W., Lü F., He P.-J., Applications of convolutional neural networks for intelligent waste identification and recycling: A review, Resources, Conservation and Recycling 190 (2023),.

[147]

Xu Y., Teng H., Ji C., Ye M., Lu H., Target classification system based on target detection for students’ classroom assessment, in: 2019 10th International conference on information technology in medicine and education, 2019, pp. 541–545,.

[148]

Xu B., Zhang Q., Gao K., Yu G., Zhang Z., Du Y., Recognition of learners’ personality traits for software engineering education, in: ACM turing award celebration conference - China, in: ACM TURC 2021, Association for Computing Machinery, New York, NY, USA, 2021, pp. 1–7,.

Digital Library

[149]

Yadav K., Gandhi A., Biswas A., Shrivastava K., Srivastava S., Deshmukh O., Vizig: Anchor points based non-linear navigation and summarization in educational videos, in: Proceedings of the 21st international conference on intelligent user interfaces, Association for Computing Machinery, New York, NY, USA, 2016, pp. 407–418,.

Digital Library

[150]

Yang J., Huang X., Chen G., Duan X., An english handwriting quality evaluation algorithm based on machine learning, in: 2021 IEEE international conference on software engineering and artificial intelligence, 2021, pp. 12–16,.

[151]

Yang H., Peng C., Sun R., Zhou Y., Cui X., Student expression recognition in smart education environment based on convolutional neural network, in: 2022 9th International conference on dependable systems and their applications, 2022, pp. 562–568,.

[152]

Yang Z., Yang J., Rice K., Hung J.-L., Du X., Using convolutional neural network to recognize learning images for early warning of at-risk students, IEEE Transactions on Learning Technologies 13 (3) (2020) 617–630,.

[153]

Yi X., DRIIS: Research on image classification of art education system based on deep learning, International Journal of Cooperative Information Systems 31 (01n02) (2022),.

[154]

Yin Y., Liu Q., Huang Z., Chen E., Tong W., Wang S., Su Y., QuesNet: A unified representation for heterogeneous test questions, in: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, Association for Computing Machinery, New York, NY, USA, 2019, pp. 1328–1336,.

Digital Library

[155]

Yoshihashi R., Shimada D., Iyatomi H., Feasibility study on evaluation of audience’s concentration in the classroom with deep convolutional neural networks, in: 2014 IEEE international conference on teaching, assessment and learning for engineering, 2014, pp. 288–292,.

[156]

Yu J., Analysis of task degree of english learning based on deep learning framework and image target recognition, Journal of Intelligent & Fuzzy Systems 39 (2) (2020) 1903–1914,.

Digital Library

[157]

Zamora-Mora J., Chacón-Rivas M., Real-time hand detection using convolutional neural networks for costa rican sign language recognition, in: 2019 International conference on inclusive technologies and education, 2019, pp. 180–1806,.

[158]

Zeiler M.D., Fergus R., Visualizing and understanding convolutional networks, in: Fleet D., Pajdla T., Schiele B., Tuytelaars T. (Eds.), Computer vision – ECCV 2014, Springer International Publishing, Cham, 2014, pp. 818–833.

[159]

Zhang D., Affective cognition of students’ autonomous learning in college english teaching based on deep learning, Frontiers in Psychology 12 (2022),.

[160]

Zhang Z., Chai X., Luo H., S2FCM: A two-stage fine classification model for students’ attention analysis, in: 2022 IEEE 25th international conference on computer supported cooperative work in design, 2022, pp. 780–785,.

[161]

Zhang S., Kumar V., Evaluation of the physical education teaching and training efficiency by the integration of ideological and political courses with lightweight deep learning, Computational Intelligence and Neuroscience 2022 (2022),.

Digital Library

[162]

Zhang S., Li C., Research on feature fusion speech emotion recognition technology for smart teaching, Mobile Information Systems 2022 (2022),.

Digital Library

[163]

Zhang Y., Qiu C., Zhong N., Su X., Zhang X., Huang F., Wang L., Wang L., AI education based on evaluating concentration of students in class: Using machine vision to recognize students’ classroom behavior, in: 2021 the 5th International conference on video and image processing, in: ICVIP 2021, Association for Computing Machinery, New York, NY, USA, 2022, pp. 126–133,.

Digital Library

[164]

Zhao X., Xiong Z., Li T., Wang Y., CRNN with 2D attention for word recognition of English exams, in: Pan Z., Hei X. (Eds.), Twelfth international conference on graphics and image processing, Vol. 11720, International Society for Optics and Photonics, SPIE, 2021, p. 117201E,.

[165]

Zheng K., Yang D., Liu J., Cui J., Recognition of teachers’ facial expression intensity based on convolutional neural network and attention mechanism, IEEE Access 8 (2020) 226437–226444,.

[166]

Zhiyao Z., Di B.M., Multiplet selection: A practical study of multi-faces recognition for student attendance system, in: Proceedings of the 2nd international conference on image and graphics processing, Association for Computing Machinery, New York, NY, USA, 2019, pp. 42–46,.

Digital Library

[167]

Zhou Z., An intelligent teaching assistant system using deep learning technologies, in: Proceedings of the 2020 5th international conference on machine learning technologies, in: ICMLT 2020, Association for Computing Machinery, New York, NY, USA, 2020, pp. 18–22,.

Digital Library

[168]

Zhou J., Ran F., Li G., Peng J., Li K., Wang Z., Classroom learning status assessment based on deep learning, Mathematical Problems in Engineering 2022 (2022),.

[169]

Zhu J., Yu F., Liu G., Sun M., Zhao D., Geng Q., Su J., Classroom roll-call system based on ResNet networks, Journal of Information Processing Systems 16 (5) (2020) 1145–1157,.

[170]

Zin T.T., Thant S., Pwint M.Z., Ogino T., Handwritten character recognition on android for basic education using convolutional neural network, Electronics 10 (8) (2021).

Cited By

Silva LSobrinho ÁCordeiro TSilva ADermeval DMarques LBittencourt IJúnior JMelo RPortela CSouza MPereira RYasojima EIsotani S(2024)Assessing students’ handwritten text productionsExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123780250:COnline publication date: 18-Jul-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.123780
Guleria P(2024)Blending Shapley values for feature ranking in machine learning: an analysis on educational dataNeural Computing and Applications10.1007/s00521-024-09861-136:23(14093-14117)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s00521-024-09861-1

Recommendations

A flipped classroom to personalise learning for engineering students

Flipped classrooms, also known as reversed or inverted classroom, has attracted widespread attention in higher education for active engagement and enhanced learning outcomes. It is proposed in the literature that flipped classroom promotes self-directed ...
Integration of Web-Based Learning into Higher Education Institutions in Uganda: Teachers' Perspectives

This article reports on the barriers encountered by teachers and the possible solutions to the integration of web-based learning WBL into higher educational institutions in Uganda. A total of 50 teachers in the departments of ICT, management, and social ...
Towards dropout training for convolutional neural networks

Recently, dropout has seen increasing use in deep learning. For deep convolutional neural networks, dropout is known to work well in fully-connected layers. However, its effect in convolutional and pooling layers is still not clear. This paper ...

Comments

Information & Contributors

Information

Published In

cover image Expert Systems with Applications: An International Journal

Expert Systems with Applications: An International Journal Volume 231, Issue C

Nov 2023

1599 pages

ISSN:0957-4174

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 30 November 2023

Author Tags

Qualifiers

Review-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Silva LSobrinho ÁCordeiro TSilva ADermeval DMarques LBittencourt IJúnior JMelo RPortela CSouza MPereira RYasojima EIsotani S(2024)Assessing students’ handwritten text productionsExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123780250:COnline publication date: 18-Jul-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.123780
Guleria P(2024)Blending Shapley values for feature ranking in machine learning: an analysis on educational dataNeural Computing and Applications10.1007/s00521-024-09861-136:23(14093-14117)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s00521-024-09861-1

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents