Design and Implementation of Teaching System Based on RGB-D Human-Computer Interaction
Authors: 
Ying Guo, LeLe Zhang, Tongao Ge, Haoran Yang, Guowei Zhao, Hui LiAuthors Info & Claims
Ying Guo, LeLe Zhang, Tongao Ge, Haoran Yang, Guowei Zhao, Hui LiAuthors Info & ClaimsPages 73 - 78
Abstract
The traditional teaching model has shortcomings such as single presentation method and difficult storage of writing on the blackboard, The emergence of multimedia teaching will change the form of chalk and blackboard in traditional teaching and improve teaching efficiency. However, there are also defects such as relying on input device control, which affects teaching quality. The control method based on human-computer interaction can solve this drawback and improve the interaction between teachers and students. Therefore, this paper designs a teaching system based on RGB-D human-computer interaction. This system uses Kinect to obtain depth images to identify the skeleton model of the human body. By analyzing the needs of the teaching system, designing corresponding control actions and acquiring three-dimensional data of key joint points for these actions, Analyze this data to get the main feature information and auxiliary judgment information of the movement, Design a control action recognition algorithm based on this information, Finally, comprehensive control requirements and control actions are designed to design a teaching control system to realize auxiliary control of common teaching functions. After testing, the correct rate of the system's various action recognition algorithms is about 95%, and the real-time, stability and other indicators meet the requirements of teaching control, and the system performance is good.
References
[1]
Ma Zhenhong. Research on the application of multimedia teaching in high school chemistry [J]. Contemporary Family Education, 2021(30): 135-136.
[2]
Zhao Meiqun. A multimedia teaching system based on animation [P]. Zhejiang Province: CN113436480A, 2021-09-24.
[3]
.Wang Jun. Design of multimedia teaching system for computer network technology courses[J]. Computer Knowledge and Technology, 2021, 17(26): 115-117.
[4]
Xiang Haiyun, Fu Xiao, Li Xu, Li Yi. Investigation and research on the status quo of multimedia teaching in colleges and universities[J]. Curriculum Education Research, 2017(38): 3-4.
[5]
Li Yuqian. A brief talk on the shortcomings of multimedia teaching in middle school Chinese teaching [J]. New Curriculum, 2019(07): 126.
[6]
Yan Xiangqing. Examples on the misunderstandings and countermeasures of multimedia teaching in political courses in high schools[J]. Audio-visual Education in Primary and Secondary Schools (the second half of the month), 2018(07): 14.
[7]
Tingting Liu, et al.Multi-modal hand gesture designing in multi-screen touchable teaching system for human-computer interaction.Proceedings of 2018 the 2nd International Conference on Advances in Image Processing (ICAIP 2018).Ed. ACM, 2018:200-204.
[8]
Kashef Mohamad, Visvizi Anna, Troisi Orlando. Smart city as a smart service system:human-computer interaction and smart city surveillance systems[J] Computers in Human Behavior, 2021:124(prepublish)
[9]
Zimmerman John. Commentary: critique of contesting control: how an excellent exemplar of artist-led HCI research surfaces unresolved issues[J]. Human–Computer Interaction,2021:36(5-6)
[10]
Ya-nan LIN, et al.Research of “Silk Road” knowledge teaching mode based on human-computer virtual interaction.Proceedings of 2019 International Conference on Information Technology, Electrical and Electronic Engineering (ITEEE 2019).Ed. DEStech Publications, 2019:742-746.
[11]
Ueda, E.Matsumoto, Y.Imai, M.Ogasawara, T. Hand pose estimation for vision-based human interface[P]. Robot and human interactive communication, 2001. Proceedings. 10th IEEE International Workshop on,2001.
[12]
T Mallick, P.P. Das, and A. K. Majumdar. Characterizations of noise in kinect depth images: a review. IEEE SEN, vol. 14, no. 6, June 2014:1731–1740.
[13]
Q. Ke, S.An, M.Bennamoun, F.Sohel and F.Boussaid. SkeletonNet: Mining deep part features for 3D action recognition. IEEE SPL, vol. 24, no. 6, 2017: 731–735.
[14]
H.Rahmani and M.Bennamoun. Learning action recognition model from depth and skeleton Videos. ICCV, 2017:5832–5841
[15]
H.Rahmani, A.Mian, and M.Shah. Learning a deep model for human action recognition from novel viewpoints. TPAMI, 2015:1–14.
[16]
Y. Tang, Y. Tian, J. Lu, P. Li, and J. Zhou. Deep progressive reinforcement learning for skeleton-based action recognition. CVPR, 2018:1–10
[17]
C. Si, Y . Jing, W. Wang, L. Wang, and T. Tan. Skeleton-based action recognition with spatial reasoning and temporal stack learning. ECCV, 2018:1–16.
[18]
Tao Liu and Haihao Zheng, "A Study of Digital Interactive Technology and Design Mode Promoting the Learners’ Metacognitive Experience in Smart Education," International Journal of Information and Education Technology vol. 11, no. 10, pp. 493-497, 2021.
[19]
Gayatri Mehta, Jeanne Tunks, Kiran Sanagapaty, Alok Pal, and Rani Deepika Balavendran Joseph, "Constructing Knowledge in an Interactive Game-Like Design Environment for STEM Education," International Journal of Information and Education Technology vol. 7, no. 8, pp. 566-570, 2017.
[20]
Ahmed R. Althobaiti and Malcolm Munro, "Evaluating an Interactive Electronic Lecture System," International Journal of Information and Education Technology vol. 5, no. 12, pp. 914-919, 2015
Index Terms
- Design and Implementation of Teaching System Based on RGB-D Human-Computer Interaction
Index terms have been assigned to the content through auto-classification.
Recommendations
Design for Teaching Surroundings Based on Human-Computer Interaction Techniques
Design, User Experience, and Usability. Application DomainsAbstractWisdom is far away, whereas Human-Computer Interaction (HCI) is very close. The thesis derives from the big vision of a vocational teacher. Education is a great system, and interaction appears here and there all the time, like Human-Human ...
Touchless gestural interaction with small displays: a case study
CHItaly '13: Proceedings of the Biannual Conference of the Italian Chapter of SIGCHITouchless gestural interaction enables users to interact with digital devices using body movements and gestures, and without the burden of a physical contact with technology (e.g., data gloves, body markers, or remote controllers). Most gesture-based ...
Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware
Human-Computer Interaction (HCI) exists ubiquitously in our daily lives. It is usually achieved by using a physical controller such as a mouse, keyboard or touch screen. It hinders Natural User Interface (NUI) as there is a strong barrier between the ...
Comments
Information & Contributors
Information
Published In
December 2021
323 pages
ISBN:9781450385800
DOI:10.1145/3510309
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 14 March 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICETM'21
ICETM'21: 2021 4th International Conference on Education Technology Management
December 17 - 19, 2021
Tokyo, Japan
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 31Total Downloads
- Downloads (Last 12 months)9
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format