Design and Application of an AI-Based Text Content Moderation System
Authors: 
Heng Sun, Wan Ni Academic Editor: Ahmed FaroukAuthors Info & Claims
Heng Sun, Wan Ni Academic Editor: Ahmed FaroukAuthors Info & ClaimsAbstract
Cloud computing, 5G mobile network, and other new technologies have been applied in higher education in recent years. The education video resource service system with adaptive multiterminals has received widespread attention from the field. From these videos, students can get new knowledge and use the system’s built-in text comment function to communicate and interact with others. However, due to the fast increase in the number of such text comments, the traditional text content moderation methods such as the keyword method and the regular expression method can no longer meet the growing business needs. Therefore, to solve this matter, this study designed a text content moderation (TCM) system based on artificial intelligence (AI), which uses artificial intelligence and cloud-based algorithm models to analyse and recognize the text comments submitted from the web-end and app-end of the education video resource service system and completes operations such as automatic detection and manual moderation. The proposed TCM system can significantly improve the efficiency of text content moderation.
References
[1]
S. Q. Guo, J. J. Huang, and Q. F. Yuan, “A review of the development of mobile learning applications abroad,” E-Education Research, vol. 5, pp. 105–109, 2011.
[2]
J. Chen, “Design and realization of the content management system of TV,” Broadcasting and Television Technology, vol. 4, pp. 4–10, 2015.
[3]
S. Wang, Z. Wang, and H. Ren, “Research on fusion model based on deep learning for text content security enhancement,” Telecommunications Science, vol. 36, no. 5, pp. 25–30, 2020.
[4]
M. Liu and G. Huang, “Research on harmful text filtering model based on semantic analysis,” Journal of Chinese Information Processing, vol. 32, no. 2, pp. 126–131, 2017.
[5]
S. Myers West, “Censored, suspended, shadowbanned: user interpretations of content moderation on social media platforms,” New Media & Society, vol. 20, no. 11, pp. 4366–4383, 2018.
[6]
A. Heldt and S. Dreyer, “Competent third parties and content moderation on platforms: potentials of independent decision-making bodies from A governance structure perspective,” Journal of Information Policy, vol. 11, no. s1, pp. 266–300, 2021.
[7]
Q. Chen, X. Hu, and H. Yuan, “A large-scaled platform of education resources based on cloud services,” Modern Educational Technology, vol. 21, no. 12, pp. 112–115, 2011.
[8]
E. A. Ahmed and H. Ali Ahmed, “A proposed model for education system using cloud computing,” in Proceedings of the 2018 3rd International Conference on Emerging Trends in Engineering, Sciences and Technology, ICEEST, Karachi, Pakistan, December 2018.
[9]
J. Seering, “Reconsidering community self-moderation: the role of research in supporting community-based models for online content moderation,” Proceedings of the ACM on Human-Computer Interaction, vol. 4, p. 107, CSCW2, 2020.
[10]
B. Cameron, E. Crawley, and D. Selva, Systems Architecture. Strategy and Product Development for Complex Systems, Pearson Education, 2016, https://www.google.com/search?rlz=1C1GCEB_enIN990IN990&q=London&stick=H4sIAAAAAAAAAOPgE-LUz9U3MC8wrSpW4gAxTbIKcrS0spOt9POL0hPzMqsSSzLz81A4VhmpiSmFpYlFJalFxYtY2Xzy81Ly83awMgIA61Psi08AAAA&sa=X&ved=2ahUKEwjr976Lyd71AhXZ8XMBHbFNCGwQmxMoAXoECDgQAw.
[11]
W. Zhu, H. Gong, R. Bansal, Z. Weinberg, N. Christin, G. Fanti, and S. Bhat, “Self-supervised euphemism detection and identification for content moderation,” in Proceedings of the IEEE Symposium on Security and Privacy, pp. 229–246, Francisco, CA, USA, May 2021.
[12]
G. Uddin, F. Khomh, and C. K. Roy, “Mining API usage scenarios from stack overflow,” Information and Software Technology, vol. 122, 2020.
[13]
P. Coutinho and J. Rui, “Moderation techniques for user-generated content in place-based communication,” in Proceedings of the 2017 12th Iberian Conference on Information Systems and Technologies, CISTI) IEEE, Lisbon, Portugal, June 2017.
[14]
A. Veglis, “Moderation techniques for social media content,” in Proceedings of the International Conference on Social Computing & Social Media, Social Computing and Social Media, pp. 137–148, Heraklion, Crete, Greece, June 2014.
[15]
M. J. Kavis, Architecting the Cloud: Design Decisions for Cloud Computing Service Models, Wiley, 2021, https://www.google.com/search?rlz=1C1GCEB_enIN990IN990&q=Hoboken&stick=H4sIAAAAAAAAAOPgE-LUz9U3MMotLypT4gAxK_LMk7S0spOt9POL0hPzMqsSSzLz81A4VhmpiSmFpYlFJalFxYtY2T3yk_KzU_N2sDICAC-vG35QAAAA&sa=X&ved=2ahUKEwiZpKvvzN71AhVt7HMBHY68D08QmxMoAXoECCYQAw.
[16]
D. M. Riehle, M. Niemann, J. Brunk, D. Assenmacher, H. Trautmann, and J. Becker, “Building an integrated comment moderation system - towards a semi-automatic moderation tool,” in Proceedings of the International Conference on Human-Computer Interaction, Lecture Notes in Computer Science, pp. 71–86, Heraklion, Crete, Greece, June 2020.
[17]
J. A. Panattoni, R. McAlpine, K. B. Bobade, M. J. Wilson, and C. Willy, “Escalation of machine-learning inputs for content moderation,” U.S. Patent Application, vol. 331, 2018.
[18]
J. Pavlopoulos, P. Malakasiotis, and I. Androutsopoulos, “Deeper attention to abusive user content moderation,” in Proceedings of the EMNLP 2017 - Conference on Empirical Methods in Natural Language Processing, pp. 1125–1135, Copenhagen, Denmark, September 2017.
[19]
V. Maddumala and R. Arunkumar, “Big data-driven feature extraction and clustering based on statistical methods,” Traitement du Signal, vol. 37, no. 3, pp. 387–394, 2020.
[20]
S. Jhaver, S. Ghoshal, A. Bruckman, and E. Gilbert, “Online harassment and content moderation: the case of blocklists,” ACM Transactions on Computer-Human Interaction, vol. 25, no. 2, 2018.
Recommendations
Moderation Techniques for Social Media Content
Proceedings of the 6th International Conference on Social Computing and Social Media - Volume 8531Social media are perhaps the most popular services of cyberspace today. The main characteristic of social media is that they offer to every internet user the ability to add content and thus contribute to participatory journalism. The problem in that ...
A Trade-off-centered Framework of Content Moderation
Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it ...
Identifying and Addressing Design and Policy Challenges in Online Content Moderation
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsMy doctoral research identifies and addresses the design and policy challenges of content moderation on the levels of smaller communities and larger platforms, using a combination of interviews and surveys. My prior work studies voice-based communities ...
Comments
Information & Contributors
Information
Published In
Copyright © 2022 Heng Sun and Wan Ni.
This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Publisher
Hindawi Limited
London, United Kingdom
Publication History
Published: 01 January 2022
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Nov 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in