Assisted Speech to Enable Second Language
Pages 3 - 7
Abstract
Speaking a second language (L2) is a desired capability for billionsof people. Currently, the only way to achieve it naturally is througha lengthy and tedious training, which ends up various stages offluency. The process is far away from the natural acquisition of alanguage.In this paper, we propose a system that enables any person withsome basic understanding of L2 speak fluently through "Instant As-sistance" provided by digital conversational agents such as GoogleAssistant, Microsoft Cortana, or Apple Siri, which monitors thespeaker. It attends to provide assistance to continue to speak whenspeech is interrupted as it is not yet completely mastered. The notyet acquired elements of language can be missing words, unfa-miliarity with expressions, the implicit rules of articles, and thehabits of sayings. We can employ the hardware and software of theassistants to create an immersive, adaptive learning environmentto train the speaker online by a symbiotic interaction for implicit,unnoticeable correction.
References
[1]
British Council, Number of English language learners keeps on growing.Retrieved from, https://www.ihlondon.com/blog/posts/2014/number-of-english-language-learners-keeps-on-growing/
[2]
Fryer, L. K., Coniam, D., Carpenter, R., & L'puneanu, D. (2020). Bots for language learning now: Current and future directions. Language Learning & Technology, 24(2), 8--22. Retrievedfrom http://hdl.handle.net/10125/44719
[3]
Levy M. (1997) CALL: context and conceptualisation, Oxford: Oxford University Press.
[4]
Fluency: Foreign Language Accent Correction, Retrieved fromhttps://www.lti.cs.cmu.edu/projects/language-technologies-education/fluency-foreign-language-accent-correction
[5]
Rosetta Stone, Language Learning System, Retrieved from https://www.rosettastone.eu/
[6]
Mondly Language Learning, Retrieved by, https://www.mondly.com/
[7]
Foreign Language Learning in the EU. Retrieved from https://ec.europa.eu/eurostat/news/themes-in-the-spotlight/language-learning
[8]
Brown, H.D. (1994). Principles of Language Learning and Teaching. Englewood Cliffs, N.J.: Prentice Hall
[9]
Bilingualism delays age at onset of dementia, independent of education and immigration statusSuvarna Alladi, Thomas H. Bak, Vasanta Duggirala, Bapiraju Surampudi, Mekala Shailaja, Anuj Kumar Shukla, Jaydip Ray Chaudhuri, Subhash KaulNeurology Nov 2013, 81 (22) 1938--1944;
[10]
Bilingualism, brain reserve, and dementiaDaniela Perani, Mohsen Farsad, Tommaso Ballarini, Francesca Lubian, Maura Malpetti, Alessandro Fracchetti, Giuseppe Magnani, Albert March, Jubin AbutalebiProceedings of the National Academy of Sciences Feb 2017, 114 (7) 1690--1695;
[11]
Graves, A., 2013. Generating sequences with recurrent neural networks. arXiv preprint arXiv:1308.0850 .
[12]
A. Graves and N. Jaitley, 'Towards End-to-End Speech Recognition with Recurrent Neural Networks,' in PMLR, 2014, pp.1764--1772
[13]
Hochreiter, S., Schmidhuber, J., 1997. Lstm can solve hard long time lag problems, in: Advances in neural information processing systems,pp. 473--479.
[14]
H. Sak, A. Senior, K. Rao, O. Irsoy, A. Graves, F. Beaufays, and J. Schalkwyk, 'Learning Acoustic Frame Labelingfor Speech Recognition with Recurrent Neural Networks,' inProc. ICASSP. IEEE, 2015, pp. 4280--4284.
[15]
Y. Miao, M. Gowayyed, and F. Metze, 'EESEN: End-toEnd Speech Recognition using Deep RNN Models and WFSTbased Decoding,' in Proc. ASRU. IEEE, 2015, pp. 167--174.
[16]
William Chan, Navdeep Jaitly, Quoc Le, and Oriol Vinyals,'Listen, attend and spell: A neural network for large vocabulary conversational speech recognition,' in Proc. ICASSP,2016, pp. 4960--4964.
[17]
B. Li et al., "Towards Fast and Accurate Streaming End-To-End ASR," ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, 2020, pp. 6069--6073.
[18]
D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek,Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, and K. Vesely. The kaldi speech recognition toolkit. InIEEE 2011 Workshop on Automatic Speech Recognition and Understanding. IEEE Signal ProcessingSociety, December 2011. IEEE Catalog No.: CFP11SRW-USB.
Index Terms
- Assisted Speech to Enable Second Language
Recommendations
EnglishBot: An AI-Powered Conversational System for Second Language Learning
IUI '21: Proceedings of the 26th International Conference on Intelligent User InterfacesToday, many students learn to speak a foreign language by listening to and repeating pre-recorded materials due to the lack of practice opportunities with human partners. Leveraging recent advancements in AI, Speech, and NLP, we developed EnglishBot, a ...
Understanding is a Two-Way Street: User-Initiated Repair on Agent Responses and Hearing in Conversational Interfaces
CSCWAlthough methods for repairing prior turns in natural conversation are critical for enabling mutual understanding, or successful communication, these methods are seldom built into conversational user interfaces systematically. Chatbots and voice ...
Hey Google, Do Unicorns Exist?: Conversational Agents as a Path to Answers to Children's Questions
IDC '19: Proceedings of the 18th ACM International Conference on Interaction Design and ChildrenChildren are known to be curious and persistent questionaskers. The pervasiveness of voice interfaces represents an opportunity for children who are not yet fluent readers to independently search the Internet by asking questions through conversational ...
Comments
Information & Contributors
Information
Published In
October 2020
44 pages
ISBN:9781450381567
DOI:10.1145/3423325
- Program Chairs:
- Alexander Hauptmann,
- João Magalhães,
- Ricardo Gamelas Sousa,
- João Paulo Costeira
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 October 2020
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MM '20
Sponsor:
Upcoming Conference
MM '24
- Sponsor:
- sigmm
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 116Total Downloads
- Downloads (Last 12 months)21
- Downloads (Last 6 weeks)1
Reflects downloads up to 27 Jul 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in