Abstract
Knowledge construction is expensive for Computer Assisted Assessment. When setting exercise questions, teachers use Test Makers to construct Question Banks. The addition of Automatic Generation to assessment applications decreases the time spent on constructing examination papers. In this article, we present ArikIturri, an Automatic Question Generator for Basque language test questions, which is independent from the test assessment application that uses it. The information source for this question generator consists of linguistically analysed real corpora, represented in XML mark-up language. ArikIturri makes use of NLP tools. The influence of the robustness of those tools and the used corpora is highlighted in the article. We have proved the viability of ArikIturri when constructing fill-in-the-blank, word formation, multiple choice, and error correction question types. In the evaluation of this automatic generator, we have obtained positive results as regards the generation process and its usefulness.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aduriz, I., Aranzabe, M.J., Arriola, J.M., de Ilarraza, A.D., Gojenola, K., Oronoz, M., Uria, L.: A Cascaded Syntactic Analyser for Basque. In: Gelbukh, A. (ed.) CICLing 2004. LNCS, vol. 2945, pp. 124–134. Springer, Heidelberg (2004)
Alegria, I., Aranzabe, M., Ezeiza, A., Ezeiza, N., Urizar, R.: Robustness and customisation in an analyser/lemmatiser for Basque. In: LREC 2002 Customizing knowledge in NLP applications workshop (2002)
Boyle, A., Russell, T., Smith, S., Varga-Atkins, T.: The eLearning Place: progress report on a complete system for learning and assessment. In: Ashby, M. (ed.) Proceedings of the Eight International Computer Assisted Conference, pp. 71–77 (2004), http://www.caaconference.com/
Liu, C.-L., Wang, C.-H., Gao, Z.-M., Huang, S.-M.: Applications of Lexical Information for Algorithmically Composing Multiple choice Cloze Iem. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, Ann Arbor, pp. 1–8 (2005)
Conejo, R., Guzmán, E., Millán, E., Trella, M., Pérez-De-La-Cruz, J.L., Ríos, A.: SIETTE: A Web-Based Tool for Adaptive Testing. International Journal of Artificial Intelligence in Education 14(1), 29–61 (2004)
Díaz de Ilarraza, A., Maritxalar, M., Oronoz, M.: IDAZKIDE: an intelligent CALL environment for second language acquisition. In: Proceedings of a One-day Conference Natural Language Processing in Computer-Assisted Language Learning organised by the Centre for Computational Linguistics, UMIST, in association with EUROCALL. a special Re-CALL publication, UK, pp. 12–19 (1999)
Hoshino, A., Nakagawa, H.: A real-time multiple-choice question generation for language testing. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, Ann Arbor, pp. 17–20 (2005)
Kerejeta, M., Larrañaga, M., Rueda, U., Arruarte, A., Elorriaga, J.A.: A Computer Assisted Assessment Tool Integrated in a Real Use Context. In: Proceedings of the 5th IEEE International Conference on Advanced Learning Technologies, ICALT, pp. 848–852 (2005)
Kraift, O., Antoniadis, G., Echinard, S., Loiseau, M., Lebarbé, T., Ponton, C.: NLP Tools for CALL: the Simpler, the Better. In: Proceedings of the InSTIL/ICALL2004 – NLP and Speech Technologies in Advanced Language Learning Systems, Venice (2004)
Mitkov, R., An, L.: Computer-aided generation of multiple-choice tests. In: Proceedings of the 1st Workshop on Building Educational Applications Using NLP. HLT-NAACL, pp. 17–22 (2003)
Pollock, M.J., Whittington, C.D., Doughty, G.F.: Evaluating the Costs and Benefits of Changing to CAA. In: Proceedings of the Fourth International Computer Assisted Conference CAA (2000), http://www.caaconference.com/
Schwartz, L., Aikawa, T., Pahud, M.: Dynamic Language Learning Tools. In: Proceedings of the InSTIL/ICALL2004 – NLP and Speech Technologies in Advanced Language Learning Systems, Venice (2004)
Sumita, E., Sugaya, F., Yamamota, S.: Measuring Non-native Speakers’ Proficiency of English by Using a Test with Automatically-Generated Fill-in-the Blank Questions. In: Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, Ann Arbor, pp. 61–68 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Aldabe, I., de Lacalle, M.L., Maritxalar, M., Martinez, E., Uria, L. (2006). ArikIturri: An Automatic Question Generator Based on Corpora and NLP Techniques. In: Ikeda, M., Ashley, K.D., Chan, TW. (eds) Intelligent Tutoring Systems. ITS 2006. Lecture Notes in Computer Science, vol 4053. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11774303_58
Download citation
DOI: https://doi.org/10.1007/11774303_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35159-7
Online ISBN: 978-3-540-35160-3
eBook Packages: Computer ScienceComputer Science (R0)