Abstract
Lexical Simplification has the function of changing words or expressions for synonyms that can be understood by a larger number of people. It is very common to have in mind a target audience which will benefit from the task, such as children, low-literacy audiences, and others. In recent years there has been great activity in this field of research, especially for English, but also for other languages such as Japanese and multilingual and cross-lingual scenarios. Few works have children as target audience. Currently, in Brazil, the Programa Nacional do Livro Didático (PNLD) is an initiative with a broad impact on education, as it aims to choose, acquire, and distribute free textbooks to students in public elementary schools. In this scenario, adapting the level of complexity of a text to the reading ability of a student is a determinant of his/her improvement and whether he/she reaches the level of reading comprehension expected for that school year. On the other hand, there have not been publicly available resources on lexical simplification for Portuguese as yet. Therefore, the development of this material is urgent and welcome. This work compiled the SIMPLEX-PB, the first available corpus of lexical simplification for Brazilian Portuguese. We also make available a benchmark for evaluating the most well-known methods of LS in our dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Our corpus and benchmark are available at github.com/nathanshartmann/simplex.
References
Brysbaert, M., New, B.: Moving beyond kucera and francis: a critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for american English. Behav. Res. Methods 41, 977–990 (2009)
Carroll, J., Minnen, G., Canning, Y., Devlin, S., Tait, J.: Practical simplification of English newspaper text to assist aphasic readers. In: Proceedings of the AAAI 1998 Workshop on Integrating Artificial Intelligence and Assistive Technology, pp. 7–10 (1998)
Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 37–46 (1960)
De Belder, J., Moens, M.-F.: A dataset for the evaluation of lexical simplification. In: Gelbukh, A. (ed.) CICLing 2012. LNCS, vol. 7182, pp. 426–437. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-28601-8_36
Glavaš, G., Štajner, S.: Simplifying lexical simplification: do we need simplified corpora? In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2015), vol. 2, pp. 63–68 (2015)
da Graça Krieger, M.: Dicionários escolares e ensino de língua materna. Estudos Linguísticos (São Paulo 1978) 41(1), 169–180 (2016)
Hartmann, N., Cucatto, L., Brants, D., Aluísio, S.: Automatic classification of the complexity of nonfiction texts in portuguese for early school years. In: Silva, J., Ribeiro, R., Quaresma, P., Adami, A., Branco, A. (eds.) PROPOR 2016. LNCS (LNAI), vol. 9727, pp. 12–24. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-41552-9_2
Hartmann, N., Fonseca, E., Shulby, C., Treviso, M., Rodrigues, J., Aluisio, S.: Portuguese word embeddings: evaluating on word analogies and natural language tasks. arXiv preprint arXiv:1708.06025 (2017)
Hartmann, N.S.: ASSIN shared task - solo queue group: mix of a traditional and an emerging approaches. In: Avaliação de Similaridade Semântica e Inferência Textual (ASSIN), Propor Workshop (2016)
Horn, C., Manduca, C., Kauchak, D.: Learning a lexical simplifier using wikipedia. In: Proceedings of the 52nd Annual Meeting of the ACL (ACL 2014), pp. 458–463 (2014)
Joulin, A., Grave, E., Bojanowski, P., Douze, M., Jégou, H., Mikolov, T.: Fasttext.zip: compressing text classification models. arXiv preprint arXiv:1612.03651 (2016)
Kajiwara, T., Yamamoto, K.: Evaluation dataset and system for Japanese lexical simplification. In: ACL (Student Research Workshop), pp. 35–40. The Association for Computer Linguistics (2015)
Kodaira, T., Kajiwara, T., Komachi, M.: Controlled and balanced dataset for Japanese lexical simplification. In: Proceedings of the ACL 2016 Student Research Workshop, pp. 1–7. Association for Computational Linguistics (2016)
Ling, W., Dyer, C., Black, A., Trancoso, I.: Two/too simple adaptations of Word2Vec for syntax problems. In: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics (2015)
Lison, P., Tiedemann, J.: OpenSubtitles 2016: extracting large parallel corpora from movie and TV subtitles. In: Proceedings of the 10th LREC (2016)
Maziero, E.G., Pardo, T.A., Di Felippo, A., Dias-da Silva, B.C.: A base de dados lexical e a interface web do tep 2.0: thesaurus eletrônico para o português do brasil. In: Companion Proceedings of the XIV Brazilian Symposium on Multimedia and the Web, pp. 390–392. ACM (2008)
McCarthy, D., Navigli, R.: Semeval-2007 task 10: English lexical substitution task. In: Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval 2007), pp. 48–53. Association for Computational Linguistics (2007)
Mikolov, T., Yih, W., Zweig, G.: Linguistic regularities in continuous space word representations. In: Proceedings of North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2013), pp. 746–751 (2013)
Muniz, M.C.M.: A construção de recursos lingüístico-computacionais para o português do Brasil: o projeto de Unitex-PB. Master’s thesis, Universidade de São Paulo, Brasil (2004)
Paetzold, G., Specia, L.: SemEval 2016 task 11: complex word identification. In: Proceedings of the 10th International Workshop on Semantic Evaluation, pp. 560–569. Association for Computational Linguistics, San Diego, California, June 2016
Paetzold, G., Specia, L.: Lexical simplification with neural ranking. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, vol. 2, pp. 34–40. ACL (2017)
Paetzold, G.H., Specia, L.: PLUMBErr: an automatic error identification framework for lexical simplification. In: Proceedings of 1st Quality Assessment for Text Simplification (LREC-QATS 2016), pp. 1–9 (2016)
Paetzold, G.H., Specia, L.: Unsupervised lexical simplification for non-native speakers. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI 2016), pp. 3761–3767 (2016)
Paetzold, G.H., Specia, L.: A survey on lexical simplication. J. Artif. Intell. Res. 60, 549–593 (2017)
Paetzold, G.H., Specia, L.: Benchmarking lexical simplification systems. In: Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016), pp. 3074–3080 (2016)
Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), vol. 12, pp. 1532–1543 (2014)
Shardlow, M.: The CW corpus: a new resource for evaluating the identification of complex words. In: Proceedings of the 2nd Workshop on Predicting and Improving Text Readability for Target Reader Populations, pp. 69–77. Association for Computational Linguistics (2013)
Shardlow, M.: Out in the open: finding and categorising errors in the lexical simplification pipeline. In: Proceedings of The International Conference on Language Resources and Evaluation (LREC 2014), pp. 1583–1590 (2014)
Specia, L., Jauhar, S.K., Mihalcea, R.: SemEval-2012 task 1: English lexical simplification. In: Proceedings of the 1st SEM, pp. 347–355. ACL (2012)
Yimam, S.M., et al.: A report on the complex word identification shared task 2018. In: Proceedings of the 13th BEA. Association for Computational Linguistics (2018)
Yimam, S.M., Štajner, S., Riedl, M., Biemann, C.: CWIG3G2 - complex word identification task across three text genres and two user groups. In: Proceedings of the 8th IJCNLP, pp. 401–407. Asian Federation of Natural Language Processing (2017)
Yimam, S.M., Štajner, S., Riedl, M., Biemann, C.: Multilingual and cross-lingual complex word identification. In: Proceedings of RANLP, pp. 813–822 (2017)
Acknowledgments
We thank Larissa Pícoli, Livia Cucatto and Magali Duran for annotating our corpus. This work was supported by FAPESP proc. 2016/00500-1.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Hartmann, N.S., Paetzold, G.H., Aluísio, S.M. (2018). SIMPLEX-PB: A Lexical Simplification Database and Benchmark for Portuguese. In: Villavicencio, A., et al. Computational Processing of the Portuguese Language. PROPOR 2018. Lecture Notes in Computer Science(), vol 11122. Springer, Cham. https://doi.org/10.1007/978-3-319-99722-3_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-99722-3_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99721-6
Online ISBN: 978-3-319-99722-3
eBook Packages: Computer ScienceComputer Science (R0)