A cross-lingual sentence pair interaction feature capture model based on pseudo-corpus and multilingual embedding

Article type: Research Article

Authors: Liu, Gang^{a; b} | Dong, Yichao^{a; *} | Wang, Kai^a | Yan, Zhizheng^a

Affiliations: [a] College of Computer Science and Technology, Harbin Engineering University, China | [b] State Key Laboratory for Novel Software Technology, Nanjing University, China

Correspondence: [*] Corresponding author. E-mail: [email protected].

Abstract: Recently, the emergence of the digital language division and the availability of cross-lingual benchmarks make researches of cross-lingual texts more popular. However, the performance of existing methods based on mapping relation are not good enough, because sometimes the structures of language spaces are not isomorphic. Besides, polysemy makes the extraction of interaction features hard. For cross-lingual word embedding, a model named Cross-lingual Word Embedding Space Based on Pseudo Corpus (CWE-PC) is proposed to obtain cross-lingual and multilingual word embedding. For cross-lingual sentence pair interaction feature capture, a Cross-language Feature Capture Based on Similarity Matrix (CFC-SM) model is built to extract cross-lingual interaction features. ELMo pretrained model and multiple layer convolution are used to alleviate polysemy and extract interaction features. These models are evaluated on multiple language pairs and results show that they outperform the state-of-the-art cross-lingual word embedding methods.

Keywords: Cross-lingual, pseudo corpus, word embedding space, interaction feature

DOI: 10.3233/AIC-210085

Journal: AI Communications, vol. 35, no. 1, pp. 1-14, 2022