2018
pdf
bib
abs
Normalization of Transliterated Words in Code-Mixed Data Using Seq2Seq Model & Levenshtein Distance
Soumil Mandal
|
Karthick Nanmaran
Proceedings of the 2018 EMNLP Workshop W-NUT: The 4th Workshop on Noisy User-generated Text
Building tools for code-mixed data is rapidly gaining popularity in the NLP research community as such data is exponentially rising on social media. Working with code-mixed data contains several challenges, especially due to grammatical inconsistencies and spelling variations in addition to all the previous known challenges for social media scenarios. In this article, we present a novel architecture focusing on normalizing phonetic typing variations, which is commonly seen in code-mixed data. One of the main features of our architecture is that in addition to normalizing, it can also be utilized for back-transliteration and word identification in some cases. Our model achieved an accuracy of 90.27% on the test data.
pdf
bib
abs
Language Identification in Code-Mixed Data using Multichannel Neural Networks and Context Capture
Soumil Mandal
|
Anil Kumar Singh
Proceedings of the 2018 EMNLP Workshop W-NUT: The 4th Workshop on Noisy User-generated Text
An accurate language identification tool is an absolute necessity for building complex NLP systems to be used on code-mixed data. Lot of work has been recently done on the same, but there’s still room for improvement. Inspired from the recent advancements in neural network architectures for computer vision tasks, we have implemented multichannel neural networks combining CNN and LSTM for word level language identification of code-mixed data. Combining this with a Bi-LSTM-CRF context capture module, accuracies of 93.28% and 93.32% is achieved on our two testing sets.
pdf
bib
SMT vs NMT: A Comparison over Hindi and Bengali Simple Sentences
Sainik Kumar Mahata
|
Soumil Mandal
|
Dipankar Das
|
Sivaji Bandyopadhyay
Proceedings of the 15th International Conference on Natural Language Processing
2014
pdf
bib
JU_CSE: A Conditional Random Field (CRF) Based Approach to Aspect Based Sentiment Analysis
Braja Gopal Patra
|
Soumik Mandal
|
Dipankar Das
|
Sivaji Bandyopadhyay
Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014)