| Title |
Using a Probabilistic Model of Context to Detect Word Obfuscation |
| Authors |
Sanaz Jabbari, Ben Allison and Louise Guthrie |
| Abstract |
This paper proposes a distributional model of word use and word meaning which is derived purely from a body of text, and then applies this model to determine whether certain words are used in or out of context. We suggest that we can view the contexts of words as multinomially distributed random variables. We illustrate how using this basic idea, we can formulate the problem of detecting whether or not a word is used in context as a likelihood ratio test. We also define a measure of semantic relatedness between a word and its context using the same model. We assume that words that typically appear together are related, and thus have similar probability distributions and that words used in an unusual way will have probability distributions which are dissimilar from those of their surrounding context. The relatedness of a word to its context is based on Kullback-Leibler divergence between probability distributions assigned to the constituent words in the given sentence. We employed our methods on a defense-oriented application where certain words are substituted with other words in an intercepted communication. |
| Language |
|
| Topics |
Statistical methods, Language modelling, Semantics |
Full paper |
Using a Probabilistic Model of Context to Detect Word Obfuscation |
Slides |
- |
| Bibtex |
@InProceedings{JABBARI08.560,
author = {Sanaz Jabbari, Ben Allison and Louise Guthrie},
title = {Using a Probabilistic Model of Context to Detect Word Obfuscation},
booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)},
year = {2008},
month = {may},
date = {28-30},
address = {Marrakech, Morocco},
editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias},
publisher = {European Language Resources Association (ELRA)},
isbn = {2-9517408-4-0},
note = {http://www.lrec-conf.org/proceedings/lrec2008/},
language = {english}
} |
Summary of the paper