article

Decision support for determining veracity via linguistic-based cues

Authors:

Christie M. Fuller,

David P. Biros,

Rick L. WilsonAuthors Info & Claims

Decision Support Systems, Volume 46, Issue 3

Pages 695 - 703

https://doi.org/10.1016/j.dss.2008.11.001

Published: 01 February 2009 Publication History

Abstract

Deception detection is an essential skill in careers such as law enforcement and must be accomplished accurately. However, humans are not very competent at determining veracity without aid. This study examined automated text-based deception detection which attempts to overcome the shortcomings of previous credibility assessment methods. A real-world, high-stakes sample of statements was collected and analyzed. Several different sets of linguistic-based cues were used as inputs for classification models. Overall accuracy rates of up to 74% were achieved, suggesting that automated deception detection systems can be an invaluable tool for those who must assess the credibility of text.

References

[1]

Adkins, M., Twitchell, D.P., Burgoon, J.K. and Nunamaker, J.F., Advances in automated deception detection in text-based computer-mediated communication. 2004. Enabling Technologies for Simulation Science VIII, The International Society for Optical Engineering, Orlando, Florida.

[2]

Berry, M.J.A. and Linoff, G.S., Data Mining Techniques. 2004. 2 ed. Wiley Publishing, Indianapolis, Indiana.

[3]

Bond, C.F. and DePaulo, B.M., Accuracy of deception judgments. Personality and Social Psychology Reports. v10 i3.

[4]

Bond, G.D. and Lee, A.Y., Language of lies in prison: linguistic classification of prisoners' truthful and deceptive natural language. Applied Cognitive Psychology. v19 i3.

[5]

Brown, D.E. and Hagen, S., Data association methods with applications to law enforcement. Decision Support Systems. v34 i4.

Digital Library

[6]

Buller, D.B. and Burgoon, J.K., Interpersonal deception theory. Communication Theory. v6 i3.

[7]

Buller, D.B., Burgoon, J.K., Buslig, A. and Roiger, J., Testing interpersonal deception theory: the language of interpersonal deception. Communication Theory. v6 i3.

[8]

Burgoon, J.K., Qin, T.T. and Twitchell, D.P., The dynamic nature of deceptive verbal communication. Journal of Language & Social Psychology. v25 i1.

[9]

Cao, J., Crews, J.M., Lin, M., Burgoon, J. and Nunamaker, J., Designing agent99 trainer: a learner-centered, web-based training system for deception detection. In: Lecture Notes in Computer Science: Proceedings of Intelligence and Security Informatics: ISI 2003, Springer.

Digital Library

[10]

Cunningham, H., Gate, a general architecture for text engineering. Computers and the Humanities. v36 i2.

[11]

H. Cunningham, D. Maynard, K. Bontcheva, V. Tablan, C. Ursu, M. Dimitrov, M. Dowman, N. Aswani, I. Roberts, Developing Language Processing Components with Gate Version 3 (a User Guide) Http://Gate.Ac.Uk/Sale/Tao/Index.Html#X1-1710008.4. 2005 February 2, 2006 {cited 2006 February 15}; Available from: http://gate.ac.uk/sale/tao/index.html#x1-1710008.4.

[12]

DePaulo, B.M., Lindsay, J.J., Malone, B.E., Muhlenbruck, L., Charlton, K. and Cooper, H., Cues to Deception. Psychological Bulletin. v129 i1.

[13]

Driscoll, L.N., A validity assessment of written statements from suspects in criminal investigations using the scan technique. Police Studies. v17 i4.

[14]

Ekman, P. and O'Sullivan, M., Who can catch a liar?. American Psychologist. v46 i9.

[15]

Engelbrecht, A.P., Cloete, I. and Zurada, J.M., Determining the significance of input parameters using sensitivity analysis. In: From Natural to Artificial Neural Computation, Springer-Verlag, Berlin.

Digital Library

[16]

Feeley, T.H. and Young, M.J., Humans as lie detectors: some more second thoughts. Communication Quarterly. v46 i2.

[17]

Ford, E.B., Lie detection: historical, neuropsychiatric and legal dimensions. International Journal of Law and Psychiatry. v29 i3.

[18]

Frank, M.G. and Feeley, T.H., To catch a liar: challenges for research in lie detection training. Journal Of Applied Communication Research. v31 i1.

[19]

Fuller, C., Biros, D.P., Twitchell, D., Burgoon, J. and Adkins, M., An analysis of text-based deception detection tools, Twelfth Americas Conference on Information Systems. 2006. Association for Information Systems, Acapulco, Mexico.

[20]

Gamer, M., Rill, H.G., Vossel, G. and Godert, H.W., Psychophysiological and vocal measures in the detection of guilty knowledge. International Journal Of Psychophysiology. v60 i1.

[21]

George, J.F. and Keane, B.T., Deception detection by third party observers, deception detection symposium. In: 39th Annual Hawaii International Conference on System Sciences,

[22]

Hair, J.F., Anderson, R.E., Tatham, R.L. and Black, W.C., Multivariate Data Analysis. 1998. 5 ed. Prentice-Hall, Inc., Upper Saddle River, New Jersey.

Digital Library

[23]

Hancock, J., Curry, L., Goorha, S. and Woodworth, M., Lies in conversation: an examination of deception using automated linguistic analysis, Annual Conference of the Cognitive Science Society. 2004. Taylor and Francis Group: Psychology Press, Mahwah, NJ.

[24]

Hancock, J.T., Curry, L., Goorha, S. and Woodworth, M., Automated linguistic analysis of deceptive and truthful synchronous computer-mediated communication. In: Proceedings of the 38th Annual Hawaii International Conference on System Sciences,

Digital Library

[25]

Hancock, J., Thom-Santelli, J. and Ritchie, T., Deception and design: the impact of communication technology on lying behavior. In: Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, Vienna, Austria.

Digital Library

[26]

Hollien, H. and Harnsberger, J.D., Voice Stress Analyzer Instrumentation Evaluation. 2006. University of Florida.

[27]

Honts, C.R. and Raskin, D.C., A field study of the validity of the directed lie control question. Journal Of Police Science And Administration. v16 i1.

[28]

Horvath, F., Jayne, B. and Buckley, J., Differentiation of truthful and deceptive criminal suspects in behavior analysis interviews. Journal Of Forensic Sciences. v39 i3.

[29]

Johnson, M.K. and Raye, C.L., Reality monitoring. Psychological Review. v88 i1.

[30]

Kaza, S., Wang, Y. and Chen, H., Enhancing border security: mutual information analysis to identify suspect vehicles. Decision Support Systems. v43 i1.

Digital Library

[31]

Kendall, K.E. and Schuldt, B.A., Decentralizing decision support systems a field experiment with drug and criminal investigators. Decision Support Systems. v9 i3.

Digital Library

[32]

Kiang, M.Y., A comparative assessment of classification methods. Decision Support Systems. v35 i4.

Digital Library

[33]

G. Kohnken, Speech and Deception of Eyewitnesses: An Information Processing Approach, in: F.L. Denmark, in: Social/Ecological Psychology and the Psychology of Women. (Elsevier Science Publishers, North-Holland, 1985).

[34]

Lesce, T., Scan: deception detection by scientific content analysis. Law and Order. v38 i8.

[35]

McCornack, S.A., Information manipulation theory. Communication Monographs. v59 i1.

[36]

Newman, M.L., Pennebaker, J.W., Berry, D.S. and Richards, J.M., Lying words: predicting deception from linguistic styles. Personality and Social Psychology Bulletin. v29 i5.

[37]

National Research Council, The Polygraph and Lie Detection. 2003. The National Academies Press, Washington, DC.

[38]

Porter, S. and Yuille, J.C., The language of deceit: an investigation of the verbal clues to deception in the interrogation context. Law And Human Behavior. v20 i4.

[39]

Raskin, D.C., Methodolgical issues in estimating polygraph accuracy in field applications. Canadian Journal of behavioral Science. v19 i4.

[40]

Rice, B., The new truth machines. Psychology Today. v12 i1.

[41]

Suzuki, A., Ohnishi, K., Matsuno, K. and Arasuna, M., Amplitude rank score analysis of GSR in the detection of deception: detection rates under various examination conditions. Polygraph. v8.

[42]

Twitchell, D.P., Biros, D.P., Adkins, M., Forsgren, N., Burgoon, J.K. and Nunamaker Jr., J.F., Automated determination of the veracity of interview statements from people of interest to an operational security force. In: Proceedings of the 39th Annual Hawaii International Conference on System Sciences,

Digital Library

[43]

Twitchell, D., Biros, D.P., Forsgren, N., Burgoon, J. and Nunamaker Jr., J.F., Assessing the veracity of criminal and detainee statements: a study of real-world data. In: Proceedings of the 2005 International Conference on Intelligence Analysis,

[44]

Twitchell, D., Jensen, M.L., Burgoon, J.K. and Nunamaker Jr., J.F., Detecting deception in secondary screening interviews using linguistic analysis. In: Proceedings of the 7th International IEEE Conference on Intelligent Transportation Systems,

[45]

Undeutsch, U. and Yuille, J.C., The development of statement reality analysis. In: Credibility Assessment, Kluwer Academic/Plenum Publishers.

[46]

Vrij, A., Detecting Lies and Deceit: The Psychology of Lying and the Implications for Professional Practice. 2000. John Wiley & Sons, New York.

[47]

Vrij, A., Criteria-based content analysis - a qualitative review of the first 37 studies. Psychology Public Policy And Law. v11 i1.

[48]

Vrij, A. and Mann, S., Telling and detecting lies in a high-stake situation: the case of a convicted murderer. Applied Cognitive Psychology. v15 i2.

[49]

Vrij, A., Mann, S. and Fisher, R., An empirical test of the behaviour analysis interview. Law & Human Behavior. v30 i3.

[50]

Weiss, S.M. and Kulikowski, C.A., Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert Systems. 1991. Morgan Kaufman Publishers, Inc., San Mateo, California.

Digital Library

[51]

Zhou, L., Burgoon, J.K., Nunamaker, J.F. and Twitchell, D.P., Automated linguistics based cues for detecting deception in text-based asynchronous computer-mediated communication: an empirical investigation. Group Decision and Negotiation. v13 i1.

[52]

Zhou, L., Burgoon, J.K., Twitchell, D.P., Qin, T.T. and Nunamaker, J.F., A comparison of classification methods for predicting deception in computer-mediated communication. Journal Of Management Information Systems. v20 i4.

Digital Library

[53]

Zhou, L., Twitchell, D.P., Qin, T.T., Burgoon, J.K. and Nunamaker Jr., J.F., An exploratory study into deception detection in text-based computer-mediated communication. In: Proceedings of the 36th Annual Hawaii International Conference on System Sciences,

Digital Library

[54]

Zhou, L. and Zhang, D.S., Typing or messaging? Modality effect on deception detection in computer-mediated communication. Decision Support Systems. v44.

Digital Library

[55]

Zuckerman, M., DePaulo, B.M. and Rosenthal, R., Verbal and nonverbal communication of deception. In: Advances in Experimental Social Psychology, Academic Press, New York.

[56]

Zuckerman, M. and Driver, R.E., Telling lies: verbal and nonverbal correlates of deception. In: Multichannel Intergration of Nonverbal Behavior, Erlbaum, Hillsdale, NJ.

Cited By

Zhu H(2023)Rumour detection based on deep hybrid structural and sequential representation networksJournal of Information Science10.1177/0165551521105657949:5(1375-1389)Online publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1177/01655515211056579
Twitchell DFuller C(2023)Expressing uncertainty in information systems analytics researchInformation Processing and Management: an International Journal10.1016/j.ipm.2022.10313260:1Online publication date: 20-Jan-2023
https://dl.acm.org/doi/10.1016/j.ipm.2022.103132
Saquete ETomás DMoreda PMartínez-Barco PPalomar M(2022)Fighting post-truth using natural language processingExpert Systems with Applications: An International Journal10.1016/j.eswa.2019.112943141:COnline publication date: 21-Apr-2022
https://dl.acm.org/doi/10.1016/j.eswa.2019.112943
Show More Cited By

Recommendations

Technology Dominance in Complex Decision Making: The Case of Aided Credibility Assessment

Decision aids have long been an important source of help in making structured decisions. However, decision support for more complex problems has been much more difficult to create. Decision aids are now being developed for very complex problems, and ...
Effects of Automated and Participative Decision Support in Computer-Aided Credibility Assessment

Historically, inaccurate credibility assessments have resulted in tremendous costs to businesses and to society. Recent research offers unobtrusive credibility assessment aids as a solution; however, the accuracy of these decision aids is inadequate, ...
An investigation of data and text mining methods for real world deception detection

Uncovering lies (or deception) is of critical importance to many including law enforcement and security personnel. Though these people may try to use many different tactics to discover deception, previous research tells us that this cannot be ...

Comments

Information & Contributors

Information

Published In

cover image Decision Support Systems

Decision Support Systems Volume 46, Issue 3

February, 2009

147 pages

ISSN:0167-9236

Issue’s Table of Contents

Copyright © Elsevier B.V. © 2008.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 February 2009

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhu H(2023)Rumour detection based on deep hybrid structural and sequential representation networksJournal of Information Science10.1177/0165551521105657949:5(1375-1389)Online publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1177/01655515211056579
Twitchell DFuller C(2023)Expressing uncertainty in information systems analytics researchInformation Processing and Management: an International Journal10.1016/j.ipm.2022.10313260:1Online publication date: 20-Jan-2023
https://dl.acm.org/doi/10.1016/j.ipm.2022.103132
Saquete ETomás DMoreda PMartínez-Barco PPalomar M(2022)Fighting post-truth using natural language processingExpert Systems with Applications: An International Journal10.1016/j.eswa.2019.112943141:COnline publication date: 21-Apr-2022
https://dl.acm.org/doi/10.1016/j.eswa.2019.112943
Li GHu JWu YZhang XZhou WLyu H(2022)A Heterogeneous Propagation Graph Model for Rumor Detection Under the Relationship Among Multiple Propagation SubtreesMachine Learning and Knowledge Discovery in Databases10.1007/978-3-031-26390-3_13(207-223)Online publication date: 19-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-26390-3_13
Ye KPiao YZhao KCui X(2021)Graph Enhanced BERT for Stance-Aware Rumor Verification on Social MediaArtificial Neural Networks and Machine Learning – ICANN 202110.1007/978-3-030-86383-8_34(422-435)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1007/978-3-030-86383-8_34
Wu JLiu Y(2020)Deception detection methods incorporating discourse network metrics in synchronous computer-mediated communicationJournal of Information Science10.1177/016555151882317646:1(64-81)Online publication date: 18-Jun-2020
https://dl.acm.org/doi/10.1177/0165551518823176
Zhou XZafarani R(2020)A Survey of Fake NewsACM Computing Surveys10.1145/339504653:5(1-40)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3395046
Sharma KQian FJiang HRuchansky NZhang MLiu Y(2019)Combating Fake NewsACM Transactions on Intelligent Systems and Technology10.1145/330526010:3(1-42)Online publication date: 12-Apr-2019
https://dl.acm.org/doi/10.1145/3305260
Hu QLi QLu YYang YCheng J(2019)Multi-level word features based on CNN for fake news detection in cultural communicationPersonal and Ubiquitous Computing10.1007/s00779-019-01289-y24:2(259-272)Online publication date: 8-Aug-2019
https://dl.acm.org/doi/10.1007/s00779-019-01289-y
Azevedo LChampin PGandon FMédini LLalmas MIpeirotis P(2018)Truth or LieCompanion Proceedings of the The Web Conference 201810.1145/3184558.3186567(807-811)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3184558.3186567
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents