research-article

Empirical evaluation of authorship obfuscation using JGAAP

Authors:

Darren VescoviAuthors Info & Claims

AISec '10: Proceedings of the 3rd ACM workshop on Artificial intelligence and security

Pages 14 - 18

https://doi.org/10.1145/1866423.1866427

Published: 08 October 2010 Publication History

Abstract

Authorship attribution is an important emerging security tool. However, just as criminals may wear gloves to hide their fingerprints, so authors may choose to mask their style to escape detection. Most authorship studies have focused on cooperative and/or unaware authors who do not take such precautions. Using a newly published corpus (the Brennan-Greenstadt Obfuscation corpus), we use the JGAAP system (www.jgaap.com) to test different methods of authorship attribution against essays written in deliberate attempt to mask style. We confirm that this is an issue.

References

[1]

}}J. N. G. Binongo. Who wrote the 15th book of Oz? an application of multivariate analysis to authorship attribution. Chance, 16(2):9--17, 2003.

[2]

}}M. Brennan and R. Greenstadt. Practical attacks against authorship recognition techniques. In Proceedings of the Twenty-First Conference on Innovative Applications of Artificial Intelligence (IAAI), Pasadena, CA, 2009.

[3]

}}C. E. Chaski. Empirical evaluations of language-based author identification. Forensic Linguistics, 8(1):1--65, 2001.

[4]

}}C. E. Chaski. Who's at the keyboard: Authorship attribution in digital evidence invesigations. International Journal of Digital Evidence, 4(1):n/a, 2005. Electronic-only journal: http://www.ijde.org, accessed 5.31.2007.

[5]

}}G. Crane. What do you do with a million books? D-Lib Magazine, 12(3), 2006.

[6]

}}O. De Vel, A. Anderson, M. Corney, and G. Mohay. Mining e-mail content for author identification forensics. SIGMOD Record, 30(4):55--64, 2001.

Digital Library

[7]

}}M. Eder. Does size matter? authorship attribution, small samples, big problems. In Proc. Digital Humanities 2010, London, UK, July 2010.

[8]

}}R. S. Forsyth. Towards a text benchmark suite. In Proc. 1997 Joint International Conference of the Association for Computers and the Humanities and the Association for Literary and Linguistic Computing (ACH/ALLC 1997), Kingston, ON, 1997.

[9]

}}D. I. Holmes. Authorship attribution. Computers and the Humanities, 28(2):87--106. 1994.

[10]

}}D. I. Holmes and R. S. Forsyth. The Federalist revisited : New directions in authorship attribution. Literary and Linguistic Computing, 10(2):111--27, 1995.

[11]

}}D. L. Hoover. Delta prime? Literary and Linguistic Computing, 19(4)477--495, 2004.

[12]

}}D. L. Hoover. Testing Burrows's Delta. Literary and Linguistic Computing, 19(4):453--475, 2004.

[13]

}}P. Juola. What can we do with small corpora? Document categorization via cross-entropy. In Proceedings of an Interdisciplinary Workshop on Similarity and Categorization, Edinburgh, UK, 1997. Department of Artificial Intelligence, University of Edinburgh.

[14]

}}P. Juola. Ad-hoc authorship attribution competition. In Proc. 2004 Joint International Conference of the Association for Literary and Linguistic Computing and the Association for Computers and the Humanities (ALLC/ACH 2004), Göteborg, Sweden, June 2004.

[15]

}}P. Juola. Authorship attribution. Foundations and Trends in Information Retrieval, 1(3), 2006.

Digital Library

[16]

}}P. Juola. Authorship attribution for electronic documents. In M. Olivier and S. Shenoi, editors, Advances in Digital Forensics II, volume 222 of International Federal for Information Processing, pages 119--130. Springer, Boston, 2006.

[17]

}}P. Juola. 20,000 ways not to do authorship attribution - and a few that work. In Proceedings of 2009 Biennial Conference of the International Association of Forensic Linguists (IAFL-09), Amsterdam, 2009.

[18]

}}P. Juola. Cross-linguistic transferrence of authorship attribution, or why english-only prototypes are acceptable. In Proceedings of Digital Humanities 2009, College Park, MD, 2009.

[19]

}}P. Juola and H. Baayen. A controlled-corpus experiment in authorship attribution by cross-entropy. Literary and Linguistic Computing, 20:59--67, 2005.

[20]

}}P. Juola, J. Noecker, Jr., M. Ryan, and S. Speer. Jgaap 4.0 - a revised authorship attribution tool. In Proceedings of Digital Humanities 2009, College Park, MD, 2009.

[21]

}}P. Juola, J. Sofko, and P. Brennan. A prototype for authorship attribution studies. Literary and Linguistic Computing, 21(2):169--178, 2006. Advance Access published on April 12, 2006;

[22]

}}C. Martindale and D. McKenzie. On the utility of content analysis in authorship attribution: The Federalist Papers. Computers and the Humanities, 29:259--70, 1995.

[23]

}}T. C. Mendenhall. The characteristic curves of composition. Science, IX:237--49, 1887.

[24]

}}F. Mosteller and D. L. Wallace. Inference and Disputed Authorship : The Federalist. Addison-Wesley, Reading, MA, 1964.

[25]

}}J. Nerbonne. The data deluge. In Proc. 2004 Joint International Conference of the Association for Literary and Linguistic Computing and the Association for Computers and the Humanities (ALLC/ACH 2004), Göteborg, Sweden, June 2004.

[26]

}}J. Oberlander and S. Nowson. Whose thumb is it anyway? classifying author personality from weblog text. In Proceedings of the 44th Annual Meeting of the Association for Computational Linguistics and 21st International Conference on Computational Linguistics, pages 627--634, Sydney, Australia, 2006.

Digital Library

[27]

}}M. Rockeach, R. Homant, and L. Penner. A value analysis of the disputed Federalist Papers. Journal of Personality and Social Psychology, 16:245--50, 1970.

[28]

}}J. Rudman. The state of authorship attribution studies: Some problems and solutions. Computers and the Humanities, 31:351--365, 1998.

[29]

}}J. Rudman. The non-traditional case for the authorship of the twelve disputed Federalist Papers : A monument built on sand. In Proceedings of ACH/ALLC 2005, Victoria, BC, 2005. Association for Computing and the Humanities.

[30]

}}S. Stein and S. Argamon. A mathematical explanation of Burrows' Delta. In Proc. Digital Humanities 2006, Paris, France, July 2006.

[31]

}}F. J. Tweedie, S. Singh, and D. I. Holmes. Neural network applications in stylometry : The Federalist Papers. Computers and the Humanities, 30(1):1--10, 1996.

Cited By

Schneider MMankad S(2021)A Two-Stage Authorship Attribution Method Using Text and Structured Data for De-Anonymizing User-Generated ContentCustomer Needs and Solutions10.1007/s40547-021-00116-xOnline publication date: 6-Aug-2021
https://doi.org/10.1007/s40547-021-00116-x
Gröndahl TAsokan N(2019)Text Analysis in Adversarial SettingsACM Computing Surveys10.1145/331033152:3(1-36)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3310331
Juola PMikros GVinsick S(2018)A comparative assessment of the difficulty of authorship attribution in Greek and in EnglishJournal of the Association for Information Science and Technology10.1002/asi.2407370:1(61-70)Online publication date: 12-Dec-2018
https://dl.acm.org/doi/10.1002/asi.24073
Show More Cited By

Index Terms

Empirical evaluation of authorship obfuscation using JGAAP

Recommendations

Adversarial Authorship Attribution in Open-Source Projects
CODASPY '19: Proceedings of the Ninth ACM Conference on Data and Application Security and Privacy

Open-source software is open to anyone by design, whether it is a community of developers, hackers or malicious users. Authors of open-source software typically hide their identity through nicknames and avatars. However, they have no protection against ...
Survey of Authorship Identification Tasks on Arabic Texts
Authorship identification is the process of extracting and analysing the writing styles of authors to identify the authorship. From the writing style, the author and his/her different characteristics can be recognised, which is very useful in digital ...
Authorship Attribution of Russian Forum Posts with Different Types of N-gram Features
NLPIR '19: Proceedings of the 2019 3rd International Conference on Natural Language Processing and Information Retrieval

Authorship attribution is an important field in online security. Recently there have been numerous successful works in authorship attribution in various European languages. Character n-grams are reported to be the best choice in authorship attribution, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AISec '10: Proceedings of the 3rd ACM workshop on Artificial intelligence and security

October 2010

78 pages

ISBN:9781450300889

DOI:10.1145/1866423

General Chair:
Rachel Greenstadt
Drexel University

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSAC: ACM Special Interest Group on Security, Audit, and Control

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CCS '10

Sponsor:

SIGSAC

CCS '10: 17th ACM Conference on Computer and Communications Security 2010

October 8, 2010

Illinois, Chicago, USA

Acceptance Rates

AISec '10 Paper Acceptance Rate 10 of 15 submissions, 67%;

Overall Acceptance Rate 94 of 231 submissions, 41%

Upcoming Conference

CCS '25

Sponsor:
sigsac

ACM SIGSAC Conference on Computer and Communications Security

October 13 - 17, 2025

Taipei , Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
381
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Schneider MMankad S(2021)A Two-Stage Authorship Attribution Method Using Text and Structured Data for De-Anonymizing User-Generated ContentCustomer Needs and Solutions10.1007/s40547-021-00116-xOnline publication date: 6-Aug-2021
https://doi.org/10.1007/s40547-021-00116-x
Gröndahl TAsokan N(2019)Text Analysis in Adversarial SettingsACM Computing Surveys10.1145/331033152:3(1-36)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3310331
Juola PMikros GVinsick S(2018)A comparative assessment of the difficulty of authorship attribution in Greek and in EnglishJournal of the Association for Information Science and Technology10.1002/asi.2407370:1(61-70)Online publication date: 12-Dec-2018
https://dl.acm.org/doi/10.1002/asi.24073
Juola PMilička JZemánek P(2017)Authorship and Time Attribution of Arabic Texts Using JGAAPIntelligent Natural Language Processing: Trends and Applications10.1007/978-3-319-67056-0_16(325-349)Online publication date: 18-Nov-2017
https://doi.org/10.1007/978-3-319-67056-0_16
El-Fiqi HPetraki EAbbass H(2016)Pairwise Comparative Classification for Translator Stylometric AnalysisACM Transactions on Asian and Low-Resource Language Information Processing10.1145/289899716:1(1-26)Online publication date: 27-Jun-2016
https://dl.acm.org/doi/10.1145/2898997
Ding SFung BDebbabi M(2015)A Visualizable Evidence-Driven Approach for Authorship AttributionACM Transactions on Information and System Security10.1145/269991017:3(1-30)Online publication date: 9-Mar-2015
https://dl.acm.org/doi/10.1145/2699910
Juola PNoecker JStolerman ARyan MBrennan PGreenstadt R(2013)Towards Active Linguistic AuthenticationAdvances in Digital Forensics IX10.1007/978-3-642-41148-9_25(385-398)Online publication date: 2013
https://doi.org/10.1007/978-3-642-41148-9_25
Juola P(2012)Detecting stylistic deceptionProceedings of the Workshop on Computational Approaches to Deception Detection10.5555/2388616.2388630(91-96)Online publication date: 23-Apr-2012
https://dl.acm.org/doi/10.5555/2388616.2388630
Brennan MAfroz SGreenstadt R(2012)Adversarial stylometryACM Transactions on Information and System Security10.1145/2382448.238245015:3(1-22)Online publication date: 30-Nov-2012
https://dl.acm.org/doi/10.1145/2382448.2382450
Afroz SBrennan MGreenstadt R(2012)Detecting Hoaxes, Frauds, and Deception in Writing Style OnlineProceedings of the 2012 IEEE Symposium on Security and Privacy10.1109/SP.2012.34(461-475)Online publication date: 20-May-2012
https://dl.acm.org/doi/10.1109/SP.2012.34
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents