research-article

Collecting, analyzing and visualizing tweets using open source tools

Authors:

Andrea L. KavanaughAuthors Info & Claims

dg.o '11: Proceedings of the 12th Annual International Digital Government Research Conference: Digital Government Innovation in Challenging Times

Pages 374 - 375

https://doi.org/10.1145/2037556.2037633

Published: 12 June 2011 Publication History

Get Access

Abstract

This tutorial introduces various open source tools and methods to archive tweets on a user's local machine and convert them into topic clouds for quick content analysis. For more in-depth analysis of the content, basic natural language processing techniques such as n-grams and term extraction are introduced along with PHP/Python scripting.

References

[1]

Harry Wallop. (2011). Japan earthquake: how Twitter and Facebook Helped. The Telegraph. http://www.telegraph.co.uk/technology/twitter/8379101/Japan-earthquake-how-Twitter-and-Facebook-helped.html.

Google Scholar

[2]

Kavanaugh, A. et al. (2011). Microblogging in Crisis Situations: Mass protests in Iran, Tunisia and Egypt. ACM Conference on Human Factors in Computing Systems (CHI'11).

Google Scholar

[3]

YourTwapperKeeper: Archive your own tweets. http://your.twapperkeeper.com/

Google Scholar

[4]

140kit.http://140kit.com

Google Scholar

[5]

The Archivist: Save and analyze tweets. http://archivist.visitmix.com/

Google Scholar

[6]

The Archivist Desktop Version: Save and analyze tweets. http://visitmix.com/labs/archivist-desktop/

Google Scholar

[7]

Wordle: word cloud. http://www.wordle.net/

Google Scholar

[8]

Wordcram: a library for generating word clouds from text, in the Processing environment. https://code.google.com/p/wordcram/

Google Scholar

[9]

Processing programming language and environment. http://processing.org

Google Scholar

[10]

The Translated Labs: Terminology Extraction. http://labs.translated.net/terminology-extraction/

Google Scholar

[11]

Yahoo! TermExtraction API. http://developer.yahoo.com/search/content/V1/termExtraction.html

Google Scholar

[12]

Natural Language Toolkit (NLTK). http://www.nltk.org/

Google Scholar

Cited By

View all

Cuzzocrea A(2017)Multidimensional mining of big social data for supporting advanced big data analytics2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)10.23919/MIPRO.2017.7973630(1337-1342)Online publication date: May-2017
https://doi.org/10.23919/MIPRO.2017.7973630
Bordogna GFrigerio LCuzzocrea APsaila G(2016)Clustering Geo-tagged Tweets for Advanced Big Data Analytics2016 IEEE International Congress on Big Data (BigData Congress)10.1109/BigDataCongress.2016.78(42-51)Online publication date: Jun-2016
https://doi.org/10.1109/BigDataCongress.2016.78
Tayal DYadav SGupta KRajput BKumari K(2014)Polarity detection of sarcastic political tweets2014 International Conference on Computing for Sustainable Global Development (INDIACom)10.1109/IndiaCom.2014.6828037(625-628)Online publication date: Mar-2014
https://doi.org/10.1109/IndiaCom.2014.6828037

Index Terms

Collecting, analyzing and visualizing tweets using open source tools
1. Applied computing
  1. Arts and humanities
    1. Language translation
  2. Document management and text processing
2. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing

Recommendations

Analysis of Tweets Related to Cyberbullying: Exploring Information Diffusion and Advice Available for Cyberbullying Victims

The use of Twitter, especially by teenagers and young people, has raised the issue of cyberbullying. There is a lack of research into what types of advice and support are available in tweets for cyberbullying victims, and into the features influencing ...
Sentence-Level Sarcasm Detection in English and Filipino Tweets
ICIBE '18: Proceedings of the 4th International Conference on Industrial and Business Engineering

Sarcasm is a special form of sentiment which defines as "a nuanced form of language in which individuals say the opposite of what is implied". In this study, the researchers collected 6,000 Tagalog tweets and 6,000 English tweets from the microblogging ...
Tweets of the nation: tool for visualizing and analyzing global tweets
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

In this work, we developed a visualization tool that allows the user to observe the popular tweet hashtags of any selected country around the globe, and on the other hand, the user can also search for any particular tweet hashtag to observe its ...

Comments

Information & Contributors

Information

Published In

dg.o '11: Proceedings of the 12th Annual International Digital Government Research Conference: Digital Government Innovation in Challenging Times

June 2011

398 pages

ISBN:9781450307628

DOI:10.1145/2037556

Conference Chairs:
John Bertot
University of Maryland
,
Karine Nahon
University of Washington
,
Program Chairs:
Soon Ae Chun
City University of New York
,
Luis Luna-Reyes
Universidad de las Americas, Puebla
,
Vijay Atluri
Rutgers University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Division of Information and Intelligent Systems

Conference

dg.o '11

Sponsor:

University of Arizona
San Diego Super Computing Ctr
Emerald
University of Maryland
IOS Press

dg.o '11: The 12th Annual International Conference of Digital Government Research

June 12 - 15, 2011

Maryland, College Park, USA

Acceptance Rates

Overall Acceptance Rate 150 of 271 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
343
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Cuzzocrea A(2017)Multidimensional mining of big social data for supporting advanced big data analytics2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)10.23919/MIPRO.2017.7973630(1337-1342)Online publication date: May-2017
https://doi.org/10.23919/MIPRO.2017.7973630
Bordogna GFrigerio LCuzzocrea APsaila G(2016)Clustering Geo-tagged Tweets for Advanced Big Data Analytics2016 IEEE International Congress on Big Data (BigData Congress)10.1109/BigDataCongress.2016.78(42-51)Online publication date: Jun-2016
https://doi.org/10.1109/BigDataCongress.2016.78
Tayal DYadav SGupta KRajput BKumari K(2014)Polarity detection of sarcastic political tweets2014 International Conference on Computing for Sustainable Global Development (INDIACom)10.1109/IndiaCom.2014.6828037(625-628)Online publication date: Mar-2014
https://doi.org/10.1109/IndiaCom.2014.6828037

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Analysis of Tweets Related to Cyberbullying: Exploring Information Diffusion and Advice Available for Cyberbullying Victims

Sentence-Level Sarcasm Detection in English and Filipino Tweets

Tweets of the nation: tool for visualizing and analyzing global tweets

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations