Improving Social Media Geolocation for Disaster Response by Using Text From Images and ChatGPT
Authors: 
Hafiz Budi Firmansyah, Valerio Lorini, Mehmet Oguz Mulayim, Jorge Gomes, 
Jose Luis Fernandez-MarquezAuthors Info & Claims
Hafiz Budi Firmansyah, Valerio Lorini, Mehmet Oguz Mulayim, Jorge Gomes, Jose Luis Fernandez-MarquezAuthors Info & ClaimsPages 67 - 72
Abstract
Social media can serve as a valuable source of timely and valuable information about the impacts on people and infrastructure during a disaster. However, due to the lack of geographical data in most social media posts, this information is often underutilized by first responders. This paper proposes and analyses an approach that combines text from social media posts with textual information extracted from images to improve the geolocation of social media data during a given disaster. The implementation incorporates ChatGPT in location prediction. We use real-world dataset from Twitter that represent four different events, including floods and earthquake. The experimental results demonstrate that our proposal improves the location prediction’s quantity and precision. We expect that our findings help policymakers consider the application of the proposed methodology in disaster response.
References
[1]
Firoj Alam, Muhammad Imran, and Ferda Ofli. 2017. Image4Act: Online Social Media Image Processing for Disaster Response. In Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2017 (Sydney, Australia) (ASONAM ’17). Association for Computing Machinery, New York, NY, USA, 601–604. https://doi.org/10.1145/3110025.3110164
[2]
Firoj Alam, Ferda Ofli, and Muhammad Imran. 2018. CrisisMMD: Multimodal Twitter Datasets from Natural Disasters. Proceedings of the 12th International AAAI Conference on Web and Social Media (ICWSM) (2018).
[3]
Jaime Alonso-Lorenzo, Enrique Costa-Montenegro, and Milagros Fernández-Gavilanes. 2016. Language independent big-data system for the prediction of user location on Twitter. In 2016 IEEE International Conference on Big Data (Big Data). 2437–2446. https://doi.org/10.1109/BigData.2016.7840880
[4]
Amna Asif, Shaheen Khatoon, Md Maruf Hasan, Majed A. Alshamari, Sherif Abdou, Khaled Mostafa Elsayed, and Mohsen Rashwan. 2021. Automatic analysis of social media images to identify disaster type and infer appropriate emergency response. Journal of Big Data 8, 1 (Jun 2021). https://doi.org/10.1186/s40537-021-00471-5
[5]
Carlo Bono, Barbara Pernici, Mehmet Oguz Mulayim, Jose Luis Fernandez-Marquez, Amudha Ravi Shankar, and Edoardo Nemni. 2022. TriggerCit: Early Flood Alerting using Twitter and Geolocation - a comparison with alternative sources. In 19th ISCRAM Conference.
[6]
Chao Fan, Cheng Zhang, Alex Yahja, and Ali Mostafavi. 2021. Disaster City Digital Twin: A vision for integrating artificial and human intelligence for disaster management. International Journal of Information Management 56 (2021), 102049. https://doi.org/10.1016/j.ijinfomgt.2019.102049
[7]
Hafiz Budi Firmansyah, Carlo Bono, Jose Luis Fernandez-Marquez, Jesus Cerquides, and Valerio Lorini. 2023. Improving Disaster Response by Combining Automated Text Information Extraction from Images and Text on Social Media. In Frontiers in Artificial Intelligence and Applications. 320–329. https://doi.org/10.3233/FAIA230701
[8]
Hafiz Budi Firmansyah, Jose Luis Fernandez-Marquez, Jesus Cerquides, Carlo Bono, Valerio Lorini, and Barbara Pernici. 2023. Enhancing Disaster Response with Automated Text Information Extraction from Social Media Images. In IEEE Big Data Service. https://doi.org/10.1109/BigDataService58306.2023.00017
[9]
Hafiz Budi Firmansyah, Jose Luis Fernandez-Marquez, Jesus Cerquides, and Giovanna Di Marzo Serugendo. 2023. Single or ensemble model ? A study on social media images classification in disaster response. In Proceedings of the 10th Multidisciplinary International Social Networks Conference (Phuket,Thailand) (MISNC ’23). Association for Computing Machinery, New York, NY, USA, 48–54. https://doi.org/10.1145/3624875.3624884
[10]
Chiara Francalanci, Paolo Guglielmino, Matteo Montalcini, Gabriele Scalia, and Barbara Pernici. 2017. IMEXT: A method and system to extract geolocated images from tweets — analysis of a case study. 2017 11th International Conference on Research Challenges in Information Science (RCIS) (2017). https://doi.org/10.1109/rcis.2017.7956563
[11]
Zixuan Liu and Xianwen Wu. 2023. Structural analysis of the evolution mechanism of online public opinion and its development stages based on machine learning and social network analysis. International Journal of Computational Intelligence Systems 16, 1 (Jun 2023). https://doi.org/10.1007/s44196-023-00277-8
[12]
Valerio Lorini, Emanuele Panizio, and Castillo Carlos. 2022. SMDRM: A Platform to Analyze Social Media for Disaster Risk Management in Near Real Time. In Workshop Proceedings of the 16th International AAAI Conference on Web and Social Media ICWSM. https://doi.org/10.36190/2022.1
[13]
Valerio Lorini, Paola Rufolo, and Carlos Castillo. 2022. Venice Was Flooding... One Tweet at a Time. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 382 (nov 2022), 16 pages. https://doi.org/10.1145/3555107
[14]
Dat T. Nguyen, Ferda Ofli, Muhammad Imran, and Prasenjit Mitra. 2017. Damage Assessment from Social Media Imagery Data During Disasters. In Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2017 (Sydney, Australia) (ASONAM ’17). Association for Computing Machinery, New York, NY, USA, 569–576. https://doi.org/10.1145/3110025.3110109
[15]
Amudha Ravi Shankar, Jose Luis Fernandez-Marquez, Barbara Pernici, Gabriele Scalia, Rossy Mondardini, and Giovanna Di Marzo Serugendo. 2019. Crowd4EMS: A crowdsourcing platform for gathering and geolocating social media content in disaster response. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII-3/W8 (2019), 331–340. https://doi.org/10.5194/isprs-archives-xlii-3-w8-331-2019
[16]
Desheng Wu and Yiwen Cui. 2018. Disaster early warning and damage assessment analysis using social media data and geo-location information. Decision Support Systems 111 (2018), 48–59. https://doi.org/10.1016/j.dss.2018.04.005
[17]
Tan Yigitcanlar, Massimo Regona, Nayomi Kankanamge, Rashid Mehmood, Justin D’Costa, Samuel Lindsay, Scott Nelson, and Adiam Brhane. 2022. Detecting Natural Hazard-Related Disaster Impacts with Social Media Analytics: The Case of Australian States and Territories. Sustainability 14, 2 (2022). https://www.mdpi.com/2071-1050/14/2/810
[18]
Chris Cundy Kristy Choi Ni Lao Wei Liu Gaurish Lakhanpal Ryan Zhenqi Zhou Yingjie Hu, Gengchen Mai and Kenneth Joseph. 2023. Geo-knowledge-guided GPT models improve the extraction of location descriptions from disaster-related social media messages. International Journal of Geographical Information Science 37, 11 (2023), 2289–2318. https://doi.org/10.1080/13658816.2023.2266495
[19]
Lei Zou, Danqing Liao, Nina S.N. Lam, Michelle A. Meyer, Nasir G. Gharaibeh, Heng Cai, Bing Zhou, and Dongying Li. 2023. Social media for emergency rescue: An analysis of rescue requests on Twitter during Hurricane Harvey. International Journal of Disaster Risk Reduction 85 (2023), 103513. https://doi.org/10.1016/j.ijdrr.2022.103513
Index Terms
- Improving Social Media Geolocation for Disaster Response by Using Text From Images and ChatGPT
Index terms have been assigned to the content through auto-classification.
Recommendations
Accelerating Crisis Response: Automated Image Classification for Geolocating Social Media Content
ASONAM '23: Proceedings of the 2023 IEEE/ACM International Conference on Advances in Social Networks Analysis and MiningIn the immediate aftermath of natural or man-made disasters, social media plays an essential role in assessing the impact of the event. The images from social media demonstrated the potential to accelerate the response to a crisis. However, finding the ...
Digitally enabled disaster response: the emergence of social media as boundary objects in a flooding disaster
In recent times, social media has been increasingly playing a critical role in response actions following natural catastrophes. From facilitating the recruitment of volunteers during an earthquake to supporting emotional recovery after a hurricane, ...
Social network analysis
Explores connections and patterns created by the aggregated interactions in Facebook pages during disaster responses.Analyzes social media data from the Facebook page of city of Baton Rouge during the 2016 Louisiana flood (Aug 12Dec 1, 2016).Analyzes ...
Comments
Information & Contributors
Information
Published In
August 2024
203 pages
ISBN:9798400717550
DOI:10.1145/3675669
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 September 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
MISNC 2024
MISNC 2024: 2024 The 11th Multidisciplinary International Social Networks Conference
August 21 - 23, 2024
Bali, Indonesia
Acceptance Rates
Overall Acceptance Rate 57 of 97 submissions, 59%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 239Total Downloads
- Downloads (Last 12 months)239
- Downloads (Last 6 weeks)62
Reflects downloads up to 26 Jan 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in