research-article

Probing user opinions in an indirect way: an aspect based sentiment analysis of game reviews

Authors:

Björn Strååt,

Harko Verhagen,

Henrik WarpefeltAuthors Info & Claims

AcademicMindtrek '17: Proceedings of the 21st International Academic Mindtrek Conference

Pages 1 - 7

https://doi.org/10.1145/3131085.3131121

Published: 20 September 2017 Publication History

Abstract

This paper presents a method for gathering and evaluating user attitudes towards previously released video games. A three-part video game franchise was selected, and all user reviews of these games were collected. The most frequently mentioned words of the game were derived from this dataset through word frequency analysis. The words, called "aspects" were then further analyzed through a manual aspect based sentiment analysis. The final analysis showed that the rating of user reviews to a high degree correlate with the sentiment of the aspect in question. This knowledge is valuable for a developer who wishes to learn more about previous games success or failure factors.

References

[1]

P. Stafford, "brain wave:the phds changing games," 18 1 2016. {Online}. Available: http://www.polygon.com/features/2016/1/18/9882430/brain-wave-the-phds-changing-games. {Accessed 29 1 2016}.

[2]

B. Strååt and H. Verhagen, "VOX POPULI - A Case Study of User Comments on Contemporary Video Games in Relation to Video Game Heuristics?," United Kingdoms, 2014.

[3]

Dragon Age:Origins, BioWare, 2009.

[4]

Dragon Age II, BioWare, 2011.

[5]

Dragon Age: Inquisition, BioWare, 2014.

[6]

"Metacritic Matters: How Review Scores Hurt Video Games," 08 08 2015. {Online}. Available: http://kotaku.com/metacritic-matters-how-review-scores-hurt-video-games-472462218. {Accessed 18 04 2016}.

[7]

"Time to kill Metacritic," 15 10 2014. {Online}. Available: http://www.mcvuk.com/news/read/time-to-kill-metacritic/0139824. {Accessed 18 04 2016}.

[8]

D. Johnson, C. Watling, J. Gardner and L. Nacke, "The edge of glory: The relationship between metacritic scores and player experience.," in Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play, 2014.

Digital Library

[9]

A. Greenwood-Ericksen, S. R. Poorman and R. Papp, "On the Validity of Metacritic in Assessing Game Value," Eludamos. Journal for computer Game Culture, vol. 7, no. 1, pp. 101--127, 2013.

[10]

L. Nacke, A. Drachen and S. Göbel, "Methods for Evaluating Gameplay Experience in a Serious Gaming Context," International Journal of Computer Science in Sport, vol. 9, no. 2, pp. 1--12, 2010.

[11]

J. Sánchez, L. Gonzáles, F. L. G. Vela, F. M. Simarro and N. Padilla-Zea, "Playability: analysing user experience in video games," Behaviour & Information Technology, vol. 31, no. 10, pp. 1033--1054, 2012.

Digital Library

[12]

H. L. O'Brien and E. G. Toms, "What is user engagement? A conceptual framework for defining user engagement with technology," Journal of the American Society for Information Science and Technology, vol. 59, no. 6, pp. 938--955, 2008.

Digital Library

[13]

B. Zaman and V. V. Abeele, "Player-Centric Game Design: Adding UX Laddering to the Method Toolbox for Player Experience Measurement," in Proceedings of Measuring Behavior, Citeseer, 2012, pp. 128--140.

[14]

D. Pinelle, N. Wong and T. Stach, "Heuristic Evaluation for Games: Usability Principles for Video Game Design," in Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2008), 2008.

Digital Library

[15]

I. J. Livinston, L. E. Nacke and L. R. Mandryk, "The impact of negative game reviews and user comments on player experience," in ACM SIGGRAPH 2011 Game Papers, ACM, 2011, p. 4.

Digital Library

[16]

I. Livingston, L. Nacke and R. Mandryk, "Influencing experience: the effects of reading game reviews on player experience," in Entertainment Computing-ICEC 2011, Springer, 2011, pp. 89--100.

Digital Library

[17]

J. P. Zagal, A. Ladd and T. Johnson, "Characterizing and understanding game reviews," in Proceedings of the 4th international Conference on Foundations of Digital Games, 2009.

Digital Library

[18]

A. Kultima and J. Stenros, "Designing games for everyone: the expanded game experience model.," in Proceedings of the International Academic Conference on the Future of Game Design and Technology, 2010.

Digital Library

[19]

L. E. Janlert and E. Stolterman, "The Character of Things," Design Studies, pp. 297--314, 1997.

[20]

M. Hassenzahl and N. Tractinsky, "User experience-a research agenda," Behaviour & information technology, pp. 91--97, 2006.

[21]

D. A. Norman, "Some observations on mental models," in Mental Models, Lawrence Erlbaum Associates, Inc., 1983, pp. 7--14.

[22]

M. Pontiki, D. Galanis, J. Pavlopoulos, H. Papageorgiou, I. Androutsopoulos and S. Manandhar, "Semeval-2014 task 4: Aspect based sentiment analysis," Proceedings of SemEval, pp. 27--35, 2014.

[23]

J. P. Zagal and N. Tomuro, "Cultural differences in game appreciation: A study of player game reviews," in FDG, 2013.

[24]

I. J. Livingston, R. L. Mandryk and K. G. Stanley, "Critic-proofing: how using critic reviews and game genres can refine heuristic evaluations," in Proceedings of the International Academic Conference on the Future of Game Design and Technology, 2010.

Digital Library

Cited By

Yu YDinh DNguyen BYu FHuynh V(2023)Mining Insights From Esports Game Reviews With an Aspect-Based Sentiment Analysis FrameworkIEEE Access10.1109/ACCESS.2023.328586411(61161-61172)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3285864
Lee Teh PPak I(2021)Pay to Play: Understanding Gamer's Motivation through Semantic AnalysisThe 23rd International Conference on Information Integration and Web Intelligence10.1145/3487664.3487688(168-175)Online publication date: 29-Nov-2021
https://dl.acm.org/doi/10.1145/3487664.3487688
Urriza IClarino M(2021)Aspect-Based Sentiment Analysis of User Created Game Reviews2021 24th Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)10.1109/O-COCOSDA202152914.2021.9660559(76-81)Online publication date: 18-Nov-2021
https://doi.org/10.1109/O-COCOSDA202152914.2021.9660559
Show More Cited By

Index Terms

Probing user opinions in an indirect way: an aspect based sentiment analysis of game reviews
1. Applied computing
  1. Computers in other domains
    1. Personal computers and PC applications
      1. Computer games

Recommendations

Explanatory opinions: to whom or what is all the fuss about?
FDIA '15: Proceedings of the 6th Symposium on Future Directions in Information Access

Exploiting sentiment relations to improve the accuracy of sentiment analysis has caught the interest of recent research. When expressing their opinions, users apply different sentence syntactic constructions styles. This analysis leverages on a ...
A comparative analysis of recommender systems based on item aspect opinions extracted from user reviews

In popular applications such as e-commerce sites and social media, users provide online reviews giving personal opinions about a wide array of items, such as products, services and people. These reviews are usually in the form of free text, and ...
Integrated microblog sentiment analysis from users' social interaction patterns and textual opinions

Traditional post-level opinion classification methods usually fail to capture a person's overall sentiment orientation toward a topic from his/her microblog posts published for a variety of themes related to that topic. One reason for this is that the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AcademicMindtrek '17: Proceedings of the 21st International Academic Mindtrek Conference

September 2017

271 pages

ISBN:9781450354264

DOI:10.1145/3131085

Conference Chair:
Markku Turunen
University of Tampere
,
Program Chairs:
Heli Väätäjä
University of Tampere
,
Janne Paavilainen
University of Tampere
,
Thomas Olsson
University of Tampere

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AcademicMindtrek'17

Sponsor:

AcademicMindtrek'17: Annual Academic Mindtrek Conference

September 20 - 21, 2017

Tampere, Finland

Acceptance Rates

Overall Acceptance Rate 110 of 207 submissions, 53%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
282
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)4

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yu YDinh DNguyen BYu FHuynh V(2023)Mining Insights From Esports Game Reviews With an Aspect-Based Sentiment Analysis FrameworkIEEE Access10.1109/ACCESS.2023.328586411(61161-61172)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3285864
Lee Teh PPak I(2021)Pay to Play: Understanding Gamer's Motivation through Semantic AnalysisThe 23rd International Conference on Information Integration and Web Intelligence10.1145/3487664.3487688(168-175)Online publication date: 29-Nov-2021
https://dl.acm.org/doi/10.1145/3487664.3487688
Urriza IClarino M(2021)Aspect-Based Sentiment Analysis of User Created Game Reviews2021 24th Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)10.1109/O-COCOSDA202152914.2021.9660559(76-81)Online publication date: 18-Nov-2021
https://doi.org/10.1109/O-COCOSDA202152914.2021.9660559
Zhang YDu JMa XWen HFortino G(2021)Aspect-Based Sentiment Analysis for User ReviewsCognitive Computation10.1007/s12559-021-09855-4Online publication date: 13-Jul-2021
https://doi.org/10.1007/s12559-021-09855-4
Warpefelt H(2020)Micro-level examination of games using Indicator AnalysisProceedings of the 15th International Conference on the Foundations of Digital Games10.1145/3402942.3402980(1-9)Online publication date: 15-Sep-2020
https://dl.acm.org/doi/10.1145/3402942.3402980
Sabeeh ADewang R(2018)Comparison, Classification and Survey of Aspect Based Sentiment AnalysisAdvanced Informatics for Computing Research10.1007/978-981-13-3140-4_55(612-629)Online publication date: 12-Dec-2018
https://doi.org/10.1007/978-981-13-3140-4_55

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents