Skip to main content
Top
Published in: Empirical Software Engineering 4/2020

26-03-2020

Building the perfect game – an empirical study of game modifications

Authors: Daniel Lee, Dayi Lin, Cor-Paul Bezemer, Ahmed E. Hassan

Published in: Empirical Software Engineering | Issue 4/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Prior work has shown that gamer loyalty is important for the sales of a developer’s future games. Therefore, it is important for game developers to increase the longevity of their games. However, game developers cannot always meet the growing and changing needs of the gaming community, due to the often already overloaded schedules of developers. So-called modders can potentially assist game developers with addressing gamers’ needs. Modders are enthusiasts who provide modifications or completely new content for a game. By supporting modders, game developers can meet the rapidly growing and varying needs of their gamer base. Modders have the potential to play a role in extending the life expectancy of a game, thereby saving game developers time and money, and leading to a better overall gaming experience for their gamer base. In this paper, we empirically study the metadata of 9,521 mods that were extracted from the Nexus Mods distribution platform. The Nexus Mods distribution platform is one of the largest mod distribution platforms for PC games at the time of our study. The goal of our paper is to provide useful insights about mods on the Nexus Mods distribution platform from a quantitative perspective, and to provide researchers a solid foundation to further explore game mods. To better understand the potential of mods to extend the longevity of a game we study their characteristics, and we study their release schedules and post-release support (in terms of bug reports) as a proxy for the willingness of the modding community to contribute to a game. We find that providing official support for mods can be beneficial for the perceived quality of the mods of a game: games for which a modding tool is provided by the original game developer have a higher median endorsement ratio than mods for games that do not have such a tool. In addition, mod users are willing to submit bug reports for a mod. However, they often fail to do this in a systematic manner using the bug reporting tool of the Nexus Mods platform, resulting in low-quality bug reports which are difficult to resolve. Our findings give the first insights into the characteristics, release schedule and post-release support of game mods. Our findings show that some games have a very active modding community, which contributes to those games through mods. Based on our findings, we recommend that game developers who desire an active modding community for their own games provide the modding community with an officially-supported modding tool. In addition, we recommend that mod distribution platforms, such as Nexus Mods, improve their bug reporting system to receive higher quality bug reports.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Ahmed F, Zia M, Mahmood H, Al Kobaisi S (2017) Open source computer game application: an empirical analysis of quality concerns. Entertain Comput 21:1–10CrossRef Ahmed F, Zia M, Mahmood H, Al Kobaisi S (2017) Open source computer game application: an empirical analysis of quality concerns. Entertain Comput 21:1–10CrossRef
go back to reference Ampatzoglou A, Stamelos I (2010) Software engineering research for computer games: a systematic review. Inf Softw Technol 52(9):888–901CrossRef Ampatzoglou A, Stamelos I (2010) Software engineering research for computer games: a systematic review. Inf Softw Technol 52(9):888–901CrossRef
go back to reference Anvik J, Hiew L, Murphy GC (2005) Coping with an open bug repository. In: OOPSLA workshop on Eclipse technology eXchange. ACM, pp 35–39 Anvik J, Hiew L, Murphy GC (2005) Coping with an open bug repository. In: OOPSLA workshop on Eclipse technology eXchange. ACM, pp 35–39
go back to reference Arakji RY, Lang KR (2007) Digital consumer networks and producer-consumer collaboration: Innovation and product development in the video game industry. J Manag Inf Syst 24(2):195–219CrossRef Arakji RY, Lang KR (2007) Digital consumer networks and producer-consumer collaboration: Innovation and product development in the video game industry. J Manag Inf Syst 24(2):195–219CrossRef
go back to reference Bécares JH, Valero LC, Martín PPG (2017) An approach to automated videogame beta testing. Entertain Comput 18:79–92CrossRef Bécares JH, Valero LC, Martín PPG (2017) An approach to automated videogame beta testing. Entertain Comput 18:79–92CrossRef
go back to reference Bettenburg N, Just S, Schröter A, Weiss C, Premraj R, Zimmermann T (2008) What makes a good bug report? In: 16th ACM SIGSOFT International Symposium on Foundations of Software Engineering. ACM, pp 308–318 Bettenburg N, Just S, Schröter A, Weiss C, Premraj R, Zimmermann T (2008) What makes a good bug report? In: 16th ACM SIGSOFT International Symposium on Foundations of Software Engineering. ACM, pp 308–318
go back to reference Blackburn J, Kourtellis N, Skvoretz J, Ripeanu M, Iamnitchi A (2014) Cheating in online games: a social network perspective. ACM Trans Internet Technol (TOIT) 13(3):9CrossRef Blackburn J, Kourtellis N, Skvoretz J, Ripeanu M, Iamnitchi A (2014) Cheating in online games: a social network perspective. ACM Trans Internet Technol (TOIT) 13(3):9CrossRef
go back to reference Bostan B, Kaplancali U (2010) Explorations in player motivations: Game mods. In: GAMEON-ASIA. EUROSIS, pp 1–9 Bostan B, Kaplancali U (2010) Explorations in player motivations: Game mods. In: GAMEON-ASIA. EUROSIS, pp 1–9
go back to reference Chambers C, Feng Wc, Sahu S, Saha D (2005) Measurement-based characterization of a collection of on-line games. In: 5th ACM SIGCOMM conference on Internet Measurement. USENIX Association, pp 1–14 Chambers C, Feng Wc, Sahu S, Saha D (2005) Measurement-based characterization of a collection of on-line games. In: 5th ACM SIGCOMM conference on Internet Measurement. USENIX Association, pp 1–14
go back to reference Cheung GK, Zimmermann T, Nagappan N (2014) The first hour experience: how the initial play can engage (or lose) new players. In: First ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play. ACM, pp 57–66 Cheung GK, Zimmermann T, Nagappan N (2014) The first hour experience: how the initial play can engage (or lose) new players. In: First ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play. ACM, pp 57–66
go back to reference Consalvo M (2007) Cheating : Gaining Advantage in Videogames. The MIT Press, Cambridge Consalvo M (2007) Cheating : Gaining Advantage in Videogames. The MIT Press, Cambridge
go back to reference Daneva M (2017) Striving for balance: a look at gameplay requirements of massively multiplayer online role-playing games. J Syst Softw 134:54–75CrossRef Daneva M (2017) Striving for balance: a look at gameplay requirements of massively multiplayer online role-playing games. J Syst Softw 134:54–75CrossRef
go back to reference Dey T, Massengill JL, Mockus A (2016) Analysis of popularity of game mods: A case study. In: Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. ACM, pp 133–139 Dey T, Massengill JL, Mockus A (2016) Analysis of popularity of game mods: A case study. In: Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. ACM, pp 133–139
go back to reference Gallagher R, Jong C, Sinervo KA (2017) Who wrote the elder scrolls?: modders, developers, and the mythology of Bethesda softworks. Loading 10(16):1–21 Gallagher R, Jong C, Sinervo KA (2017) Who wrote the elder scrolls?: modders, developers, and the mythology of Bethesda softworks. Loading 10(16):1–21
go back to reference Graham TN, Roberts W (2006) Toward quality-driven development of 3d computer games. In: International workshop on design, Specification, and Verification of Interactive Systems. Springer, pp 248–261 Graham TN, Roberts W (2006) Toward quality-driven development of 3d computer games. In: International workshop on design, Specification, and Verification of Interactive Systems. Springer, pp 248–261
go back to reference Guana V, Stroulia E, Nguyen V (2015) Building a game engine: A tale of modern model-driven engineering. In: IEEE/ACM 4th International Workshop on Games and Software Engineering. IEEE, pp 15–21 Guana V, Stroulia E, Nguyen V (2015) Building a game engine: A tale of modern model-driven engineering. In: IEEE/ACM 4th International Workshop on Games and Software Engineering. IEEE, pp 15–21
go back to reference Hassan S, Shang W, Hassan AE (2017) An empirical study of emergency updates for top android mobile apps. Empir Softw Eng 22(1):505–546CrossRef Hassan S, Shang W, Hassan AE (2017) An empirical study of emergency updates for top android mobile apps. Empir Softw Eng 22(1):505–546CrossRef
go back to reference Hassan S, Bezemer CP, Hassan AE (2018b) Studying bad updates of top free-to-download apps in the Google Play store. IEEE Transactions on Software Engineering (In press) Hassan S, Bezemer CP, Hassan AE (2018b) Studying bad updates of top free-to-download apps in the Google Play store. IEEE Transactions on Software Engineering (In press)
go back to reference Hirvonen E (2017) Improving the game with user generated content: an overview of Skyrim mod users. Master’s thesis, University of Jyväskylä, Finland Hirvonen E (2017) Improving the game with user generated content: an overview of Skyrim mod users. Master’s thesis, University of Jyväskylä, Finland
go back to reference Jeppesen LB (2004) Profiting from innovative user communities: How firms organize the production of user modifications in the computer games industry. Technical report. Department of Industrial Economics and Strategy, Copenhagen Business School Jeppesen LB (2004) Profiting from innovative user communities: How firms organize the production of user modifications in the computer games industry. Technical report. Department of Industrial Economics and Strategy, Copenhagen Business School
go back to reference Kanode CM, Haddad HM (2009) Software engineering challenges in game development. In: Sixth international conference on information technology, New Generations. IEEE, pp 260–265 Kanode CM, Haddad HM (2009) Software engineering challenges in game development. In: Sixth international conference on information technology, New Generations. IEEE, pp 260–265
go back to reference Kasurinen J, Palacin-Silva M, Vanhala E (2017) What concerns game developers?: A study on game development processes, sustainability and metrics. In: 8th Workshop on Emerging Trends in Software Metrics. IEEE, pp 15–21 Kasurinen J, Palacin-Silva M, Vanhala E (2017) What concerns game developers?: A study on game development processes, sustainability and metrics. In: 8th Workshop on Emerging Trends in Software Metrics. IEEE, pp 15–21
go back to reference Köhler B, Haladjian J, Simeonova B, Ismailović D (2012) Feedback in low vs. high fidelity visuals for game prototypes. In: Second international workshop on games and software engineering, Realizing User Engagement with Game Engineering Techniques. IEEE, pp 42–47 Köhler B, Haladjian J, Simeonova B, Ismailović D (2012) Feedback in low vs. high fidelity visuals for game prototypes. In: Second international workshop on games and software engineering, Realizing User Engagement with Game Engineering Techniques. IEEE, pp 42–47
go back to reference Koleva B, Tolmie P, Brundell P, Benford S, Rennick Egglestone S (2015) From front-end to back-end and everything in-between: work practice in game development. In: Annual Symposium on Computer-Human Interaction in Play. ACM, pp 141–150 Koleva B, Tolmie P, Brundell P, Benford S, Rennick Egglestone S (2015) From front-end to back-end and everything in-between: work practice in game development. In: Annual Symposium on Computer-Human Interaction in Play. ACM, pp 141–150
go back to reference Laukkanen T (2005) Modding scenes-introduction to user-created content in computer gaming Laukkanen T (2005) Modding scenes-introduction to user-created content in computer gaming
go back to reference Lewis C, Whitehead J, Wardrip-Fruin N (2010) What went wrong: a taxonomy of video game bugs. In: Fifth International Conference on the Foundations of Digital Games. ACM, pp 108–115 Lewis C, Whitehead J, Wardrip-Fruin N (2010) What went wrong: a taxonomy of video game bugs. In: Fifth International Conference on the Foundations of Digital Games. ACM, pp 108–115
go back to reference Lewis C, Whitehead J (2011) The whats and the whys of games and software engineering. In: 1st International Workshop on Games and Software Engineering. ACM, pp 1–4 Lewis C, Whitehead J (2011) The whats and the whys of games and software engineering. In: 1st International Workshop on Games and Software Engineering. ACM, pp 1–4
go back to reference Lin D, Bezemer CP, Hassan AE (2017) Studying the urgent updates of popular games on the Steam platform. Empir Softw Eng 22(4):2095–2126CrossRef Lin D, Bezemer CP, Hassan AE (2017) Studying the urgent updates of popular games on the Steam platform. Empir Softw Eng 22(4):2095–2126CrossRef
go back to reference Lin D, Bezemer CP, Hassan AE (2018) An empirical study of early access games on the Steam platform. Empir Softw Eng 23(2):771–799CrossRef Lin D, Bezemer CP, Hassan AE (2018) An empirical study of early access games on the Steam platform. Empir Softw Eng 23(2):771–799CrossRef
go back to reference Lin D, Bezemer CP, Hassan AE (2019a) Identifying gameplay videos that exhibit bugs in computer games. Empirical Software Engineering: 1–28 Lin D, Bezemer CP, Hassan AE (2019a) Identifying gameplay videos that exhibit bugs in computer games. Empirical Software Engineering: 1–28
go back to reference Lin D, Bezemer CP, Zou Y, Hassan AE (2019b) An empirical study of game reviews on the Steam platform. Empir Softw Eng 24(1):170–207CrossRef Lin D, Bezemer CP, Zou Y, Hassan AE (2019b) An empirical study of game reviews on the Steam platform. Empir Softw Eng 24(1):170–207CrossRef
go back to reference Long JD, Feng D, Cliff N (2003) Ordinal analysis of behavioral data. In: Schinka J. A., Velicer W. F. (eds) Handbook of psychology: Research methods in psychology, vol 2. Wiley, pp 635–661 Long JD, Feng D, Cliff N (2003) Ordinal analysis of behavioral data. In: Schinka J. A., Velicer W. F. (eds) Handbook of psychology: Research methods in psychology, vol 2. Wiley, pp 635–661
go back to reference Martin W, Sarro F, Jia Y, Zhang Y, Harman M (2017) A survey of app store analysis for software engineering. IEEE Trans Softw Eng 43(9):817–847CrossRef Martin W, Sarro F, Jia Y, Zhang Y, Harman M (2017) A survey of app store analysis for software engineering. IEEE Trans Softw Eng 43(9):817–847CrossRef
go back to reference McIlroy S, Ali N, Hassan A E (2016) Fresh apps: an empirical study of frequently-updated mobile apps in the Google play store. Empir Softw Eng 21(3):1346–1370CrossRef McIlroy S, Ali N, Hassan A E (2016) Fresh apps: an empirical study of frequently-updated mobile apps in the Google play store. Empir Softw Eng 21(3):1346–1370CrossRef
go back to reference Murphy-Hill E, Zimmermann T, Nagappan N (2014) Cowboys, ankle sprains, and keepers of quality: How is video game development different from software development?. In: 36Th international conference on software engineering. ACM, New York, pp 1–11 Murphy-Hill E, Zimmermann T, Nagappan N (2014) Cowboys, ankle sprains, and keepers of quality: How is video game development different from software development?. In: 36Th international conference on software engineering. ACM, New York, pp 1–11
go back to reference Nieborg DB, Van der Graaf S (2008) The mod industries? the industrial logic of non-market game production. Eur J Cult Stud 11(2):177–195CrossRef Nieborg DB, Van der Graaf S (2008) The mod industries? the industrial logic of non-market game production. Eur J Cult Stud 11(2):177–195CrossRef
go back to reference Pascarella L, Palomba F, Di Penta M, Bacchelli A (2018) How is video game development different from software development in open source? In: 2018 IEEE/ACM 15th International Conference on Mining Software Repositories (MSR), pp 392–402 Pascarella L, Palomba F, Di Penta M, Bacchelli A (2018) How is video game development different from software development in open source? In: 2018 IEEE/ACM 15th International Conference on Mining Software Repositories (MSR), pp 392–402
go back to reference Politowski C, Fontoura L, Petrillo F, Guéhéneuc YG (2016) Are the old days gone?: A survey on actual software engineering processes in video game industry. In: 5th International Workshop on Games and Software Engineering. ACM, pp 22–28 Politowski C, Fontoura L, Petrillo F, Guéhéneuc YG (2016) Are the old days gone?: A survey on actual software engineering processes in video game industry. In: 5th International Workshop on Games and Software Engineering. ACM, pp 22–28
go back to reference Poretski L, Arazy O (2017) Placing value on community co-creations: A study of a video game ‘modding’ community. In: ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, pp 480–491 Poretski L, Arazy O (2017) Placing value on community co-creations: A study of a video game ‘modding’ community. In: ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, pp 480–491
go back to reference Postigo H (2007) Of mods and modders: Chasing down the value of fan-based digital game modifications. Games Cult 2(4):300–313CrossRef Postigo H (2007) Of mods and modders: Chasing down the value of fan-based digital game modifications. Games Cult 2(4):300–313CrossRef
go back to reference Romano J, Kromrey JD, Coraggio J, Skowronek J, Devine L (2006) Exploring methods for evaluating group differences on the nsse and other surveys: Are the t-test and cohen’sd indices the most appropriate choices. In: Annual Meeting of the Southern Association for Institutional Research. Citeseer Romano J, Kromrey JD, Coraggio J, Skowronek J, Devine L (2006) Exploring methods for evaluating group differences on the nsse and other surveys: Are the t-test and cohen’sd indices the most appropriate choices. In: Annual Meeting of the Southern Association for Institutional Research. Citeseer
go back to reference Scacchi W (2010) Computer game mods, modders, modding, and the mod scene. First Monday 15(5) Scacchi W (2010) Computer game mods, modders, modding, and the mod scene. First Monday 15(5)
go back to reference Scacchi W (2011a) Modding as a basis for developing game systems. In: 1st International Workshop on Games and Software Engineering. ACM, pp 5–8 Scacchi W (2011a) Modding as a basis for developing game systems. In: 1st International Workshop on Games and Software Engineering. ACM, pp 5–8
go back to reference Scacchi W (2011b) Modding as an open source approach to extending computer game systems. In: IFIP International Conference on Open Source Systems. Springer, pp 62–74 Scacchi W (2011b) Modding as an open source approach to extending computer game systems. In: IFIP International Conference on Open Source Systems. Springer, pp 62–74
go back to reference Scacchi W, Cooper KM (2015) Research challenges at the intersection of computer games and software engineering. In: Conference on Foundations of Digital Games Scacchi W, Cooper KM (2015) Research challenges at the intersection of computer games and software engineering. In: Conference on Foundations of Digital Games
go back to reference Sifa R, Bauckhage C, Drachen A (2014) The playtime principle: Large-scale cross-games interest modeling. In: IEEE Conference on Computational Intelligence and Games. IEEE, pp 1–8 Sifa R, Bauckhage C, Drachen A (2014) The playtime principle: Large-scale cross-games interest modeling. In: IEEE Conference on Computational Intelligence and Games. IEEE, pp 1–8
go back to reference Sotamaa O (2003) Computer game modding, intermediality and participatory culture. New Media: 1–5 Sotamaa O (2003) Computer game modding, intermediality and participatory culture. New Media: 1–5
go back to reference Sotamaa O (2010) When the game is not enough: Motivations and practices among computer game modding culture. Games Cult 5(3):239–255CrossRef Sotamaa O (2010) When the game is not enough: Motivations and practices among computer game modding culture. Games Cult 5(3):239–255CrossRef
go back to reference Villarroel L, Bavota G, Russo B, Oliveto R, Di Penta M (2016) Release planning of mobile apps based on user reviews. In: 2016 IEEE/ACM 38Th international conference on software engineering (ICSE). IEEE, pp 14–24 Villarroel L, Bavota G, Russo B, Oliveto R, Di Penta M (2016) Release planning of mobile apps based on user reviews. In: 2016 IEEE/ACM 38Th international conference on software engineering (ICSE). IEEE, pp 14–24
go back to reference Washburn Jr, M, Sathiyanarayanan P, Nagappan M, Zimmermann T, Bird C (2016) What went right and what went wrong: an analysis of 155 postmortems from game development. In: 38th International Conference on Software Engineering Companion. ACM, pp 280–289 Washburn Jr, M, Sathiyanarayanan P, Nagappan M, Zimmermann T, Bird C (2016) What went right and what went wrong: an analysis of 155 postmortems from game development. In: 38th International Conference on Software Engineering Companion. ACM, pp 280–289
go back to reference Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bullet 1(6):80–83CrossRef Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bullet 1(6):80–83CrossRef
Metadata
Title
Building the perfect game – an empirical study of game modifications
Authors
Daniel Lee
Dayi Lin
Cor-Paul Bezemer
Ahmed E. Hassan
Publication date
26-03-2020
Publisher
Springer US
Published in
Empirical Software Engineering / Issue 4/2020
Print ISSN: 1382-3256
Electronic ISSN: 1573-7616
DOI
https://doi.org/10.1007/s10664-019-09783-w

Other articles of this Issue 4/2020

Empirical Software Engineering 4/2020 Go to the issue

Premium Partner