What Empirically Based Research Tells Us About Game Development

The Computer Games Journal - 2019
Björn Berg Marklund1, Henrik Engström1, Marcus Hellkvist1, Per Backlund1
1School of Informatics, University of Skövde, Högskolevägen, Box 408, 541 28, Skövde, Sweden

Tóm tắt

Abstract This paper reviews empirically grounded research on practices in game development with the intent to give a comprehensive overview of contemporary development practices used in the video game industry. While there are many intangible elements that inform game development processes, this review specifically covers the more immediate practical challenges. The review covers a total of 48 papers published between 2006 and 2016, which were all subjected to thematic analysis by three reviewers. The results of the review show that an almost universal characteristic of game development is that it is almost impossible to accurately plan a development project in detail, largely due to the soft requirements inherent in game production which emerge mid-process during development projects, during when testing is coupled with continuous ideation and refinement. Practicing game developers have created their own frameworks that accommodate for this lack of planning. They include flat hierarchies, democratic decision-making, creative autonomy, and informal communication, which are designed to create an environment that maintains creativity and openness to product changes long into the production process. These frameworks vary significantly between studios and often between individual projects. This review also shows that the term ‘Agile’, while often used by both researchers and developers to characterize the process of game development, is not an apt descriptor of how game developers actually work. Agile is used as shorthand for unstructured and flexible development, rather than serving as a descriptor of a definable or unified work method. Finally, as companies develop more complicated hierarchies of stakeholders and staff, the desired flexibility and autonomy of game development becomes increasingly complicated to maintain, and often necessitates more formalized management processes and company structures. In these cases, inherent tensions of game development become more pronounced, and continuous creativity is hard to maintain due to a growing need to formalize processes.

Từ khóa


Tài liệu tham khảo

Alves, C., Ramalho, G., & Damasceno, A. (2007). Challenges in requirements engineering for mobile games development: The meantime case study. In Proceedings-15th IEEE international requirements engineering conference, RE 2007 (pp. 275–280).

Amanatiadou, A., & Van De Weerd, I. (2009). Extending the reference method for game production: A situational approach. In Proceedings of the 2009 conference in games and virtual worlds for serious applications, VS-GAMES 2009 (pp. 20–27).

Bernhaupt, R. (2015). User experience evaluation methods in the games development life cycle. In R. Bernhaupt (Ed.), Game user experience evaluation (pp. 1–8). Cham: Springer International Publishing.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology,3(2), 77–101.

Bryant, J. A., Akerman, A., & Drell, J. (2010). Diminutive subjects, design strategy, and driving sales: Preschoolers and the nintendo DS. The International Journal of Computer Game Research, 10(1).

Chung, P., & Fung, A. (2013). Internet development and the commercialization of online gaming in China. In N. B. Huntemann & B. Aslinger (Eds.), Gaming globally: Production, play, and place (pp. 233–250). New York: Palgrave Macmillan.

Cohendet, P., & Simon, L. (2007). Playing across the playground: Paradoxes of knowledge creation in the videogame firm. Journal of Organizational Behavior,28(5), 587–605.

Daneva, M. (2014). How practitioners approach gameplay requirements? An exploration into the context of massive multiplayer online role-playing games. In 2014 IEEE 22nd international requirements engineering conference, RE 2014-Proceedings (pp. 3–12).

Dezso, C. L., Grohsjean, T., & Kretschmer, T. (2010). The what, the who, and the how: Coordination experience and team performance in the electronic game industry. In Academy of management 2010 annual meeting-dare to care: Passion and compassion in management practice and research, AOM 2010.

Dormans, J. (2012). The effectiveness and efficiency of model driven game design. In M. Herrlich, R. Malaka, & M. Masuch (Eds.), Entertainment computing-ICEC 2012: 11th international conference, ICEC 2012, Proceedings, Bremen, Germany, September 26–29, 2012 (pp. 542–548). Berlin: Springer.

Drachen, A., Canossa, A., & Sørensen, J. R. M. (2013). Gameplay metrics in game user research: Examples from the trenches. In M. S. El-Nasr, A. Drachen, & A. Canossa (Eds.), Game analytics: Maximizing the value of player data (pp. 285–319). London: Springer.

Engström, H., Berg Marklund, B., Backlund, P., & Toftedahl, M. (2018). Game development from a software and creative product perspective: A quantitative literature review approach. Entertainment Computing, 27, 10–22.

Hagen, U. (2012). Lodestars for player experience: Ideation in videogame design. Stockholm: Stockholm University.

Hodgson, D., & Briand, L. (2013). Controlling the uncontrollable: ‘Agile’ teams and illusions of autonomy in creative work. Work, Employment & Society,27(2), 308–325.

Hotho, S., & Champion, K. (2011). Small businesses in the new creative industries: Innovation as a people management challenge. Management Decision,49(1), 29–54.

Kasurinen, J., Laine, R., & Smolander, K. (2013). How applicable is ISO/IEC 29110 in game software development? In J. Heidrich, M. Oivo, A. Jedlitschka & M. T. Baldassarre (Eds.), Product-focused software process improvement: 14th international conference, PROFES 2013, Paphos, Cyprus, June 12–14, 2013. Proceedings (pp. 5–19). Berlin: Springer.

Kasurinen, J., Maglyas, A., & Smolander, K. (2014) Is requirements engineering useless in game development? In Paper presented to the lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics).

Kasurinen, J., & Smolander, K. (2014). What do game developers test in their products? In International symposium on empirical software engineering and measurement.

Kasurinen, J., Strandén, J. P., & Smolander, K. (2013). What do game developers expect from development and design tools? In ACM International conference proceeding series (pp. 36–41).

Koeffel, C., Hochleitner, W., Leitner, J., Haller, M., Geven, A., & Tscheligi, M. (2010). Using heuristics to evaluate the overall user experience of video games and advanced interaction games. In R. Bernhaupt (Ed.), Evaluating user experience in games: Concepts and methods (pp. 233–256). London: Springer.

Kortmann, L. J., & Harteveld, C. (2009). Agile game development: Lessons learned from software engineering. In Learn to game, game to learn; The 40th conference ISAGA.

Koutonen, J., & Leppänen, M. (2013). How are agile methods and practices deployed in video game development? A survey into finnish game studios. In H. Baumeister, & B. Weber (Eds.), Agile processes in software engineering and extreme programming: 14th international conference, XP 2013, Vienna, Austria, June 3–7, 2013. Proceedings (pp. 135–149). Berlin: Springer.

Kultima, A. (2010). The organic nature of game ideation: Game ideas arise from solitude and mature by bouncing. In Paper presented to the proceedings of the international academic conference on the future of game design and technology, Vancouver, British Columbia, Canada.

Land, S. K., & Wilson, B. (2006). Using IEEE standards to support America’s Army gaming development. Computer,39(11), 105–107.

Lê, P. L., Massé, D., & Paris, T. (2013). Technological change at the heart of the creative process: Insights from the videogame industry. International Journal of Arts Management,15(2), 45–59.

Llerena, P., Burger-Helmchen, T., & Cohendet, P. (2009). Division of labor and division of knowledge: A case study of innovation in the video game industry. In U. Cantner, J.-L. Gaffard, & L. Nesta (Eds.), Schumpeterian perspectives on innovation, competition and growth (pp. 315–333). Berlin: Springer.

Marie-Josée, L., & Kathleen, O. (2012). So into it they forget what time it is? Video game designers and unpaid overtime. In J. Dariusz & M. Abigail (Eds.), Managing dynamic technology-oriented businesses: High-tech organizations and workplaces (pp. 82–102). Hershey: IGI Global.

Martin, P. (2018). The intellectual structure of game research. Game Studies, 18(1).

McAllister, G., & White, G. R. (2015). Video game development and user experience. In R. Bernhaupt (Ed.), Game user experience evaluation (pp. 11–35). Cham: Springer International Publishing.

McGregor, N. (2013). Business growth, the internet and risk management in the computer games industry. In S. Hotho & N. McGregor (Eds.), Changing the rules of the game: Economic, management and emerging issues in the computer games industry (pp. 65–81). London: Palgrave Macmillan.

Murphy-Hill, E., Zimmermann, T., & Nagappan, N. (2014). Cowboys, ankle sprains, and keepers of quality: How is video game development different from software development? In Paper presented to the proceedings of the 36th international conference on software engineering, Hyderabad, India.

Musial, M., Kauppinen, A., & Puhakka, V. (2015). Recognised creativity: The influence of process, social needs, and the third drive on creative individuals’ work through social media. In Social media and networking: Concepts, methodologies, tools, and applications (Vol. 3–4, pp. 1249–1280).

Musil, J., Schweda, A., Winkler, D., & Biffl, S. (2010). Improving video game development: Facilitating heterogeneous team collaboration through flexible software processes. In Paper presented to the communications in computer and information science.

Myllärniemi, V., Raatikainen, M., & Männistö, T. (2006). Inter-organisational approach in rapid software product family development: A case study. In: M. Morisio (Ed.), Reuse of off-the-shelf components: 9th international conference on software reuse, ICSR 2006 Turin, Italy, June 12–15, 2006 Proceedings (pp. 73–86). Berlin: Springer.

Nelson, W. A., & Palumbo, D. B. (2014). When design meets hollywood: Instructional design in a production studio environment. In B. Hokanson & A. Gibbons (Eds.), Design in educational technology: Design thinking, design process, and the design studio (pp. 75–88). Cham: Springer International Publishing.

O’Donnell, C. (2011). Games are not convergence: The lost promise of digital production and convergence. Convergence,17(3), 271–286.

O’Hagan, A. O., & O’Connor, R. V. (2015). Towards an understanding of game software development processes: A case study. In Paper presented to the communications in computer and information science.

O’Hagan, A. O., Coleman, G., & O’Connor, R. V. (2014). Software development processes for games: A systematic literature review. In Paper presented to the communications in computer and information science.

Petrillo, F., & Pimenta, M. (2010). Is agility out there? Agile practices in game development. In SIGDOC 2010-Proceedings of the 28th ACM international conference on design of communication (pp. 9–15).

Petrillo, F., Pimenta, M., Trindade, F., & Dietrich, C. (2008). Houston, we have a problem…: A survey of actual problems in computer games development. In Proceedings of the ACM symposium on applied computing (pp. 707–711).

Petrillo, F., Pimenta, M., Trindade, F., & Dietrich, C. (2009). What went wrong? A survey of problems in game development. Computers in Entertainment,7(1), 13.

Ruggiero, D., & Watson, W. R. (2014). Engagement through praxis in educational game design: Common threads. Simulation and Gaming,45, 471–490.

Schmalz, M., Finn, A., & Taylor, H. (2014). Risk management in video game development projects. In Proceedings of the annual hawaii international conference on system sciences (pp. 4325–4334).

Seung, H. L., Gum, H. L., Hyun, H. C., Doo, H. S., & Sung, Y. R. (2006). An empirical model of the game software development processes. In Proceedings-fourth international conference on software engineering research, management and applications, SERA 2006 (pp. 371–377).

Simon, L. (2006). Managing creative projects: An empirical synthesis of activities. International Journal of Project Management,24(2), 116–126.

Srisuriyasavad, A., & Prompoon, N. (2013). Defining usability quality metric for game prototype using software attributes. Lecture Notes in Engineering and Computer Science,2202, 522–528.

Stacey, P., Brown, A., & Nandhakumar, J. (2007). Making sense of stories: The development of a new mobile computer game. In Proceedings of the annual hawaii international conference on system sciences.

Stacey, P., & Nandhakumar, J. (2008). Opening up to agile games development. Communications of the ACM,51(12), 143–146.

Stacey, P., & Nandhakumar, J. (2009). A temporal perspective of the computer game development process. Information Systems Journal,19(5), 479–497.

Tran, M. Q., & Biddle, R. (2008). Collaboration in serious game development: A case study. In Paper presented to the proceedings of the 2008 conference on future play: Research, play, share, Toronto, Ontario, Canada.

Trantow, S., Hansen, A., Richert, A., & Jeschke, S. (2013). Emergence of innovation: Eleven strategies to increase innovative capability. In S. Jeschke, I. Isenhardt, F. Hees, & K. Henning (Eds.), Automation, communication and cybernetics in science and engineering 2011/2012 (pp. 161–189). Berlin: Springer.

Tschang, F. T., & Szczypula, J. (2006). Idea creation, constructivism and evolution as key characteristics in the videogame artifact design process. European Management Journal,24(4), 270–287.

Vallance, P. (2014). Creative knowing, organisational learning, and socio-spatial expansion in UK videogame development studios. Geoforum,51, 15–26.

Vanhala, E., Kasurinen, J. (2014). The role of business model and its elements in computer game start-ups. In Paper presented to the lecture notes in business information processing.

VERBI GmbH (1995) MAXQDA, [Software], 18.0.7 edn.

Walfisz, M., Zackariasson, P., & Wilson, T. L. (2006). Real-time strategy: Evolutionary game development. Business Horizons,49(6), 487–498.

Wang, A. I., & Nordmark, N. (2015). Software architectures and the creative processes in game development. In K. Chorianopoulos, M. Divitini, J. Baalsrud Hauge, L. Jaccheri, & R. Malaka (Eds.), Entertainment computing-ICEC 2015: 14th international conference, ICEC 2015, Trondheim, Norway, September 29–Ocotober 2, 2015, Proceedings (pp. 272–285). Springer International Publishing, Cham.

Wimmer, J., & Sitnikova, T. (2011). The professional identity of gameworkers revisited. A qualitative inquiry on the case study of German professionals. In Proceedings of DiGRA 2011 conference: Think design play.

Zackariasson, P., Walfisz, M., & Wilson, T. L. (2006). Management of creativity in video game development: A case study. Services Marketing Quarterly,27(4), 73–97.

Thông tin
Thông tin xuất bản

The Computer Games Journal

Thông tin tác giả