Affective Adaptation Design for Better Gaming Experiences

Authors: Ollie Hall, Salma ElSayed

Abstract:

Affective adaptation is a creative way for game designers to add an extra layer of engagement to their productions. When player’s emotions are an explicit factor in mechanics design, endless possibilities for imaginative gameplay emerge. Whilst gaining popularity, existing affective game research mostly runs controlled experiments in restrictive settings and rely on one or more specialist devices for measuring player’s emotional state. These conditions albeit effective, are not necessarily realistic. Moreover, the simplified narrative and intrusive wearables may not be suitable for players. This exploratory study investigates delivering an immersive affective experience in the wild with minimal requirements, in an attempt for the average developer to reach the average player. A puzzle game is created with rich narrative and creative mechanics. It employs both explicit and implicit adaptation and only requires a web camera. Participants played the game on their own machines in various settings. Whilst it was rated feasible, very engaging and enjoyable, it remains questionable whether a fully immersive experience was delivered due to the limited sample size.

Keywords: affective games, dynamic adaptation, emotion recognition, game design

References:

[1] Kotsia, Irene, Stefanos Zafeiriou, and Spiros Fotopoulos. "Affective gaming: A comprehensive survey." Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 2013.
[2] Picard, Rosalind W. Affective computing. MIT press, 2000.
[3] Jerčić, Petar, and Veronica Sundstedt. "Practicing emotion-regulation through biofeedback on the decision-making performance in the context of serious games: A systematic review." Entertainment Computing 29 (2019): 75-86.
[4] Michailidis, Lazaros, Emili Balaguer-Ballester, and Xun He. "Flow and immersion in video games: The aftermath of a conceptual challenge." Frontiers in Psychology 9 (2018): 1682.
[5] Hamdy, Salma, and David King. "Affective games: a multimodal classification system." 19th annual European GAME-ON Conference (GAME-ON'2018) on Simulation and AI in Computer Games. EUROSIS, 2018.
[6] Hamdy, Salma, and David King. "Affective games: adaptation and design." 20th annual European GAME-ON Conference: Simulation and AI in Computer Games. EUROSIS, 2019.
[7] Thekla Inc. CA, USA, 2016. The Witness. (Disk)
[8] Kuikkaniemi, Kai, et al. "The influence of implicit and explicit biofeedback in first-person shooter games." Proceedings of the SIGCHI conference on human factors in computing systems. 2010.
[9] Munasinghe, M. I. N. P. "Facial expression recognition using facial landmarks and random forest classifier." 2018 IEEE/ACIS 17th International Conference on Computer and Information Science (ICIS). IEEE, 2018.
[10] Kanade, Takeo, Jeffrey F. Cohn, and Yingli Tian. "Comprehensive database for facial expression analysis." Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580). IEEE, 2000.
[11] University of Tennessee at Knoxville, ScienceDaily, "Psychologists find smiling really can make people happier.", April 12, 2019. Accessed on: 20 April 2021. (Online) Available at: www.sciencedaily.com/releases/2019/04/190412094728.htm (Accessed 20 April 2021)
[12] Kutt, Krzysztof, et al. "Personality-Based Affective Adaptation Methods for Intelligent Systems." Sensors 21.1 (2021): 163.
[13] Kuikkaniemi, Kai, et al. "The influence of implicit and explicit biofeedback in first-person shooter games." Proceedings of the SIGCHI conference on human factors in computing systems. 2010.
[14] Flying Mollusk, CA, USA, Nevermind, 2015.
[15] Vachiratamporn, Vanus, et al. "An analysis of player affect transitions in survival horror games." Journal on Multimodal User Interfaces 9.1 (2015): 43-54.
[16] Parsec Productions, NM, USA, Slender: The Eight Pages, 2012.
[17] Ng, Yiing, Chee Weng Khong, and Robert Jeyakumar Nathan. "Evaluating affective user-centered design of video games using qualitative methods." International Journal of Computer Games Technology 2018 (2018).
[18] Media Molecule, Guildford, UK, LittleBigPlanet 2, 2011.