With the increased adoption of real-time objective measurements of player experience, advances have been made in characterising the dynamically changing aspects of the player experience during gameplay itself. A direct coupling to player action, however, is not without challenges. Many physiological responses, for instance, have an inherent delay, and often take some time to return to a baseline, providing challenges of interpretation when analysing rapidly changing gameplay on a micro level of interaction. The development of event-related, or phasic, measurements directly coupled to player actions provides additional insights, for instance through player modelling, but also through the use of behavioural characteristics of the human computer interaction itself. In this study, we focused on the latter, and measured keyboard pressure in a number of different, fast-paced action games. In this particular case, we related specific functional game actions (keyboard presses) to experiential player behaviour. We found keyboard pressure to be higher for avoidance as compared to approach-oriented actions. Additionally, the difference between avoidance and approach keyboard pressure related to levels of arousal. The findings illustrate the application potential of qualifying players’ functional actions at play (navigating in a game) and interpret player experience related to these actions through players’ real world behavioural characteristics like interface pressure.
MULTIFILE
The realization of one’s musical ideas at the keyboard is dependent on the ability to transform sound into movement, a process called audiomotor transformation. Using fMRI, we investigated cerebral activations while classically-trained improvising and non-improvising musicians imagined playing along with recordings of familiar and unfamiliar music excerpts. We hypothesized that audiomotor transformation would be associated with the recruitment of dedicated cerebral networks, facilitating aurally-cued performance. Results indicate that while all classically-trained musicians engage a left-hemisphere network involved in motor skill and action recognition, only improvising musicians additionally recruit a right dorsal frontoparietal network dedicated to spatially-driven motor control. Mobilization of this network, which plays a crucial role in the real-time transformation of imagined or perceived music into goal-directed action, may be held responsible not only for the stronger activation of auditory cortex we observed in improvising musicians in response to the aural perception of music, but also for the superior ability to play ‘by ear’ which they demonstrated in a follow-up study. The results of this study suggest that the practice of improvisation promotes the implicit acquisition of hierarchical music syntax which is then recruited in top-down manner via the dorsal stream during music performance. In a study of audiomotor transformation in Parkinson patients, we demonstrated a dissociation between dysprosody in speech and music. While patients’ speech could reliably be distinguished from that of healthy individuals, purely on the basis of aural perception, no difference was observed between patients and healthy controls in their ability to sing improvised melodies.
LINK
