Joris Weijdom studies the impact of collective embodied design techniques in mixed-reality that combines physical and virtual spaces, objects, and participants. He aims to develop new embodied design methods, collaborative mixed-reality environments, and pedagogies for art- and design students and professionals.
The PhD research by Joris Weijdom studies the impact of collective embodied design techniques in collaborative mixed-reality environments (CMRE) in art- and engineering design practice and education. He aims to stimulate invention and innovation from an early stage of the collective design process.
Joris combines theory and practice from the performing arts, human-computer interaction, and engineering to develop CMRE configurations, strategies for its creative implementation, and an embodied immersive learning pedagogy for students and professionals.
This lecture was given at the Transmedia Arts seminar of the Mahindra Humanities Center of Harvard University. In this lecture, Joris Weijdom discusses critical concepts, such as embodiment, presence, and immersion, that concern mixed-reality design in the performing arts. He introduces examples from his practice and interdisciplinary projects of other artists.
About the research
Multiple research areas now support the idea that embodiment is an underpinning of cognition, suggesting new discovery and learning approaches through full-body engagement with the virtual environment. Furthermore, improvisation and immediate reflection on the experience itself, common creative strategies in artist training and practice, are central when inventing something new. In this research, a new embodied design method, entitled Performative prototyping, has been developed to enable interdisciplinary collective design processes in CMRE’s and offers a vocabulary of multiple perspectives to reflect on its outcomes.
Studies also find that engineering education values creativity in design processes, but often disregards the potential of full-body improvisation in generating and refining ideas. Conversely, artists lack the technical know-how to utilize mixed-reality technologies in their design process. This know-how from multiple disciplines is thus combined and explored in this research, connecting concepts and discourse from human-computer interaction and media- and performance studies.
This research is a collaboration of the University of Twente, Utrecht University, and HKU University of the Arts Utrecht. This research is partly financed by the Dutch Research Council (NWO).
Mixed-reality experiences merge real and virtual environments in which physical and digital spaces, objects, and actors co-exist and interact in real-time. Collaborative Mix-Reality Environments, or CMRE's, enable creative design- and learning processes through full-body interaction with spatial manifestations of mediated ideas and concepts, as live-puppeteered or automated real-time computer-generated content. It employs large-scale projection mapping techniques, motion-capture, augmented- and virtual reality technologies, and networked real-time 3D environments in various inter-connected configurations.
Collaborative Mixed Reality Environments (CMREs) enable designing Performative Mixed Reality Experiences (PMREs) to engage participants’ physical bodies, mixed reality environments, and technologies utilized. However, the physical body is rarely purposefully incorporated throughout such design processes, leaving designers seated behind their desks, relying on their previous know-how and assumptions. In contrast, embodied design techniques from HCI and performing arts afford direct corporeal feedback to verify and adapt experiential aesthetics within the design process. This paper proposes a performative prototyping method, which combines bodystorming methods with Wizard of Oz techniques with a puppeteering approach, using inside-out somaesthetic- and outside-in dramaturgical perspectives. In addition, it suggests an interdisciplinary vocabulary to share and evaluate PMRE experiences during and after its design collaboration. This method is exemplified and investigated by comparing two case studies of PMRE design projects in higher-art education using the existing Social VR platform NEOS VR adapted as a CMRE.
Created for the 2019 Prague Quadrennial’s 36Q°, Blue Hour VR was a site-responsive mixed reality performative installation that placed the spectator, as experiencer, within a hybrid landscape of real- time three-dimensional computer graphics and 360-degree video. This article describes the design process, staging and experience of Blue Hour VR from the vantage point of its creators. Using a phenomenological perspective, the article discusses how Blue Hour VR staged presence and embodiment within an intermedial haptic experience. Blue Hour VR demonstrates how virtual reality technology can be harnessed by a mixed reality performance design, which includes both the material and virtual environment, creating a complex stratigraphy of intermedial textures and visual dramaturgies that co-exist inside, outside and in between perceptual realities. In doing so, the article aims to contribute to the limited body of work on mixed and virtual reality in the context of theatre and performance design.
The 6th issue of the Fresh Perspectives series takes you on a playful but serious journey along the issues at stake when designing a mixed reality experience in the context of theatre and performance. The publication features a selection of projects describing in detail the artistic design processes, as well as the challenges and opportunities brought about by the use of mixed reality technologies.Joris Weijdom, researcher and lecturer at the Professorship, wrote the key article and curated this publication.
Finished
Not known
