project

VR INTERACTIVE MUSEUM


Description

Create and test the effect of different audio and movement interactions on virtual museum experiences

A virtual museum was created in order to conduct research, specifically designed for the Samsung Gear VR. In the virtual environment there are interactive compositions the user can hear, and react to while seeing a virtual reality exposition of stunning Japanese paintings. The objective of the latest study was to find whether differences in audio (i.e., interactive or non‐interactive) and movement types (i.e., fixed or free) had an impact on the experience of presence for the user in a virtual environment that represents a museum. The audio variable is composed by and is researched on behalf of Musica Nova, a company that produces music for new forms of media. The results of this component illustrated that interactive music increases feelings of engagement and presence. As to the movement types in a virtual museum, users indicated that free movement caused for a more engaging virtual environment. The research was extended for research on different paintings (e.g. VanGogh).


Products

6
    product

    Play me the music: how sound and vision interplay may enhance VR experiences

    PDF

    product

    NHTV New Campus VR experience

    PDF

    product

    When sound modulates vision: VR applications for art and entertainment

    The interplay between sound and vision is a key determinant of human perception. With the development of Virtual Reality (VR) technologies and their commercial applications, there is emergent need to better understand how audio-visual signals manipulated in virtual environments influence perception and human behaviour. The current study addresses this challenge in simulated VR environments mirroring real life scenarios. In particular, we investigated the parameters that might enhance perception, and thus VR experiences when sound and vision are manipulated. A VR museum was created mimicking a real art gallery featuring Japanese paintings. Participants were exposed to the gallery via Samsung Gear VR, head mounted display, and could freely walk in. To half of the participants newly composed music clips were played, during the VR gallery visit. The other participants were exposed to the same environment, but no music was played (control condition). The results showed that music played altered the way people are engaged in, perceive and experience the VR art gallery. Opposite to our expectation, the VR experience was liked more when no music was played. The naturalness and presence were perceived to be relatively high, and did not differ significantly depending on whether music was played or not. Regression modelling further explored the relationship between the parameters hypothesised to influence the VR experiences. The findings are summarised in a theoretical model. The study outcomes could be implemented to successfully develop efficient VR applications for art and entertainment.

    PDF