Virtual Human

Jiayi Xu, MFA ’19

thesis abstract

Shifting from informational to experiential age, Virtual Reality (VR) represents the new revolution of natural human-computer interaction. Instead of passively consuming graphics and textual information like using Facebook, or watching TV, VR has the potential to deepen self-awareness by encouraging users to actively participate in technology. It is a high-tech medium that allows us to dream, experience, empathize and share.

Based on the Hype Cycle for Emerging Technologies in 2018, VR is currently in the “slope of enlightenment” stage. This means that the preferred interaction for VR is still being explored. For now, we can only use two of our senses, sight, and hearing in virtual environments. This is limited and unnatural. In addition, according to the Diffusion of Innovation model, VR is between Early Adoption and Early Majority, where 15-30% of society has accepted and begun using this innovation. However, the pricey VR devices and complicated set-up greatly discourage the diffusion of VR, and isolate users from one another.

My thesis focuses on enhancing interaction and immersion in virtual spaces. To achieve this goal, I have created projects that don’t rely on headsets or wearable sensors. Instead, I combined VR experiences with face-tracking technology, gesture recognition, and brainwave monitor (EEG) to digitize human behaviors, emotions, and consciousness. This allows the human body to become the interface. I want to discover a better way to associate human activities with a virtual space and eventually make VR more immersive.

Theoretically, anything that can stimulate our brains to create an illusory world can be virtual reality. However, today VR technology is limited to the creation of three-dimensional, computer-generated environments. My thesis works to imagine an ideal VR system, that can fully immerse users through their behaviors, emotions, and consciousness.