WAVR | Baris Siniksaran

Exploring the human brain through VR.

Introduction

Roles

Collaborator(s)

WAVR is a meditative mixed reality experience, which uses EEG/VR technology to monitor alpha & beta brainwave frequency and trigger commands on the VR application, essentially allowing users to control the virtual environment using their brain activity.

PRODUCT DESIGN

VR DEVELOPMENT

Tech Stack

Sean Kim

(Product Designer, EEG Technologist)

Hardware

Achievements

Promo Video

Unreal Engine 4

Max/MSP

Python

Processing

Oculus Rift

OpenBCI Ultracortex

OpenBCI Ganglion Board

Arduino Uno

Duration

1 year 2 months

World Maker Faire, Editor's Choice Award

NYU MakerSpace Prototyping Fund

NYVR Expo Showcase @ Javits Center

Bank of America & Reuters VR Showcase

NY1 Spectrum News TV Interview

NYC Media Lab Showcase @ The New School

NYU SPS Brand Strategy Guest Lecturer

ORF OE1 Radio Interview (Vienna, Austria)

NYU IDM, ITP & XStory Showcases

NYU Official Website (Cover Story)

Promo Video

Project Overview

(Courtesy of NYU)

Project Overview

Challenge

The human brain is the most complex object on Earth, and most of us are unaware of its true potential. In the modern world, it is quite common to be suffering from certain psychological and emotional complications such as ADHD, anxiety, insomnia and lack of motivation. This is due to the simple fact that we do not know how to tell our brain to stop doing what it is doing.

Research Summary

The open-ended interviews have revealed that the average person spends about 20% of their day trying to concentrate (on their work, studies, etc.) and/or to fall asleep. This proves how limited the average person’s control over their brain is. Research shows that by learning how to orchestrate the chemical, physical and functional changes that happen in our brain, we could gain ultimate control over the remaining course of our lives.

Solution

The immersive and protean nature of virtual reality gives it the great potential power of training the human brain to operate in a desired way, at the ideal time.

The initial idea behind the WAVR project was to determine the potential effectiveness of virtual reality in brain training and find out whether it would be possible to significantly improve brain performance through neuroplasticity and virtual reality.

How It Works

Concept Statement

"WAVR is a brain-controlled VR technology that uses biosensors to monitor the fluctuations in alpha and beta waves. The brainwave data triggers commands on the VR application, allowing the user to control virtual objects with their mind.

In addition to virtual reality, WAVR engages other physical senses through a vibrating chair, a fan blowing cool air and wafts of perfume." –nyu.edu

How It Works

User Journey

Spectator puts on the WAVR headset, sits on the stool and is asked to try and meditate.

Spectator is virtually placed in a landscape with a beautiful lake view. The water is still and the sky is a bit cloudy, but there is no rain or fog.

Setup Diagram

The EEG microcontroller on the back of the headset detects and records the initial brainwave frequency of the spectator via the attached biosensors. At this stage, the average person produces brainwaves at a frequency between 12-15 Hz. (Lo-Beta)

The VR environment starts to evolve depending on the changing brain activity of the spectator.

The EEG data is delivered to the VR application through Max/MSP.

If the spectator manages to go into a meditative state, the recorded brainwave frequency drops below 12 Hz (Alpha) triggering a command on the VR application that makes the clouds in the sky dissolve. The sun then gets brighter and new plants start to flourish on the banks of the lake.

If the spectator fails to go into a meditative state and starts thinking faster than before, the brainwave frequency goes above 15 Hz (Beta), triggering a command that makes dark clouds start covering the sun and it eventually starts to rain. If the brainwave frequency stays between 12-15 Hz (Lo-Beta), the VR environment does not change.

Spectator experiences changes in their physical environment if they manage to go into a deep meditative state or get too anxious.

If the spectator fails to relax, gets anxious and the brainwave frequency goes above 22 Hz (Hi-Beta), Max sends a command to the Arduino Uno that activates the vibration engine attached to the chair they are sitting on. The physical vibration imitates the feeling of an earthquake.

Events & Press

If the spectator manages to go into a deep meditative state and their brainwave frequency drops below 8 Hz (Theta), Max triggers a different command on the same Arduino Uno, which activates the fans and the scent machine placed in front of them. These two working together imitate the feeling of a soft breeze and the beautiful smell of spring flowers.

At the end of the experience, the application calculates the concentration score of the spectator, based on the difference between the recorded brainwave frequency and the ideal frequency at certain checkpoints throughout the experience. The level of improvement in the percentage of the spectator's self-controlled brain activity is determined by comparing the concentration scores recorded after multiple attempts.