YouTube 360 Version: Featuring the first streaming experience ever to utilize 3D spatial audio on YouTube
EDEN's 'Drugs' is a VFX heavy Virtual Reality music video, featuring DepthKit volumetric performance capture, stereoscopic 3D plate shots, point cloud data inclusion, and heavy CGI. All these elements were used to build up a picture of the inner thought process that brings to life the mystery of the artist, EDEN. It also contains a sprawling spatial audio mix that was created for a complete sensory experience, a YouTube first.
Dust to dust. This was the first thought behind this project's concept. Director Stuart Cripps wanted to create an experience where the viewer could watch memories or thoughts form inside the artists' head. "The idea was to portray thoughts, emotions or feelings in a VR space, kind of like being inside the singers head able to see what he is thinking and singing about, I am drawn by the idea that the thoughts or memories are bare bones, sketches, not all the info is there, so point cloud or mesh makes sense visually to me, they appear and disappear with an organic fluid quality. Theres a loose narrative driven by the lyrics which have a poetic feel I wanted to compliment and build on. Its very much open to the viewer to draw meaning from the visuals its not about drugs in the literal sense, its touches on themes such as the addictive hold of certain behaviour, theres something more here than meets the eye". The artist is EDEN, a Dublin-based electronic music producer and singer-songwriter otherwise known as Jonathon Ng. EDEN created his recent EP "i think you think too much of me" alone in his bedroom. It showed a poetic candidness inspired by artists such as Frank Ocean. It also included our song "drugs." The woozy desperation in this song shows him reflecting on hurting somebody who loved him. Perhaps the drugs are simply a metaphor, or perhaps they are what hurt this relationship in the first place.
Canon 5D MK III + Kinect V2 Depthkit Rig
In EDEN's "drugs" VR experience, we take the viewer on a visceral journey led by the music, which was abstracted into stunning visuals by filming and scanning performers using the DepthKit, a one stop solution to motion capture using a camera / depth sensor rig. Andrew has used this technology on several projects before, but this marks the very first time it has finally been incorporated into a fully pre-rendered VR experience. The DepthKit allowed Andrew and the team to capture, edit, and process 3D volumetric video of our actors and dancers. This means that once a scene was filmed, we then had the ability to fly virtual cameras around the actors, change angles, and add beautiful motion design and other effects to that same data. The SLR camera captures the texture and color of the performers, and the sensor captures the 3D data. After, using DepthKit software, the two feeds are blended together in the visualizer.
In this project, the choice was made to use only the colored point clouds and wireframes from the data in the end. However, the aesthetic possibilities really do become endless with the scans obtained, as creatives can modify the model and texture in any way they'd like. Once everything was captured on set, they were beautified and ingested by Skulley Effects into the environment and experience they also created.
DepthKit is currently in a closed beta for filmmakers and creatives. For more information, head to their website here.
Tying into EDEN's new tour kick off, EDEN unveiled the experience, developed and distributed by SAMO in partnership with Scooter Braun's SB Projects. The video is available in VR and 360 on Facebook and on EDEN’s YouTube channel where the experience will utilize not only the 360 video feature but also YouTube’s newly available spatial audio capabilities. YouTube has launched the spatial audio feature that is currently available on desktop and Android. The “drugs” VR Experience will be the first experience ever to utilize this feature on the web. The video can also be viewed in VR on Oculus, Milk VR, Jaunt, VRideo, Discovery, Littlstar, Napster and Hulu.
Wired Magazine - Music's Salvation Might Be Selling Not Songs, But VR
"Cripps and his crew shot with a strange-looking rig: a Canon 5D on top of a Kinect, which together capture real-time three-dimensional data using beta software created by a New York company called DepthKit. The resulting aesthetic is pure wireframed data, like a glitchy Tron landscape crossed with Star Trek’s Holodeck. At one point the picture floats over a mesh surface, panning down and out until you realize it’s an outline of a person playing the keyboard."
Our Wonderful Crew
Production Company: SAMO VR (previously Waves VR)
Producers: Craig Bernard, Sara Mora Ivicevich
Director: Stuart Cripps
DepthKit Operator / Volumetric Direction: Andrew Gant
Visual Effects and VR Construction: Team at Skulley Effects
Spacial Audio Mix: Tim Gedemer / Sourcesound
DepthKit Special Thanks: James George, Alexander Porter, Kyle Kukshtel