NVIDIA Releases VRWorks Audio and 360 Video SDKs at GTC

Photo of author

At the GPU Technology Conference (GTC) in San Jose NVIDIA will have the public release of two VRWorks software development kits (SDKs) that will enable VR audio and real time 360० video stitching. And BTR is planning to go to San Jose for the GTC on Wednesday for Jensen’s keynote, so we will report on it here later this week.

NVIDIA is releasing publicly for the first time the VRWorks Audio SDK for real time ray tracing of audio in virtual environments and a plugin for VRWorks Audio in Unreal Engine 4. NVIDIA are also announcing and demoing for the first time an upcoming release of the VRWorks 360 Video SDK that enables stereo stitching in real-time. Using the power of two Quadro P6000 GPUs, NVIDIA is able to stitch eight 4k cameras in stereo and in real-time using Z CAM’s V1 PRO rig – which was introduced at SIGGRAPH, last year using two cameras.

NVIDIA is also releasing the first public beta of the VRWorks 360 Video SDK. Below is the press release quoted in full:

NVIDIA is making VR more immersive, and VR development easier, with the release of VR audio and 360-degree video stitching as part of our VRWorks software development kit.

Released at the GPU Technology Conference, kicking off today at the San Jose Convention Center, the VRWorks Audio SDK provides real-time ray tracing of audio in virtual environments, and is supported in Epic’s Unreal Engine 4. The VRWorks 360 Video SDK addresses the complex challenge of real-time video stitching.

VRWorks Audio for Physically Accurate Audio

Traditional VR audio provides an accurate 3D position of the audio source within a virtual environment. However, sound in the real world reflects more than just the location of the source — it’s also a function of the dimensions and material properties of the physical environment.

NVIDIA VRWorks Audio helps create a truly immersive environment by modeling sound propagation phenomena, such as reflection, refraction and diffraction. And it does so in real time, thanks to the massive processing power of GPUs.

Using NVIDIA OptiX ray-tracing technology, VRWorks Audio traces the path of sound in real time, delivering physically accurate audio that reflects the size, shape and material properties of the virtual environment.

It’s the only hardware-accelerated and path-traced audio solution that creates a complete acoustic image of the environment in real time without requiring any “pre-baked” knowledge of the scene. As the scene is loaded by the application, the acoustic model is built and updated on the fly. And audio effect filters are generated and applied on the sound source waveforms.

The software release consists of a set of C-APIs for integration into any engine or application, and an integration for Epic’s Unreal Engine 4 that’s now available on GitHub.

GTC attendees can visit the VR Village to experience a live demonstration of VRWorks Audio technology, as well as the SDK integrated into OPTIS’ HIM VR design application.

Come hear the difference!

VRWorks 360 Video for Real-Time Stitching

Also at GTC, we’re releasing the first public beta of the VRWorks 360 Video SDK, which enables real-time 4K 360 video capture, stitching and streaming.

In addition, we’re demoing an upcoming release of the VRWorks 360 Video SDK that enables real-time stitching in stereo. Using two Quadro P6000 GPUs, the SDK can stitch eight 4K cameras in stereo as demonstrated with Z CAM’s V1 PRO VR camera system.

“The fact that NVIDIA manages to stitch 4K 360 stereoscopic video in real time, making livestreaming possible, changes the production pipeline and enables entirely new use cases in VR,” said Kinson Loo, CEO of Z CAM.

The NVIDIA VRWorks 360 Video and Audio SDKs are available for all developers to download fromdeveloper.nvidia.com/vr. VRWorks 360 Video SDK for mono is available now as a public beta. VRWorks 360 Video SDK for stereo will be released soon.

Related links:

BTR will be live at the GTC on Wednesday and we will be giving a real emphasis on VR this year as we are currently benchmarking VR games using NVIDIA’s FCAT VR tool and video benching. Happy Gaming