Category: Technical

ASW and Passthrough+ with NVIDIA Optical Flow

At Oculus we’re looking to pave the way for consumer augmented and virtual reality, defining the components needed to help both developers and users have the most immersive, enjoyable experience in VR. Today we’re going in depth on one of our recently announced technologies, Passthrough+. We will provide insights into how it works, powered by the NVIDIA Optical Flow SDK on Turing GPUs.

Read more: https://developer.oculus.com/blog/asw-and-passthrough-with-nvidia-optical-flow/

Making 3D Interfaces for Python with Unity3D

The following article discusses an implementation for using a Python backend and communicating with Unity via websockets to provide a visualization interface

Read more: https://hackernoon.com/user-interfaces-with-unity3d-and-python-eb2e7744518a

Another related article on Visualization using VR/AR:

https://towardsdatascience.com/dxr-bridging-2d-data-visualization-into-immersive-spaces-d77a20d5f9e9

Best way to prepare 3D movies for Quest

Original source: https://www.reddit.com/r/OculusQuest/comments/bmt29i/best_way_to_prepare_3d_movies_for_quest/

To connect the Quest to the PC use a cable like this

As for the 3D Bluray movies you will want to use MakeMKV to rip them to your PC.

When you select the Title in MakeMKV make sure to check the MVC-3D video as it is unchecked by default before you proceed with the rip.

Once the movie is ripped you will want to use BD3D2MK3D to encode it to be playable on the Quest.

In BD3D2MK3D to save space and get the audio working you will want to uncheck all of the audio and subtitle streams under 2. Select streams tab except for one of the DTS audio streams. Then at the bottom of the tab check the box to convert the audio to AC3.

You will be required to select a title under the 3rd tab. On the 5th tab you can choose between having the 3D movie use Half-SBS or Full-SBS by unchecking the Half- checkbox. Oculus Gallery supports Full-SBS but the file size is larger. For example I have these movies
Dredd Full-SBS = 6.9GB | Half-SBS = 2.6GB
Hugo Full-SBS = 6.4GB | Half-SBS = 3.5GB
Ready Player One Full-SBS = 7.9GB | Half-SBS = 4.2GB
Before clicking Do it! make sure to set the Temp directory to a folder on a drive that has enough space. The rip from MakeMKV and that folder are going to be very large usually 30+GB each.

After BD3D2MK3D finishes what it needs to do it will tell you to run the __ENCODE_3D_LAUNCHER.cmd in the folder that opens. This will take an hour or so depending on your PC specs to encode.

After the encode finishes you will have a mkv file of the Video that can be played on the Quest.

VR180 Creator

VR180 cameras allow creators to shoot three-dimensional, immersive photos and videos using affordable cameras that are small enough to fit in your pocket.

And to make it even easier for you to create and edit high quality VR videos, we’re launching VR180 Creator on Mac and Linux. This desktop tool lets anyone edit VR180 footage with existing VR video tools.

VR180 Creator currently offers two features for VR videos. “Convert for Publishing” takes raw fisheye footage from VR180 cameras like the Lenovo Mirage Camera and converts it into a standardized equirect projection. This can be edited with the video editing software creators already use, like Adobe Premiere and Final Cut Pro. “Prepare for Publishing” re-injects the VR180 metadata after editing so that the footage is viewable on YouTube or Google Photos in 2D or VR.

Read more; https://vr.google.com/vr180/apps/

Read more: https://www.blog.google/products/google-vr/introducing-vr180-creator-simple-video-editing/

Read more: https://www.reddit.com/r/OculusQuest/comments/c8ltpy/watching_iphone_galaxy_depth_photos_in_glorious/