The work presented in the new Nature report goes beyond simple scenes and addresses the primary limitations to existing non-line-of-sight imaging technology, including varying material qualities of the walls and surfaces of the hidden objects, large variations in brightness of different hidden objects, complex inter-reflection of light between objects in a hidden scene, and the massive amounts of noisy data used to reconstruct larger scenes.
In other words, you can view normal 2D film in 3D if:
- The camera moves horizontally at a somewhat constant speed
- No object in the scene is moving too fast compared to the speed of the camera
All that’s needed is to stitch together pairs of images that are a few frames apart. You might think there’s some complicated file format for 3D photos and videos, but most viewers will handle standard .jpg or .mp4 with the 2 images concatenated side-by-side.I used free software to create 3D files: ffmpeg to extract individual frames from video, a few lines of python and montage to create side-by-side images using a fixed number of frames difference, and ffmpeg to stitch the images back into a video. Then I transferred the video to my phone, placed it in a Google cardboard viewer, and voila, I was seeing it in 3D.
I was surprised by the level of detail in the 3rd dimension and by how real it looked. When you watch the 2D film you can still get some sense of depth because objects in the foreground move faster than those in the background, but when each eye gets a different image it’s completely different. For the scene in 12 Angry Men I used a 600ms offset to get the 2nd image (which was actually the left image because the camera was panning left), but I also tried half and double that and didn’t notice a major difference in how it looked.
Samsung Is Going All In. Samsung is one of the leading companies in the virtual reality space. Years of research into virtual reality are finally paying off for the company. At virtual reality conventions, Samsung's products are often regarded as one of the most popular, based on feedback from attendees. Currently, the Samsung Gear VR is the most popular virtual reality headset on the market. Things in the market might change in a few years, but for now Samsung is in the lead.
Crafting skyboxes using Neos VR
A tip if you want to view the image above with Google cardboard/daydream: you don’t need any special app — all you really need to do is display the image on your screen, turn off adaptive brightness and the screen timeout, and then stick your phone into the viewer.