What you need to know
- Google is training its AI to create depth maps isolating human subjects in the scene using only one camera.
- As a starting point, Google used 2000 YouTube videos from the Mannequin Challenge to train the AI.
- The results will lead to the ability to add effects to videos, such as portrait mode, and be used for Augmented Reality.
In a recent blog post, Google detailed how it has been working on depth perception in videos where both the camera and subject are moving. As a starting point, the study needed access to a vast amount of data to train the AI, and the first logical step was training it to detect people in a scene where the camera was moving but the people were static.
As it turns out, Google had the perfect resource for this data in the form of YouTube videos that were filmed for the Mannequin Challenge. In this challenge, a person or group of people would stand completely still as a camera panned around their position. Google used 2000 videos from the challenge to help train its AI to detect human figures in a variety of different scenes.
Something that makes this study even more interesting is the fact that Google is teaching its AI to create depth maps using footage that has been shot using only one camera. Most times, multiple cameras must be used to sense depth information in a scene.
Google already utilizes something similar for still images to create its portrait mode effect on the Pixel phones. However, this only pertains to still images. The new method Google has been developing is training its AI to create a depth map where both the camera and subject are moving within a scene.
By branching out into videos, it will open up features in the future for creating bokeh in video scenes similar to portrait mode on your phone. Another benefit to come from this study will be improved results for augmented reality, such as the Playmojis from Google's Playground.
Another possibility will be the generation of 3D images from 2D scenes. While camera hardware has always been essential for photography and videography, what Google has done over the years with software shows that, in the future, algorithms will be just as important and help provide new experiences.
We may earn a commission for purchases using our links. Learn more.
Everything you need to know about the OnePlus 8 and OnePlus 8 Pro
The newest OnePlus phones are here. Whether you want to read our full review, get familiar with all the specs, or anything else in between, here's everything you need to know about the OnePlus 8 and OnePlus 8 Pro!
Daily COVID-19 updates: Global phone sales fall by 20% in Q1 2020
COVID-19 has caused untold devastation around the globe, with entire industries shutting down in the wake of the virus. Here's how coronavirus is affecting the tech industry.
Samsung’s Galaxy S20 series starts getting the June 2020 security update
Samsung has started rolling out the latest June 2020 Android security patch to its Galaxy S20, S10, and Note 10 series smartphones. Currently, however, the update is only available for the U.S. unlocked versions.
Take your PS4 gaming to new heights with these awesome arcade pads
Looking to step your game up in the world of fighting games? An arcade pad is one of the best ways you can slay the competition.