What you need to know
- Google's AI team this week took to blogging about how they implemented Motion Sense in the Pixel 4.
- The technology underpinning the feature is called Soli, a short-range radar sensor.
- In addition, Google used the power of AI and machine learning to allow the phone to understand a user's gestures and movements.
One of the Pixel 4's most exciting innovations is Motion Sense, which allows you to interact with the phone using only hand gestures, all without touching the phone at all. Google's AI blog this week documented the technologies and processes its engineers used to bring the feature to market.
As the company's Jaime Lien and Nicholas Gillian explain, powering Motion Sense is a short-range radar sensing system that Google calls Soli. And while radar itself has existed in some form for more than a century, what makes the Pixel 4 unique is that it's the only example of such a system being integrated into a consumer device.
How Soli works is as follows: the radar module emits radio waves that are then reflected off of surrounding objects and back to the sensor. Using the properties of the reflected waves, the module can detect things like distance and size.
The most interesting thing about Soli, though, is the fact that Google's custom algorithms allow for the Soli module to perceive motion around the phone without actually generating a detailed image of the objects around it. Not only is that good for privacy — because your face, for example, is not captured — but it's also what allowed Google to shrink the whole thing to fit in the top of a phone.
Here's a look at what that process looked like, as the company iteratively shrunk the desktop-sized prototype to its current size:
Reducing the system's size so that it could fit in a phone wasn't the only challenge the team faced. They also developed new techniques to deal with the signal deterioration from audio signals near the Soli radar. Those innovations are why you can continue using Motion Sense even while listening to music.
The end result is seen below, which gives a visual representation of what Soli "sees":
Note that the axes are not actually 2-dimensional space. Instead, they represent the radial distance from the sensor, as well as the velocity of approach toward the phone, but I'll leave those technical details for the actual experts. You can read the blog post in full here, and if you're academically curious, also check out this research article by the team behind Soli.
Lien and Gillian end the post by promising to continue working on exploring novel applications for a miniature radar system in a phone, and I, for one, can't wait to find out what they come up with next!
We may earn a commission for purchases using our links. Learn more.
I turned off my phone for a day and it was the best decision I made in 2020
The internet is great and useful for so many things. But a day without it was like a reboot inside me. You should try it.
Review: Dyson Pure Humidify + Cool is an incredible three-in-one system
Dyson's latest product combines a fan, air purifier, and humidifier into a single unit. The Pure Humidify + Cool has a premium design, delivers outstanding performance at both purification and humidification, and is an ideal product for the new work-from-home normal.
Don't delete your Oculus Facebook account if you want to keep your games
Nowadays, your Facebook account is your Oculus account. Make sure you don't delete it if you want to keep your games.
Ditch the wires with these Pixel 4 charging pads
Wireless charging on the Pixel 4 doesn't have the same caveats as the Pixel 3, and that means you can get a fast wireless charger without breaking the bank!