Google Assistant is now more important than your Android phone ever will be

Google Nest Hub
Google Nest Hub (Image credit: Android Central)

We saw some big announcements from Google about new features for Google Assistant that add a ton of functionality through deep integration with the rest of the apps on your phone, but possibly the biggest news was talked about the least — Assistant has truly broken out and ready to take on the rest of the digital world.

The most obvious ways this is happening surround Google's Nest Hub and other smart displays. New tools for educational use and ways to offer better choices or better entertainment are obviously going to be a focus when you're talking about a device that is really just a window into your Google account and content to consume.

Assistant is a better personal assistant when it goes everywhere with you.

Likewise, the new Chromecast with Google TV or the new Nest Audio are content consumption styled devices, but they too will benefit from new features like being able to detect the doorbell ringing or a leaky pipe (that's super-cool). But I think the most impactful features, the ones that we'll notice really do make a difference, are how all of this is expanding into the internet — both the "of Things" kind and the internet we just use all of the time without realizing it.

Assistant Custom Intents

Source: YouTube (Image credit: Source: YouTube)

Features like Google login integration through Assistant or vertical custom intents — where you tell an app to do a custom action the developer has implemented — are also great with a PWA (Progressive Web App). When done right, these integrations mean it's no longer tied to an app on your phone.

Assistant will always be prioritized with your Android phone in mind, but it can branch out.

The idea of telling an app on your phone to order your favorite smoothie from your favorite smoothie bar is cool. Moving that into being able to tell a smart speaker or your TV to do the same thing is even cooler. The idea of saying it to the webpage with the menu in front of you changes the whole experience, same for ordering it from the scrolling marquee in the window of an adjacent bookstore or the screen on the seat in front of you at a sporting event (whenever we can have those again). These examples aren't necessarily better than using Assistant on your phone, but they are different.

Using Assistant to recognize who you are, the context of what you're saying, and it being able to act on what you say once the recognition part is done is known as ambient computing — you're connected everywhere, to everything, all of the time.

The idea itself makes most of us a bit uneasy. It should because if things are not done the right way, it is an actual privacy nightmare that should make you wake up in the middle of the night drenched in sweat. It's nigh impossible to work right 100% of the time, and when things don't work, the potential for abuse is really high.

Ambient Display

Source: Android Central (Image credit: Source: Android Central)

We all know what Ambient Display is, but the easy way to think of ambient computing is to look at how Google Assistant's voice match works. Your phone (or your smart display or other Google Assistant device) can "voiceprint" the way you speak. It's definitely not 100% accurate 100% of the time, but when the conditions are right it just works exactly the way it's described. This is how you can ask for your agenda or ask to make a Duo call on a shared device in your living room.

The important part of ambient computing is the sounds that aren't your voice.

For years Google has been interested in ways to improve ambient computing and much of that has been based around sounds that are not your voice. Seeing that Google has devised a way for your Nest Mini to let you know your toilet is overflowing or your dogs are barking means Google is getting better at analyzing the background sounds without transmitting any data back to any Google servers. Your phone or your Nest device or even your Chromebook could be listening and processing all this data to check that you are really you and you're in a place where you are expected to be while asking for something.

None of this data is saved or sent anywhere once it's processed and you're authenticated, but Assistant can have a very high level of confidence that it's really you so when you do ask it to do a thing, it can do it on your behalf.

Nest Audio

Source: Daniel Bader / Android Central (Image credit: Source: Daniel Bader / Android Central)

That's still pretty scary, I admit. And right now, I don't think the digital brains behind Assistant are there yet. But this is the path we're heading down. It's a path where the steps can be very small. Today, Assistant is more ambient focused and new features are built that make it more functional; if I'm at work and my dogs are barking, my Nest Speaker can send me a message. Tomorrow, the same thing could happen, but I also can pull a live feed from a smart camera. The next step could involve interaction through a smart doorbell or a call to emergency services if needed, or my face and voice on a Nest Hub telling my dogs to shush.

Privacy still needs to be the most important thing about ambient computing.

There are plenty of ways to keep developing the tech without it becoming invasive on the privacy front. Once it's all good enough, we can be given the chance to opt into something like using Google Pay through Assistant at a smart terminal or telling our car stereo our Starbucks order while we're driving. We just need to be sure that the tech isn't easy to hack and that our privacy is respected.

This whole idea could just fail, too. Nothing about future tech is written in stone and for every good idea we're using today, hundreds of other good ideas failed and were rejected. I just think it's exciting to see a small glimpse of what things could be. The next few years of work on ambient computing are going to be fun to watch, even if we never get to try any of it.

Nest Hub Max

Google Nest Hub Max

If you're going to end up streaming through a smart display, you may as well go big or go home. The Nest Hub Max comes with a great speaker, a roomy display, and quick gestures that make Netflixing in the kitchen less messy than it should be.

Jerry Hildenbrand
Senior Editor — Google Ecosystem

Jerry is an amateur woodworker and struggling shade tree mechanic. There's nothing he can't take apart, but many things he can't reassemble. You'll find him writing and speaking his loud opinion on Android Central and occasionally on Twitter.

7 Comments
  • Just got my Google Chromecast, and I'm super excited to fire it up .
  • I never use it.
  • With AI now able to analyze existing voice recordings to generate a super realistic Text-to-Speech deepfake of anyone's voice I can see this being easily abused. Imagine a thief outside your home window within earshot of your smart speaker playing back in *your* voice "Hey Google, open the front door".
  • I will wait until the US gets done breaking google apart to see how useful this really is. Like many have already said this is a security nightmare.
  • Didn't even need to read the article to know it is full of crap! NO assistant of any kind is of any value to many people! I am NOT going to talk to my phone, or some listening speaker sitting on my coffee table, in private much less in public. This is NOT Star Trek...computer? computer? will you butter my toast please?
    I am really starting to doubt the qualifications of the writers of many so-called tech articles. They keep passing themselves off as "experts" when they're more likely just beer drinking id10t$. No offense to any true beer drinking ID10T$! SMH
  • I started reading the article and after about 5 paragraphs I thought, "hmm...this sounds like a Jerry Hildenbrand". I always enjoy reading Jerry's well thought-out and writtnen, articles. I have a Nest Hub and Nest Hub Max as love them both. I'd love new features.
  • ...and shy of Chinese controlled companies, Google is the last one I'd trust with my data in any way resembling this! And in any case, I just can't see myself having any need for a digital assistant trying to predict my favoured milkshake flavour of the day... I agree with John above, though - Jerry's articles are always interesting and thought-provoking!