Thousands of Amazon employees are listening to your Alexa conversations

Alexa is installed on over 100 million devices around the globe, acquiring billions of user queries in the process. Like all digital assistants, Alexa relies on data models to offer better responses, but it looks like Amazon also gave the digital assistant a helping hand in the form of human reviews. An investigation by Bloomberg has revealed that Amazon has a global team that transcribes and annonates Alexa recordings from around to world to "eliminate gaps in Alexa's understanding of human speech" and allow the assistant to serve up better responses to your queries.

The publication found that Amazon employs thousands of people around the world — both contractors and full-time employees — to review Alexa recordings, with teams spread out across Boston, Costa Rica, India, and Romania. According to an unnamed source, each reviewer parses over 1,000 audio clips over a nine-hour shift, annotating them and feeding them back to the system to improve Alexa's responses. From Bloomberg:

One worker in Boston said he mined accumulated voice data for specific utterances such as "Taylor Swift" and annotated them to indicate the searcher meant the musical artist.Occasionally the listeners pick up things Echo owners likely would rather stay private: a woman singing badly off key in the shower, say, or a child screaming for help. The teams use internal chat rooms to share files when they need help parsing a muddled word—or come across an amusing recording.

The publication also found that employees come across recordings that are of a disturbing nature:

Sometimes they hear recordings they find upsetting, or possibly criminal. Two of the workers said they picked up what they believe was a sexual assault. When something like that happens, they may share the experience in the internal chat room as a way of relieving stress.Amazon says it has procedures in place for workers to follow when they hear something distressing, but two Romania-based employees said that, after requesting guidance for such cases, they were told it wasn't Amazon's job to interfere.

The recordings don't have a user's full name or address, but they do include the user's first name, an account number, and the device's serial number. Amazon has previously mentioned that it relies on natural language processing to train Alexa, but it has admitted to Bloomberg that it uses a human element to annotate a "small sample of Alexa voice recordings:"

We take the security and privacy of our customers' personal information seriously. We only annotate an extremely small sample of Alexa voice recordings in order to improve the customer experience. For example, this information helps us train our speech recognition and natural language understanding systems, so Alexa can better understand your requests, and ensure the service works well for everyone.We have strict technical and operational safeguards, and have a zero tolerance policy for the abuse of our system. Employees do not have direct access to information that can identify the person or account as part of this workflow. All information is treated with high confidentiality and we use multi-factor authentication to restrict access, service encryption and audits of our control environment to protect it.

It's not just Amazon that's turning to humans helpers to develop its digital assistant. Bloomberg found that Apple also has a human team that checks whether Siri's interpretation of requests matches what was asked by users. Google has reviewers that train Assistant, but the clips don't have any personally identifiable information and the audio itself is distorted to prevent any identification.

Have you listened to this week's Android Central Podcast?

Android Central

Every week, the Android Central Podcast brings you the latest tech news, analysis and hot takes, with familiar co-hosts and special guests.

  • Subscribe in Pocket Casts: Audio
  • Subscribe in Spotify: Audio
  • Subscribe in iTunes: Audio (opens in new tab)
Harish Jonnalagadda
Senior Editor - Asia

Harish Jonnalagadda is a Senior Editor overseeing Asia at Android Central. He leads the site's coverage of Chinese phone brands, contributing to reviews, features, and buying guides. He also writes about storage servers, audio products, and the semiconductor industry. Contact him on Twitter at @chunkynerd.

  • Crazy to think about. but glad Amazon knows that their eavesdropping isn't a legal way to interfere.yet. Even in criminal events. Must be stressful not being able to call authoritiesvwhen they feel they could save someone. I figure in time "big brother " will be in all our homes. And because we put him there.
  • Not in my house
  • This is why I don't use voice assistants, period. Especially a smart speaker. Smart speakers are listening 24/7 so long as they are plugged in and connected. I am not doing anything that interesting in my home, however, it's creepy. I also get a kick out of how tin foil hat folks from both political perspectives decry "government surveillance" yet have voice assistants in their homes, carry a 24/7 monitoring device on their persons (mobile phone), publish their life events on social media, and internet connected cameras in their homes, etc.
  • Exactly. People want their privacy and to give out as much personal info as possible to the masses. Just be good people and worry less.
  • Smart speakers are listening 24/7 but they aren't relaying 24/7. They only relay to the company if the hotword is recognized. Otherwise, there'd be a lot of music, radio chatter, tv, and other things that'd needlessly consume bandwidth.
  • It's tech -- it has bugs, it can be hacked, it can fail, and it's ALWAYS listening...Do you really BELIEVE that it never inadvertently listens??? Nation states have the ability to turn on mobile phones microphones with malware....are you naive enough to think they don't have the means to do so with smart speakers and internet connected cameras???
  • So we should don't develop new technology because it has bugs and they might get your private information? What the article reports here is human intervention to increase the accuracy of Alexa's voice recognition. How else are they going to improve it?
    Like it or not all these AI technologies are the future, we are only starting.
    This reminds me some years ago, when people complained they didn't have accurate traffic data in Google Maps or Waze, but at the same time they refused to share their driving information. How do they expect accurate data if no one is sharing their data?
  • Probably contracted employees from other countries
  • Said in the article if you choose to read it. " with teams spread out across Boston, Costa Rica, India, and Romania." Funny how they list a city name then three countries.
  • If someone is being murdered or raped, Alexa's job is not as a conduit to alert authorities; it's to let the perpetrator order cleanup materials easily.
  • That's why I'll never use those stupid assistents. Amazon, Google etc. collect enough data already. I don't have any use for listening spy devices in my home. But people getting more lazy and stupid by the day so they deserve what's coming!
  • What's coming? You think you can stop it?
  • Big Brother and the Holding Company.
  • If there are indeed "thousands of Amazon employees" sitting around listening to my Echo/Alexa devices (I have one in every room) I feel sorry for them.....they are going to be extremely bored!