What you need to know
- The Brain Team at Google Research outlined a new type of chatbot in a paper published earlier this week.
- Named Meena, this virtual talker was explicitly designed to address chatbots' seeming inability to understand the broader context of conversations.
- It can also be funny, sometimes.
Meena, what Google Brain's research team so callously described as a "multi-turn open-domain chatbot" — she's got feelings, people! — could just be the next generation of chatbot. And perhaps your next best friend.
The paper describes the flaws with the current generation of chatbots as follows:
Trained on 40 billion words mined from the valleys of Twitter and Facebook, Meena was explicitly designed to be contextually aware of not just some specific customer support tasks but rather the ongoing conversation as a whole and the world at large. To ensure Meena was smarter, and funnier, than those 'other chatbots,' Google's team coined two new metrics for testing itsperformance.
These being perplexity, which automatically generates data on the ability of a chatbot to understand a conversation, and Sensibleness and Specificity Average (SSA), which relies on humans to give their input on how well the AI performs in a conversation.
In other news, I'm more boring than a chatbot, because all my conversations end with a "That's nice."
Getting back to Meena, what's the end result of all that geeky end-to-end neural network training? Meena is not only far more human-like in its conversations than its counterparts, but she's also funny.
And a budding philosopher, apparently.
That joke, by the way, was all Meena and officially makes her funnier than me. Whoever said chatbots are dumb and robotic?
Overall, Google was able to hone Meena to an SSA rating of 79%. That's particularly impressive given that it's not only 23% better than its closest competitor but, more importantly, it's also within spitting distance of the 86% score that was associated with humans.
If you'd like to get into all the nitty-gritty of how Google made Meena, you can read the 38-pages-long paper here.
Get the Android Central Newsletter
Instant access to breaking news, the hottest reviews, great deals and helpful tips.