The Cleo Alexa Skill is Helping Alexa Learn the Languages of India
Today, Amazon India launched the Cleo skill for Alexa in India. Cleo’s goal is to learn new languages and dialects across the world. Amazon’s India launch of Cleo intends to help the Alexa AI learn Hindi as well as other Indian languages and dialects. This includes Tamil, Marathi, Kannada, Bengali, Gujarati, Telugu, and more. The skill currently supports French and German in addition to American, Australian, British, Canadian, and Indian dialects of English. The description of the app on the Alexa skill store encourages users to help Alexa learn:
“You love learning new things from Alexa and now it’s your turn to help her learn! Do you speak a language that Alexa doesn’t understand? Cleo is your opportunity to share more about that language and culture with Alexa.”
Alexa prompts Cleo users in English and allows you to respond in your chosen language or dialect. The app encourages frequent user interaction with the ability to earn badges and rankings, like playing a game. Alexa will ask you to say at least five things in your language each round. Sometimes she will provide a specific prompt, or she may ask you to speak anything at all in your language.
Ramping Up the Language Model
Amazon has a built-in disadvantage compared to Apple and Google when it comes to global language abilities. Siri today supports 21 languages in 36 countries. As of late 2017, Google listed automated speech recognition (ASR) capabilities for 119 language and localized dialects. These language model assets didn’t appear overnight. Siri was launched in 2011 and Google has had speech recognition solutions on mobile at least since 2012. Google announced in November 2017 when it added 30 languages to its ASR assets such as Khmer, Urdu and Ghanan English that:
“To incorporate 30 new language varieties, we worked with native speakers to collect speech samples, asking them to read common phrases. This process trained our machine learning models to understand the sounds and words of the new languages and to improve their accuracy when exposed to more examples over time.”