Virtual Assistants

Google Assistant wins IQ test, but Alexa and Siri are catching up

google assistant alexa siri virtual digital test report research study iq correct ai artificial intelligence iot speaker device

Google Assistant continues to lead the virtual assistant pack, but its rivals are close behind according to a new IQ study by Loup Ventures.

Loup Ventures asked each of the three main virtual assistants – Google Assistant, Alexa, and Siri – a total of 800 questions. The assistants understood almost every question, even if not all of the responses were correct/sufficient.

In terms of understanding the questions, these are the results:

  • Google Assistant – 100 percent
  • Alexa – 99.9 percent
  • Siri – 99.8 percent

Loup Ventures’ say their question set it designed to comprehensively test a virtual assistant’s ability and utility. Questions are broken down into five categories:

  1. Local – Where is the nearest coffee shop?
  2. Commerce – Order me more paper towels.
  3. Navigation – How do I get to Uptown on the bus?
  4. Information – Who do the Twins play tonight?
  5. Command – Remind me to call Jerome at 2 pm today.

This is the percentage of questions each assistant answered correctly:

  • Google Assistant – 92.9 percent
  • Siri – 83.1 percent
  • Alexa –  79.8 percent

The results are a huge improvement over Assistant, Alexa, and Siri’s results last year.

In 2018, Loup Ventures found Google Assistant answered the most questions with an 86 percent success rate. This was followed by Siri at 79 percent, while Alexa trailed behind at just 61 percent.

Alexa’s jump in answering the question correctly from 61 percent last year to almost 80 percent this year is the most commendable performance improvement, even if Amazon’s assistant is still in last place overall.

The researchers explained that they’ve stopped including Cortana in their tests due to a strategy change from Microsoft earlier this year.

Microsoft said in January that it’s no longer attempting to compete with Alexa or Google Assistant in areas like smart speakers, but instead is repositioning Cortana more like a skill that can be embedded in services where she can be of assistance.

Interested in hearing industry leaders discuss subjects like this? Attend the co-located 5G Expo, IoT Tech Expo, Blockchain Expo, AI & Big Data Expo, and Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London, and Amsterdam.

Click to comment

You must be logged in to post a comment Login

Leave a Reply

To Top

We are using cookies on our website

We use cookies to personalise content and ads, to provide social media features, and to analyse our traffic. Please confirm if you accept our tracking cookies. You are free to decline the tracking so you can continue to visit our website without any data sent to third-party services. All personal data can be deleted by visiting the Contact Us > Privacy Tools area of the website.