Wanted: A world where virtual assistants help (without being asked)

Siri on Mac
Could Siri be coming to the Mac? Image: Macworld

Only two virtual assistants - those from Google and Facebook - can eavesdrop on your conversations. We need more of that to take the technology mainstream



Read More:

21 August 2017 | 0

Instead of fearing that artificial intelligence will replace us, we should be excited about how AI will help us.

In a perfect future, our AI virtual assistant will know what we’re doing, where we’re going and – most importantly – what we’re saying. They’ll know lots of other things, too. And when they sense we need help, they’ll whisper suggestions, ideas or facts into our ears, essentially giving us real-time knowledge as we go about our day.

As you’re walking from a parking garage to your meeting, your virtual assistant should give you turn-by-turn walking directions without you having to ask. As you shake hands before the meeting, your virtual assistant should remind you (without anyone else hearing), that you met the person four years ago at a conference. During the meeting, it should listen for potential questions and supply the answer.

When it hears, “Let’s meet up on this in October,” it should remind you that you’ll be away on business in October – so you can suggest November.

This future is delayed by two facts. The first is that virtual assistants and AI aren’t that good yet. And the second is that the public isn’t ready to be spied on all day by the companies that make virtual assistants.

The good news is that progress is being made on both fronts by Google and Facebook.

Google’s suggestion AI
Google this week rolled out a Chrome Web browser version of its Allo messaging app.

Each Allo account is tied to a specific phone number, and the smartphone using that number must validate the browser version with an on-screen QR code to enable its use. At the moment, only Android phones can validate, with Google promising an iPhone version shortly.

The browser version simply provides an interface for Allo on the phone. If your phone dies, goes offline or if you uninstall the mobile app, the browser version becomes unavailable. You can be logged into just one browser session at a time.

In some respects, Allo is an ordinary modern chat app. It offers ‘stickers,’ for example. But Allo also uses two forms of ‘suggestion’ AI.

Google’s Smart Reply, which uses neural nets to guess at the reply you might choose, works in both Allo and Google Inbox. Smart Reply pays attention to what’s being said, and offers relevant suggestions – in this case, of course, suggestions about how to reply.

The Google Assistant, which is a virtual assistant platform, is also available via Allo. You can type commands and queries just as you would speak them to a Google Home device. The Home also runs Google Assistant, as does Google’s own Pixel line of Android smartphones. The Web version of Allo represents the first availability of Google Assistant on the Web. Unfortunately, the Web version of Assistant does not support third party app integration.

The single most interesting aspect of Google Assistant in Allo (and the new desktop browser version) is that Assistant ‘pays attention’ to chat conversations, and occasionally suggests things. For example, if you start talking about pizza, it might suggest a nearby pizza joint.

Placing suggestion AI into a typed chat context simultaneously helps Google develop the technology to make it better, but also eases privacy concerns. Typed chats feel more private and formal than, say, something that listens to actual conversations and makes suggestions based on what it hears.

Google isn’t the only company offering suggestion AI.

Facebook’s suggestion AI
Facebook Messenger has a newish feature called M Suggestions.

Most reports and even Facebook announcements confuse M, which is an unreleased AI virtual assistant experiment project, with M Suggestions, which is a feature of Facebook Messenger that has been released in most English- and Spanish-speaking countries.

M is more of an umbrella project for Facebook to figure out how AI could enhance or augment social interaction at massive scale.

If you visit the help page for M and click on ‘How can I use M’ link, it will probably tell you ‘M isn’t currently available in your area. When it is, you’ll be notified in the Messenger app’. Only a tiny number of select users participate in the M experiment. Facebook M is not generally available in any country.

Everyone who uses Facebook Messenger in the US, UK, Canada, South Africa, Australia, Spain and Mexico does not automatically get access to M, but they do get access to M Suggestions.

M Suggestions can urge you to save Messenger conversations or remind you to wish somebody happy birthday when it’s their birthday.

Those preemptive suggestions are based on data. Others are based on the conversation you’re having. For example, if you say, ‘Want to call me?,’ M Suggestions will offer to place the call. M Suggestions can also offer to send money, share locations, coordinate meetings or conduct a poll – all based on the conversation.

The latest news is that M Suggestions also offers music suggestions via Spotify when you’re talking about music.

M Suggestions eavesdrops on the chat (it’s all text, so it’s not technically listening). However, reports by Bloomberg earlier this month indicate Facebook is working on at least two Amazon Echo-like virtual assistant appliance products that would presumably run Facebook M Suggestions. In that case, it could actually listen to conversations, then interject with spoken computer voice.

One rumoured version of a Facebook appliance has a screen, which could display suggestions quietly while you talk via audio or video.

As a social networking company, Facebook focuses both the larger M experiment, and also M Suggestions, on greasing the wheels of social interaction. It’s not about knowledge or productivity, but communication.

Mike Elgan, IDG News Service

Read More:

Comments are closed.

Back to Top ↑