Inteligence

How to spot vendor AI-washing

Pro
(Image: Stockfresh)

28 February 2018

New technologies generate new buzzwords. Cloud, fabric, bitcoin, blockchain, containers, microservices, and so on. Artificial intelligence (AI) as a technology and term has been around for decades, but only recently seems buzzworthy. Unfortunately, some vendors are associating the buzzword with their products without having any real AI. Or to be charitable, they stretch the limits of what can be considered AI. Maybe they do not really understand what AI is, or maybe the marketing team cajoled them into it. Either way, buyers need to be aware that many of the products claiming to have AI do not.

 “A key way to tell the difference between AI and rules-based engines, is that a rules-based engine will never improve on its own until someone updates the rules. AI improves its accuracy the more it is used. The more you use it the better it becomes. The adaptability of the model is what makes AI work”

Reviewing more vendors than usual, it appears they all think if they have the word AI in their product description, they will sell more of their product or service. When asked about how they are using AI, there are silences or descriptions that sound a whole lot more like rules engines.

Vendors who claim to have AI when they clearly do not is confusing customers. This is frustrating the vendors that have done the hard work to have real AI in their products. If you are a consumer or purchaser of computer security products, it can only help you to understand what AI really means.

AI and rules-based engines
This topic came up recently Yuri Frayman, CEO of Zenedge, and Laurent Gil, co-founder and chief product officer were being interviewed. At time of interview, Zenedge had been purchased by Oracle, and because of acquisition rules concerning silent periods, the two could not talk about Zenedge or their products.

This was a disappointment, as Zenedge is a computer security company with real AI, which was acknowledged. However, there followed some banter, cantered around the frustration of companies falsely claiming they are AI. It was an energetic discussion to say the least.

Frayman and Gil were asked what they felt the key difference was between rules-based engines and AI, because many vendors with hundreds of rules feel they have accomplished some sort of near version of AI.

“Rules-based engines,” Gil responded, “are like signature-based antivirus (AV). They already know what to expect. You’ve got a bunch of researchers looking at what has happened in the past, and based on that they write a bunch of IF-THEN rules that identify known malware. Rules are only as good as your research and what the hacker community is doing that you know about. Hackers don’t share ahead of time, so you are always behind.”

“True AI is about the future. AI says, ‘I don’t know what this is, but we’ve seen something similar so we will flag it.’ Or, ‘We’ve never seen this before, it’s an anomaly, so we will flag it.’ The key difference between rules engines and AI is where they are focused. Rules are IF-THEN decisions based on past data. AI is all about recognising anomalies simply because they are new. We are interested when the machine says, ‘I don’t know. I haven’t seen this before.’ This is when AI is the most powerful and useful,” said Gil.

“A key way to tell the difference between AI and rules-based engines,” said Gil, “is that a rules-based engine will never improve on its own until someone updates the rules. AI improves its accuracy the more it is used. The more you use it the better it becomes. The adaptability of the model is what makes AI work.”

Frayman strongly agreed. “Rules are basically in the past. The machine [AI] can predict the future.”

Frayman was asked what is the one question you would ask as a consumer to help determine if the vendor is being honest about whether or not they are using true AI? He replied, “I would ask how they would handle zero-day attack detecting and handling. They have no history. There are no rules you can write for the unexpected. The answer they give you will reveal whether their product is rules-based or AI-based.”

AI vs. AI is the future of hacking and defence
The next thing they said was surprising.

“The future of hacking [and defence] is machine versus machine,” said Frayman. “It sounds like Jules Verne’s stuff, but attackers are using AI to attack us, to get around our detection. It’s going to take machine learning and AI to fight back.”

Gil added, “Bots, good and bad, are already using AI to act like humans. They are changing their behaviour on the fly, using AI, to defeat protection and detection, so we need AI to fight back.”

These statements were a surprise, but at the same time, understandable. It is machine versus machine. If it is not there yet, it will not be long before that is the majority of activity between the good and bad in the computer world.

The machine-versus-machine idea has been playing out in the rules-based world for a long time. The VirusTotal site is very useful, as it allows you to submit the hash of any file you have and find out if it is marked as malicious by any of the dozens of antivirus software programs. One antivirus program might miss something, but dozens rarely do, or not for long.

Malware users
VirusTotal is very useful. Unfortunately, malware writers think so too. For a long time, they have automated the process of creating malware that is guaranteed to scan “clean” on VirusTotal. When it starts to get detected on VirusTotal, the malware auto-updates itself to avoid detection. This is machine versus machine in the rules world. Take the same concept and apply it to the AI-based world. It is already starting to happen, and pretty soon it will be how malware and badness works in our online world.

To be clear, this is not a worry about Skynet becoming self-aware, but we are entering a different, more sophisticated world of good versus evil in the online world. We are going to need better and more AI to defend ourselves.

Too many companies are claiming they have AI when what they really have is lots of rules and rules-based engines. AI is coming because we need it to fight the malicious AI that is being pointed our way. We just need to be clear about which companies have it now and which do not.

 

IDG News Service

Read More:


Back to Top ↑

TechCentral.ie