Not all public cloud service providers are the same when it comes to network performance.
Each one’s connectivity approach varies, which causes geographical discrepancies in network performance and predictability. As businesses consider moving to the cloud, especially software-defined wide-area networks (SD-WAN) and multi-cloud, it is important to understand what each public cloud service provider brings to the table and how they compare.
In 2018, ThousandEyes first conducted a benchmark study assessing three major public cloud providers: Amazon Web Services (AWS), Microsoft Azure (Azure), and Google Cloud Platform (GCP). The study gathered data on network performance and connectivity architecture to guide businesses in the planning stage.
This year’s study offers a more comprehensive view of the competition, with two more providers added to the list: Alibaba Cloud and IBM Cloud. It compares 2018 and 2019 data to show changes that took place year-over-year and what triggered them.
ThousandEyes periodically collected bi-directional network performance metrics – such as latency, packet loss and jitter – from 98 user vantage points in global data centres across all five public cloud providers over a four-week period. Additionally, it looked at network performance from leading US broadband internet service providers (ISPs), including AT&T, Verizon, Comcast, CenturyLink, Cox, and Charter.
The network management company then analysed more than 320 million data points to create the benchmark. Here are the results.
Inconsistencies among providers
In its initial study, ThousandEyes revealed that some cloud providers rely heavily on the public internet to carry user traffic while others do not. In this year’s study, the cloud providers generally showed similar performance in bi-directional network latency.
However, ThousandEyes found architectural and connectivity differences have a big impact on how traffic travels between users and certain cloud hosting regions. AWS and Alibaba mostly rely on the internet to transport user traffic. Azure and GCP use their private backbone networks. IBM is different from the rest and takes a hybrid approach.
ThousandEyes tested the theory of whether AWS Global Accelerator out-performs the internet. AWS Global Accelerator launched in November 2018, offering users the option to utilise the AWS private backbone network for a fee instead of the default public internet. Although performance did improve in some regions around the world, there were other instances where the internet was faster and more reliable than AWS Global Accelerator.
Broadband ISPs that businesses use to connect to each cloud also showed inconsistencies, even in the mature US market. After evaluating network performance from the six US ISPs, sub-optimal routing results were recorded, with up to 10 times the expected network latency in some cases.
Location, location, location
Cloud providers commonly experience packet loss when crossing through China’s content-filtering firewall, even those from the region like Alibaba. The 2019 study closely examined the performance toll cloud providers pay in China, which has a notoriously challenging geography for online businesses. For those with customers in China, ThousandEyes recommends Hong Kong as a hosting region since Alibaba Cloud traffic experienced the least packet loss there, followed by Azure and IBM.
In other parts of the world, Latin America and Asia showed the highest performance variations for all cloud providers. For example, network latency was six times higher from Rio de Janeiro to GCP’s São Paulo hosting region because of a suboptimal reverse path, compared to other providers. But across North America and Western Europe, all five cloud providers demonstrated comparable, robust network performance.
The study’s results confirm that location is a major factor, therefore, user-to-hosting-region performance data should be considered when selecting a public cloud provider.
Multi-cloud connectivity
In 2018, ThousandEyes discovered extensive connectivity between the backbone networks of AWS, GCP, and Azure. An interesting finding in this year’s study shows multi-cloud connectivity was erratic when IBM and Alibaba Cloud were added to the list.
ThousandEyes found IBM and Alibaba Cloud do not have fully established, direct connectivity with other providers. That is because they typically use ISPs to connect their clouds to other providers. AWS, Azure, and GCP, on the other hand, peer directly with each other and do not require third-party ISPs for multi-cloud communication.
With multi-cloud initiatives on the rise, network performance should be included as a metric in evaluating multi-cloud connectivity since it appears to be inconsistent across providers and geographical boundaries.
ThousandEyes’ comprehensive performance benchmark can serve as a guide for businesses deciding which public cloud provider best meets their needs. But to err on the side of caution, businesses selecting public cloud connectivity should consider the unpredictable nature of the internet, how it affects performance, creates risk, and increases operational complexity. Businesses should address those challenges by gathering their own network intelligence on a case-by-case basis. Only then they will benefit fully from what cloud providers have to offer.
IDG News Service
Ltd
