How US enterprise networking is changing with a work-at-home workforce
As the coronavirus spreads, public and private companies and government entities are requiring employees to work from home, putting unforeseen strain on all manner of networking technologies and causing bandwidth and security concerns.
AT&T said its core network traffic – which includes business, home broadband and wireless – was up 24% through 30 March compared to the same day last month. It broke down some mobility traffic patterns as well: voice calls: +33%, instant messaging: +63%, text messaging: +41%, e-mail: -18%, web browsing: -5%, video: +4% (also accounts for over half of all mobility traffic). It also usage for conferencing: AT&T’s global audio-conferencing solution: +200%; audio, Web and video conferencing tools: +400%; large-scale webcast events: +200%.
AT&T said its investment in artificial intelligence technology is helping it keep up with demand. For example, the company said AI is helping remotely troubleshoot and diagnose problems with customer equipment, by identifying the cause or even proactively identifying a potential issue before it occurs. “We’ve expedited deployments of new AI capabilities in certain markets that will allow us to balance the traffic load within a sector and across sectors to help avoid overloading specific cells and improve the experience.”
DNS vendor BlueCat says it has been tracking the use of DNS over HTTPS (DoH) – a method of encrypting queries to prevent visibility into DNS traffic patterns. Over the last week through 27 March, the company said it has seen a massive increase in the use of DoH across its customer base wrote Ben Ball, director of strategy and content marketing at BlueCat in a blog about the trend. “In the course of a single weekend, the number of endpoints attempting to use DoH went from an average of 90 to about 1,400. That’s a 1,500% increase in the use of DoH. Around 45% of these queries are from Firefox (which now activates DoH by default).
“Aside from that, we’re seeing queries to eleven different DoH services from all kinds of applications. DoH usage is fairly uniform across our customer base as well – this isn’t one company or industry vertical; this is a broad trend. While we have not seen any clear indications that any of these queries are from DoH enabled malware, that is an emerging threat that we are tracking,” Ball stated.
Ookla’s SpeedTest shows mean download speed over fixed broadband declined only slightly in Mexico and the US when comparing the week of 23 March to that of 16 March, while a decline in Canada’s mean download speed over fixed broadband was more evident. Mean download speed over mobile was down in the US and Canada during the week of 23 March, while it rose slightly in Mexico during the same period.
Broadband watchers at BroadbandNow say users in most of the cities it analysed are experiencing normal network conditions, suggesting that ISP’s (and their networks) are holding up to the shifting demand. In a post the firm wrote: “Encouragingly, many of the areas hit hardest by the spread of the coronavirus are holding up to increased network demand. Cities like Los Angeles, Chicago, Brooklyn, and San Francisco have all experienced little or no disruption. New York City, now the epicentre of the virus in the US, has seen a 24% dip out of its previous ten-week range. However, with a new median speed of nearly 52 Mbps, home connections still appear to be holding up overall.”
Other BroadbandNow findings included:
- Eighty-eight (44%) of the 200 cities it analysed experienced some degree of network degradation over the past week compared to the 10 weeks prior. However, only 27 (13.5%) cities experienced dips of 20% below range or greater.
- Seattle download speeds have continued to hold up over the past week, while New York City’s speeds have fallen out of range by 24%. Both cities are currently heavily affected by the coronavirus pandemic.
- Three cities – Austin, Texas, Winston Salem, North Carolina and Oxnard, California – have experienced significant degradations, falling out of their 10-week range by more than 40%.
Cisco’s Talos threat-intelligence arm wrote on 26 March about the Covid security threat noting what it called three broad categories of attacks leveraging Covid with known advanced persistent threat participation in: Malware and phishing campaigns using Covid-themed lures; attacks against organisations that carry out research and other work related to Covid; and fraud and disinformation.
From an enterprise security perspective, Talos recommended:
- Remote access: Do not expose Remote Desktop Protocol (RDP) to the internet. Use secure VPN connections with multi-factor authentication schemes. Network access control packages can be used to ensure that systems attempting to remotely connect to the corporate environment meet a minimum set of security standards such as anti-malware protection, patch levels, etc, prior to granting them access to corporate resources. Continually identify and remediate access-policy violations.
- Identity Management: Protect critical and public-facing applications with multi-factor authentication and supporting corporate policies. Verify that remote-account and access-termination capabilities work as intended in a remote environment.
- Endpoint Control: Because many people may be working from home networks, endpoint visibility, protection, and mitigation is now more important than ever. Consider whether remediation and reimaging capabilities will work as intended in a remote environment. Encrypt devices where possible and add this check to your NAC solution as a gate for connectivity. Another simple method of protecting endpoints is via DNS, such as with [Cisco’s] Umbrella, by blocking the resolution of malicious domains before the host has a chance to make a connection.
In an FAQ about the impact of Covid-19 on fulfilling customer hardware orders, VMware stated: “Some VMware SD-WAN hardware appliances are on backorder as a result of supply chain issues. As a result, we are extending the option to update existing orders with different appliances where inventory is more readily available. Customers may contact a special email hotline with questions related to backordered appliances. Please send an email to email@example.com with your questions and include the order number, urgent quantities, and contact information. We will do our best to respond within 48 hours.”
Cisco said it has been analysing traffic statistics with major carriers across Asia, Europe, and the Americas, and its data shows that typically, the most congested point in the network occurs at inter-provider peering points, Jonathan Davidson, senior vice president and general manager of Cisco’s Mass-Scale Infrastructure Group wrote in a blog on 26 March. “However, the traffic exchanged at these bottlenecks is only a part of the total internet traffic, meaning reports on traffic may be higher overall as private peering and local destinations also contribute to more traffic growth.”
“Our analysis at these locations shows an increase in traffic of 10% to 33% over normal levels. In every country, traffic spiked with the decision to shut down non-essential businesses and keep people at home. Since then, traffic has remained stable or has experienced a slight uptick over the days that followed,” Davidson stated.
He said that traffic during peak hours from 6pm and 10 pm has increased slightly but is not the primary driver for the overall increase. Busy hours have extended to 9am to 10pm, although the new busy-hour (9am to 6pm) traffic is still below the traditional peak hours. “Service providers are certainly paying attention to these changes, but they are not yet a dire concern, as most networks are designed for growth. Current capacities are utilised more over the course of the entire day,” he wrote.
Spanish multinational telecommunications company Telefonica said IP networks are experiencing traffic increases of close to 40% while mobile voice use is up about 50% and data is up 25%. In general, traffic through IP networks has experienced increases of nearly 40% while mobile use has increased by about 50% for voice and 25% for data. Likewise, traffic from instant-messaging tools such as Whatsapp has increased fivefold in recent days.
What is the impact of the coronavirus on corporate network planning? Depends on how long the work-from-home mandate goes on really. Tom Nolle, president of CIMI Corp. takes an interesting look at the situation saying the shutdown “could eventually produce a major uptick for SD-WAN services, particularly in [managed service provider]… Businesses would be much more likely to embark on an SD-WAN VPN adventure that didn’t involve purchase/licensing, favouring a service approach in general, and in particular one with a fairly short contract period.”
Statistics from VPN provider NordVPN show the growth of VPN usage across the globe. For example, the company said the US has experienced a 65.93% growth in the use of business VPNs since 11 March. It reported that mass remote working has contributed towards a rise in desktop (94.09%) and mobile app (0.39%) usage among Americans. Globally, NordVPN teams has seen a 165% spike in the use of business VPNs and business VPN usage in Netherlands (240.49%), Canada (206.29%) and Austria (207.86%) has skyrocketed beyond 200%. Italy has had the most modest growth in business VPN usage at just 10.57%.
According to Atlas VPN user data, VPN usage in the US increased by 124% during the last two weeks. VPN usage in the country increased by 71% between 16 and 22 March. Atlas said it measured how much traffic travelled through its servers during that period compared to 9-15 March. The data came from the company’s 53,000 weekly users.
Verizon reports that voice usage, long declining in the age of texting, chat and social media, is up 25% in the last week. The network report shows the primary driver is accessing conference calls. In addition, people are talking longer on mobile devices with wireless voice usage notching a 10% increase and calls lasting 15% longer.
AT&T also reported increased calling, especially Wi-Fi calling, up 88% on 22 March versus a normal Sunday. It says that consumer home voice calls were up 74% more than an average Sunday; traffic from Netflix dipped after all-time highs on Friday and Saturday; and data traffic due to heavy video streaming between its network and peered networks tied record highs. AT&T said it has deployed portable cell nodes to bolster coverage supporting FirstNet customers in Indiana, Connecticut, New Jersey, California and New York.
What’s more, Microsoft this week advised users of Office 365 it was throttling back some services:
- OneNote: OneNote in Teams will be read-only for commercial tenants, excluding EDU. Users can go to OneNote for the web for editing. Download size and sync frequency of file attachments has been changed.
- SharePoint: It is rescheduling specific backend operations to regional evening and weekend business hours. Impacted capabilities include migration, DLP and delays in file management after uploading a new file, video or image. Reduced video resolution for playback videos.
- Stream: People timeline has been disabled for newly uploaded videos. Pre-existing videos will not be impacted. Meeting recording video resolution adjusted to 720p.
Security vendor Check Point’s Threat Intelligence says that since January 2020, there have been over 4,000 coronavirus-related domains registered globally. Out of these websites, 3% were found to be malicious and an additional 5% are suspicious. Coronavirus-related domains are 50% more likely to be malicious than other domains registered at the same period, and also higher than recent seasonal themes such as Valentine’s day.
Orange, an IT and communications services company aid, has increased its network capacity and upgraded its service platforms. These measures allow it to support the ongoing exponential increase in needs and uses. The number of users connecting to their company’s network remotely has already increased by 700% among its customers. It has also doubled the capacity for simultaneous connections on its platforms. The use of remote collaboration solutions such as video conferencing has also risen massively with usage increasing by between 20% to 100%.
Verizon said it has seen a 34% increase in VPN traffic from 10 to 17 March. It also noted a 75% increase in gaming traffic and web traffic increased by just under 20% in that time period according to Verizon.
One week after the CDC declaration of the virus as a pandemic, data analytics and broadband vendor OpenVault wrote on 19 March that:
- Subscribers’ average usage during the 9am to 5pm daypart has risen to 6.3Gb, 41.4% higher than the January figure of 4.4Gb.
- During the same period, peak hours (6pm-11pm) usage has risen 17.2% from 5Gb per subscriber in January to 5.87Gb in March.
- Overall daily usage has grown from 12.19Gb to 15.46Gb, an increase of 26.8%.
- Based on the current rate of growth, OpenVault projected that consumption for March will reach nearly 400Gb per subscriber, an increase of almost 11% over the previous monthly record of 361Gb, established in January of this year. In addition, OpenVault projects a new coronavirus-influenced run rate of 460Gb per subscriber per month going forward.
IDG News Service