Microsoft's latest networking update helps stabilize workloads and accelerate packet transactions on its public...
cloud -- and brings a new weapon onto the latest cloud provider battlefield.
Accelerated Networking, a free service now generally available in Microsoft Azure for Windows and Linux users, uses Microsoft's move to field-programmable gate arrays (FPGAs) and can reduce latency and other networking hiccups. It's also the latest in a series of upgrades from the major public cloud providers as they emphasize their platforms' networking capabilities.
Accelerated Networking, available in all Azure regions, provides up to 30Gbps throughput by moving the Azure networking stack from the hypervisor down to the smart network interface controllers (SmartNICs). It's akin to Amazon Web Services' enhanced networking feature, which is also free and available for Linux and Windows.
Bypassing the hypervisor to directly interface with the NIC should boost performance and cut jitter, in addition to latency benefits, said Murali Basavaiah, co-founder and vice president of engineering at Avi Networks, which provides application load balancing on premises and in the public cloud. Elimination of CPU-tied networking reduces compute cycles and load per VM, which ultimately translates to lower cost for customers and greater overall efficiency in Microsoft's data centers.
There is a hitch to the service, however. It's currently limited to a handful of options in the D, E, F and M series of VMs, and can't be used with older VM types. Customers must also use a new NIC, which cannot be attached to an existing VM, or to an availability set if any of the VMs in the group aren't Accelerated Networking-enabled. It also can only be deployed through the Azure Resource Manager.
In a bit of good timing, Microsoft made Accelerated Networking generally available in the wake of its response to the Spectre and Meltdown chip vulnerabilities. Microsoft initially said some Azure workloads would see slower performance due to security patches but, following the patches, it said Accelerated Networking should make up the difference for those users.
Applications that will benefit the most from Azure Accelerated Networking are smaller, transactional workloads, but this new tool is not a cure all, said Scott Harvey, vice president of engineering at Atmosera, an Azure managed service provider in Beaverton, Ore. An instance with large packet transfers, for example, would see less latency with a virtual switch because it wouldn't have to map additional hops required to break down large chunks of data to accommodate the capacity limits of a physical controller.
He's also dubious of Microsoft's claims that Accelerated Networking can unilaterally address performance issues related to these chip defects. "It certainly will have its benefits, but those would be there whether Spectre and Meltdown were in play or not," Harvey said.
Cloud vendors push network improvements
Cloud providers continue to improve their platforms' networking capabilities. Services such as Accelerated Networking touch on the server-network connection, but other internal and external efforts focus on performance with entire clusters through load balancers, as well as automation through wide-area networking.
Expect more as customers push for greater continuity across multiple availability zones, either because of their multinational status or because of failover and disaster recovery demands.
"It's not only going to be the local processing and what area network interface card can provide, but it will be the broader networking capabilities," said Brad Casemore, an analyst at IDC.
Microsoft has work to do for Azure networking to achieve feature parity with AWS, Casemore said. Though it has its on-premises Azure Stack to provide hybrid capabilities, it will need a response to AWS Application Load Balancer, which lets customers use an API to create an in-house staging environment for apps going to the public cloud. The company also needs to better compete with Amazon on features and performance attributes at the application layer. (TEST 2)
Trevor Jones is a senior news writer with SearchCloudComputing and SearchAWS. Contact him at firstname.lastname@example.org.