The Yoga version of OpenStack supports SmartNICs

The OpenStack open source project updates the cloud infrastructure solution to the Yoga version. It considers SmartNIC DPUs in the Neutron network service, as well as in Nova, which provide provisioning of compute instances. Cloud-native integrations have also been extended to Kubernetes and Prometheus. New contributors, vendors like Nvidia and end users like the BBC, are actively participating in the release of Yoga.

In 12 years, OpenStack cloud infrastructure software is in its 25th version, called Yoga. It expanded hardware support, specifically for SmartNIC DPUs, and strengthened its integration with Kubernetes. “25 million cores are in production compared to 15 million in 2020 with more than 100 new clouds”, recalled Thierry Carrez, general manager since January of the Open Infrastructure Foundation which hosts the open source project. OpenStack includes over 180 distributed public cloud datacenters. “The public cloud footprint of OpenStack is enormous around the world,” said the man who is also responsible for software engineering. Since 2012, the project community has aggregated more than 560,000 changes from 8,700 contributors, he summarized.

OpenStack adoption remains dominant among telecommunications operators and deployments continue to move to established users such as Bloomberg, Walmart, CERN, Yahoo or Workday. “7 organizations run more than a million hearts”, Thierry Carrez pointed out, including Workday, Walmart and China Mobile (6 million hearts). As for recent contributors to the project, DG mentioned Nvidia, but also the BBC (which is in 7th position in the Yoga version) and among the new users, the ECMWF (European Center for Medium- Range Weather Forecasts) that will show. a demonstration of its OpenStack cloud at the project’s next user conference. In fact, in two months, the OpenInfra Summit will return, the first on-site conference in two and a half years. One thousand participants are expected from June 7 to 9, 2022 in Berlin. Kendall Nelson, Head of Upstream Developers, reported that it will discuss 5G connectivity, including the first case of using 5G Kata Containers and OpenStack, Magma on OpenStack, Confidential Computing, DPU and GPU support and OpenInfra work in the automotive.

Contributions to Neutron, Nova, Cinder and Manila

In the Yoga version of OpenStack, Thierry Carrez first emphasized the extension of hardware support, driven by the advent of more and more specialized hardware. Thus, Neutron, the network as-a-service project, is enriched with the support of a type of remote-managed virtual network interface controller (VNIC) that makes it possible to directly create network ports to connect to DPUs (data processing unit) SmartNIC. We found the equivalent to Nova (provisioning of compute instance) which also offers the ability to directly connect to network ports for VMs in this network backend to take advantage of SmartNICs and strengthen security by removing control plane from the server. host. On the storage side, Cinder (block storage service) supports three other drivers for LightOS for NVMe/TCP (Lightbits), Toyou NetStor Fiber Channel and Nec V Series Storage (FC and iSCSI).

On the network side, Neutron makes it possible to add high-performance local IP to be shared between VMs with the guarantee that it will only be accessible within the limits of a physical server or a node. This enables the implementation of high-efficiency network data plane performance scenarios for clouds that are very large in size or have high demands on network throughput. The project in Manila, which provides a shared file system service, is also getting improvements. Shares to be deleted can be placed in a recycle bin and remain there for a configurable time before being destroyed. As long as they remain in the recycle bin, parts of this file system can be viewed and restored upon request.

Cloud Native Compatibility Extensions

Other evolutions of Yoga have to do with extending native cloud compatibility to Kubernetes and the Prometheus alert-oriented monitoring tool. The latter integration is done by Octavia, the load balancer, and Kolla, the OpenStack automation tool. “It’s stronger for a variety of use cases,” Kendall Nelson said. Octavia now supports deeper observations by increasing the number of points exposed by the Prometheus agent for metric retrieval. The load balancing service can expose more than 150 metrics. In part, the Kolla project now supports the deployment of the Prometheus Libvirt exporter.

In Yoga, the collaboration with Kubernetes progresses to the Kuryr and Tacker projects. The first serves as a gateway between the Neutron network service and the Docker containers. It is enriched with debugging capabilities by integrating Kubernetes events into the resources it manages. As for Tacker, an NFV (network function virtualization) orchestration service, it adds some functionality to its Kubernetes virtualized infrastructure manager, including using Docker private registry images or Helm graphs to deploy container network functions (CNF).

OpenStack, one of the 3 or 4 most active projects

At the end of the presentation of this version of Yoga, which can be downloaded from the OpenStack site, Mark Collier, one of the co-founders of the project in 2010, recalled that the platform remains among the 3 or 4 most active open source projects. around the world, along with projects such as Linux and Kubernetes. He returned to the contribution of Nvidia engineers who provided support for SmartNICs and stressed the arrival of DPUs specifically designed for the datacenter that are now being considered in OpenStack with Yoga. “After 25 releases, the pace of contributions is still strong,” Mark Collier said. As for the Open Infrastructure Foundation, which is hosting the project, it has seen its membership grow by 20% since November 2021. The organization now has 100,000 members in 187 countries.

The main contributors to the Yoga version, according to Stackanalytics: Red Hat (50.8%), then above, from right to left, Ericsson, Binero, Canonical, independents, Nec, stackHPC, BBC, Yovole. In green (21.7%), other contributors. (Credit: Stackanalytics)

Leave a Comment