At GTC immediately, NVIDIA unveiled numerous updates to its DGX portfolio to energy new breakthroughs in enterprise AI improvement.

NVIDIA DGX H100 methods at the moment are obtainable for order. These infrastructure constructing blocks assist NVIDIA’s full-stack enterprise AI options.

With 32 petaflops of efficiency at FP8 precision, NVIDIA DGX H100 delivers a leap in effectivity for enterprise AI improvement. It provides 3x decrease complete price of possession and three.5x extra power effectivity in comparison with the earlier technology.

New NVIDIA Base Command software program, which simplifies and speeds AI improvement, powers each DGX system — from single nodes to DGX SuperPODs.

Also unveiled was NVIDIA DGX BasePOD — the evolution of DGX POD — which makes enterprise data-center AI deployments easier and sooner for IT groups to accumulate, deploy and handle.

Many of the world’s AI leaders are constructing technological breakthroughs — from self-driving vehicles to voice assistants — utilizing NVIDIA DGX methods and software program, and the tempo of innovation shouldn’t be slowing down.

New NVIDIA Base Command Features

NVIDIA Base Command offers enterprise-grade orchestration and cluster administration, and it now includes a full software program stack for maximizing AI developer productiveness, IT manageability and workload efficiency.

The workflow administration options of Base Command now embody assist for on-premises DGX SuperPOD environments, enabling companies to realize centralized management of AI improvement tasks with simplified collaboration for mission groups, and built-in monitoring and reporting dashboards.

Base Command works with the NVIDIA AI Enterprise software program suite, which is now included with each DGX system. The NVIDIA AI software program allows end-to-end AI improvement and deployment with supported AI and knowledge science instruments, optimized frameworks and pretrained fashions.

Additionally, it provides enterprise-workflow administration and MLOps integrations with DGX-Ready Software suppliers Domino Data Lab, Run.ai, Weights & Biases and NVIDIA Inception member Rescale. It additionally contains libraries that optimize and speed up compute, storage and community infrastructure — whereas guaranteeing maximized system uptime, safety and reliability.

New DGX BasePOD Reference Architecture

DGX BasePOD offers a reference structure for DGX methods that comes with design greatest practices for integrating compute, networking, storage and software program.

Customers are already utilizing NVIDIA DGX POD to energy the event of a broad vary of enterprise purposes. DGX BasePOD builds on the success of DGX POD with new trade options focusing on the largest AI alternatives, together with pure language processing, healthcare and life sciences, and fraud detection.

Delivered as absolutely built-in, ready-to-deploy choices via the NVIDIA Partner Network, DGX BasePOD options vary in measurement, from two to lots of of DGX methods, with licensed high-performance storage from NVIDIA DGX storage expertise companions together with DDN, Dell, NetApp, Pure Storage, VAST Data and WEKA.

Leaders Power AI Breakthroughs With DGX Systems

Enterprises all over the world select NVIDIA DGX methods to energy their most superior AI workloads. Among the AI innovators growing mission-critical AI capabilities on DGX A100 methods:

• ML analysis and product lab Adept is constructing an AI teammate powered by a big language mannequin prototyped on NVIDIA DGX Foundry, after which scaled with NVIDIA A100 GPUs and NVIDIA Megatron on Oracle Cloud Infrastructure.
• Hyundai Motor Group is utilizing a 40-node DGX SuperPOD to discover hyperscale AI workloads.
• Telecom firm KT is growing a LLM with round 40 billion parameters for a wide range of Korean-language purposes, together with the GiGA Genie good speaker, utilizing the NVIDIA NeMo Megatron framework, NVIDIA DGX SuperPOD and NVIDIA Base Command software program.
• The University of Wisconsin-Madison is shortly bringing AI to medical imaging units utilizing NVIDIA DGX methods with the Flywheel analysis platform and the NVIDIA Clara healthcare software framework. Using the NVIDIA Federated Learning Application Runtime Environment, or NVIDIA FLARE, in collaboration with different hospitals, the college is securely coaching AI fashions on DGX methods for medical imaging, annotation and classification.

Learn extra in regards to the AI breakthroughs powered by NVIDIA DGX methods by watching NVIDIA founder and CEO Jensen Huang’s GTC keynote in replay. And be a part of the GTC session, “Designing Your AI Center of Excellence,” with Charlie Boyle, vp of DGX methods at NVIDIA.