Thought Leadership
Dell Technologies continues to expand the “Dell AI Factory with NVIDIA” offering: A whole range of new server, edge and workstation solutions as well as new services enable companies to accelerate the introduction of artificial intelligence.
The Dell AI Factory with NVIDIA combines Dell Technologies’ AI portfolio with NVIDIA’s software platform, NVIDIA AI Enterprise, powered by NVIDIA Tensor Core GPUs, the NVIDIA Spectrum-X Ethernet Networking Fabric and NVIDIA Bluefield DPUs. This provides companies with integrated functionalities tailored to their individual requirements and validated full-stack solutions. They enable them to quickly get started with demanding AI use cases such as Retrieval Augmented Generation (RAG) or the training and use of AI models.
Advanced computing power for large-scale AI implementations
With the new Dell PowerEdge XE9680L server, organizations can leverage advanced computing power for large-scale AI deployments. The server supports eight NVIDIA GPUs with Blackwell architecture in a compact 4U form factor. The server offers the highest possible rack-scale density for NVIDIA Blackwell GPUs in an industry-standard x86 rack, providing 33% more GPU density per node. The platform also brings 20% more PCIe Gen5 slots and doubles the north-south capacity of the network.
With Direct Liquid Cooling for CPUs and GPUs, the server improves overall efficiency. It is designed for easy maintenance and will be available fully configured and pre-integrated for rack-scale deployments and on-site installations.
With the Dell PowerEdge XE9680L, Dell Technologies offers extremely dense and energy-efficient turnkey rack solutions. This enables companies to significantly reduce the time to value of large GPU-accelerated deployments. Several options will be available, including an air-cooled solution that supports 64 GPUs in a single rack and a liquid-cooled GB200-NVL72 rack solution that supports 72 NVIDIA Blackwell GPUs in a single rack.
Deploy AI applications faster at the edge
Dell NativeEdge enhancements enable organizations to deploy AI applications faster at the edge. As an edge orchestration platform, Dell NativeEdge automates the deployment of NVIDIA AI enterprise software. New Dell NativeEdge Deployment Blueprints are available to organizations of all types, from manufacturing companies to retailers. They cover the video analytics capabilities of NVIDIA Metropolis, the speech and translation capabilities of NVIDIA Riva, and the inferencing microservices of NVIDIA NIM.
Accelerate the development and deployment of AI applications
The new Dell Generative AI Solution for Digital Assistants accelerates the implementation of digital assistants on a full-stack solution from Dell Technologies and NVIDIA. The new Implementation Services for Digital Assistants also help organizations design, plan, implement, test and scale the solution.
With new automated deployment capabilities from Dell AI Factory with NVIDIA, organizations can quickly set up AI environments for a wide range of use cases. Developed in partnership with NVIDIA, full stack automation reduces time to value by up to 86% compared to manual deployment (4). When combined with NVIDIA Inferencing Microservices (NIM), the overall time from deployment to execution of inferencing tasks can be reduced even further. NIMs provide developers with ready-to-use and optimized inferencing engines for common AI models offered by NVIDIA and its partners.
With the new Dell Accelerator Services for RAG on Precision AI Workstations, organizations can shorten AI application development cycles. On a Dell Precision Workstation with the NVIDIA AI Workbench Toolkit, they can rapidly develop powerful AI applications using a customized large language model with RAG in a secure environment.
Availabilities
- The Dell PowerEdge XE9680L will be available worldwide in the second half of 2024.
- The Dell NativeEdge Deployment Blueprints for NVIDIA will be available worldwide from the second half of 2024.
- The availability of the Dell Generative AI Solution for Digital Assistants and the Implementation Services for Digital Assistants will be announced at a later date.
- Dell AI Factory with NVIDIA automated provisioning capabilities will be available in the second half of 2024.
- The availability of Dell Accelerator Services for RAG on Precision AI Workstations will be announced at a later date.
(pd/ Dell Technologies)
