Thought Leadership
Dell Technologies is expanding its generative AI offering together with AMD. The Dell PowerEdge XE9680 server is now available with the AMD Instinct MI300X accelerators. A new validated design and new implementation services are also available.
The PowerEdge XE9680 with AMD Instinct MI300X offers powerful functions for generative AI. The server is equipped with eight MI300X accelerators, has a total HBM3 capacity of 1.5 TB and offers a theoretical maximum FP18 performance of 42 petaflops. This means that the server guarantees faster training and better performance when using large language models.
Simplified deployment through Dell OpenManage Enterprise and intelligent automation with APEX AIOps enable organizations to quickly deploy the server and rapidly scale their GenAI solutions. Advanced security features such as integrated cyber recovery and the server’s zero-trust design also ensure robust security.
Introducing generative AI more easily
The new “Dell Validated Design for Generative AI with AMD” makes it easier for companies to introduce generative AI. It provides organizations and developers with comprehensive guidance for the implementation and customization of large-scale language models and the use of advanced technologies such as finetuning and Retrieval Augmented Generation (RAG). The design is based on open standards and reduces dependency on proprietary AI software. Developers can thus create their solutions more easily and freely customize workflows with the open source language models of Hugging Face or Meta.
In addition to this Validated Design, Dell Technologies will be offering new services for the implementation of AI platforms from September. Experienced experts will help companies to quickly establish a fully operational platform, integrate the necessary tools and frameworks into their environments and implement best practices for secure and smooth operation.
(pd/Dell Technologies)
