Dell Announces Integrated Rack-Scalable Systems For Dell AI Factory

Dell Technologies has unveiled a series of integrated rack-scalable systems, including server, storage, and data management innovations designed for Dell AI Factory. These systems are expected to enhance high-density computing and AI workloads on a large scale.

Dell Technologies has unveiled a series of integrated rack-scalable systems, including server, storage, and data management innovations designed for Dell AI Factory. These systems are expected to enhance high-density computing and AI workloads on a large scale.

Arthur Lewis, President of Dell Technologies’ Infrastructure Solutions Group, emphasized the growing demand for AI in data centers, noting that current infrastructures struggle to meet these requirements. He highlighted that Dell’s new systems provide the necessary performance to help organizations stay competitive in this rapidly changing AI landscape.

Cooling Innovations, Density, and Flexibility

The Dell Integrated Rack 7000 (IR7000) is designed to meet accelerated computing needs with superior density, efficient power management, and advanced cooling capabilities. As an Open Compute Project (OCP) standards-based rack, the IR7000 is engineered for large-scale deployments and future technology environments.

The Dell Integrated Rack 7000 (IR7000) is built to handle the growing demands of accelerated computing. It offers a combination of superior density, sustainable power management, and advanced cooling technologies. As a rack adhering to Open Compute Project (OCP) standards, the IR7000 is optimized for large-scale deployments. It can accommodate future technology across multiple generations of hardware and diverse environments.

The IR7000 is designed with density in mind. Its 21-inch frame is engineered to support industry-leading CPU and GPU configurations, maximizing the use of space to handle high-performance computing tasks. This ensures that the rack can support the most demanding workloads, including AI and machine learning applications that rely on substantial processing power.

The IR7000 design includes server sleds that are wider and taller than traditional setups to accommodate current, more significant CPU and GPU architectures. These expanded dimensions enable the rack to support more powerful and sophisticated hardware, ensuring it remains relevant as technology evolves. Additionally, the rack is natively designed for liquid cooling, making it capable of cooling future deployments that generate up to 480KW of heat. The system is engineered to capture nearly 100% of produced heat, ensuring energy efficiency and sustainability.

Another key feature of the IR7000 is its flexibility. It is designed to provide users with greater choice in their technology configurations. It supports Dell’s networking solutions and off-the-shelf networking options, allowing organizations to integrate the system into various IT environments. This ensures customers are not locked into a single vendor solution, allowing for more versatile infrastructure choices.

Dell’s Integrated Rack Scalable Systems (IRSS) also simplifies deployment by offering a fully integrated, plug-and-play rack-scale infrastructure. The IRSS is optimized for AI workloads, letting organizations set up and scale their systems quickly and efficiently. This setup reduces the complexity of installation and ensures energy-efficient operation, making it an ideal solution for businesses looking to scale their AI operations without unnecessary complications.

By combining cooling, density, and flexibility, the IR7000 is positioned as a leading solution for organizations needing to support the most advanced computing environments, particularly in AI and machine learning.

AI-Ready Platforms

The Dell IR7000 supports two AI-focused platforms:

• Dell PowerEdge XE9712: Designed for large language model (LLM) training and real-time inferencing at scale, this platform offers high-performance, dense acceleration. It includes NVIDIA GB200 NVL72 technology, connecting up to 36 NVIDIA Grace CPUs and 72 NVIDIA Blackwell GPUs in a rack-scale design. This configuration enables AI inference speeds up to 30 times faster than previous generations, with up to 25 times better energy efficiency than air-cooled systems.
• Dell PowerEdge M7725: Built for environments such as research, government, and fintech, this system is optimized for dense compute, scaling between 24,000 and 27,000 cores per rack. It is powered by 5th Gen AMD EPYC CPUs and integrates direct liquid cooling (DLC) and air cooling for more sustainable deployments.

Unstructured Storage and Data Management Innovations

Dell Technologies’ unstructured data storage portfolio updates are designed to improve AI application performance while simplifying global data management. The Dell PowerScale, the first Ethernet storage certified for NVIDIA DGX SuperPOD, brings many improvements.

• Enhanced discoverability: PowerScale metadata combined with Dell Data Lakehouse allows faster decision-making through improved data insights. An upcoming open-source document loader will improve data ingestion and reduce compute and GPU use costs.
• Denser storage: New 61TB drives allow customers to train AI models on larger datasets, doubling storage capacity while reducing the data center footprint.
• Boosted AI performance: AI workloads are further enhanced with support for NVIDIA InfiniBand and 200GbE Ethernet adapters, which offer up to 63% faster throughput.

Enhancements to the Dell Data Lakehouse platform include disaster recovery, automated schema discovery, comprehensive management APIs, and self-service full-stack upgrades, helping organizations save time and streamline operations. Dell also offers Optimization Services for Data Cataloging and Implementation Services for Data Pipelines to assist customers in scaling AI and business use cases with better data management.

Dell Generative AI Solutions with Intel

Dell has also introduced Generative AI Solutions as part of the Dell AI Factory, featuring preconfigured, validated platforms for various AI use cases. These solutions include the Dell PowerEdge XE9680, Intel Gaudi 3 AI accelerators, and Dell’s storage, networking, and software stack. They are designed for modern content creation, digital assistants, and code-generation workflows.

These new solutions from Dell Technologies will redefine AI infrastructure by addressing the critical needs of high-density computing, cooling efficiency, and scalable AI deployment for enterprises to remain competitive.

Product Availability

• The Dell IR7000 will be available globally in Q1 CY2025.
• The Dell PowerEdge XE9712 is currently available for select customers.
• The Dell PowerEdge M7725 will be available globally in Q1 CY2025.
• Updates to Dell PowerScale will be available in Q4 CY2024.
• Dell Data Lakehouse updates are expected in the first half of CY2025.
• Dell Generative AI Solutions with Intel will be available in Q4 CY2024.

Engage with StorageReview

Newsletter | YouTube | Podcast iTunes/Spotify | Instagram | Twitter | TikTok | RSS Feed