> ## Documentation Index
> Fetch the complete documentation index at: https://docs.nyc-ai.app/llms.txt
> Use this file to discover all available pages before exploring further.

# Hardware specifications

> Alpha and Beta architecture, Blackwell systems, interconnect fabric, and storage design.

Empire AI is being built as a phased AI supercomputing environment centered on accelerated training, inference, and data-intensive research.

## Alpha system

Alpha is the first production-facing phase of the platform.

Public Empire AI materials describe the October 2024 launch as a first-stage system powered by 96 advanced processors. CCR's user documentation describes Alpha as the current onboarding and early-use environment while Beta procedures continue to mature. In practice, Alpha is where researchers validate software stacks, data paths, and job patterns before moving to larger allocations.

<Warning>
  Alpha is an early-access research environment, not the final target architecture. It is useful for onboarding and experimentation, but the larger Blackwell-based Beta platform is where the consortium's long-term AI scale begins.
</Warning>

## Beta system

Beta is the major architecture jump. Empire AI announced Beta in June 2025 with a \$40 million investment and described it as roughly 11 times stronger for AI training than Alpha, with about 40 times the inference throughput and 8 times the storage footprint.

<Tip>
  Beta uses an NVIDIA DGX SuperPOD built on DGX GB200 systems. That matters because it combines Blackwell GPUs, Grace CPUs, high-bandwidth memory, and a unified NVLink fabric in a design aimed at very large distributed AI workloads.
</Tip>

## Beta architecture details

| Component                  | Specification                                             |
| -------------------------- | --------------------------------------------------------- |
| GPU architecture           | 288 NVIDIA Blackwell GPUs                                 |
| CPU nodes                  | 60 nodes with NVIDIA Grace CPU Superchips                 |
| Blackwell transistor count | 208 billion transistors per GPU                           |
| Process technology         | TSMC 4NP                                                  |
| Superchip design           | DGX GB200 systems built around Grace Blackwell Superchips |
| Interconnect               | NVLink unified fabric                                     |
| Rack-scale bandwidth       | Up to 130 TB/s across a single NVL72 rack                 |
| Rack-scale AI performance  | Up to 1.44 exaFLOPS at FP4 precision                      |
| Storage tier 1             | 20+ PB on the VAST Data AI Operating System               |
| Storage tier 2             | 10+ PB on DDN's data intelligence platform                |
| Operations software        | NVIDIA AI Enterprise and NVIDIA Mission Control           |

## Beta hardware

<Frame caption="NVIDIA GB200 NVL72: a single liquid-cooled rack containing 36 Grace CPUs and 72 Blackwell GPUs connected over NVLink">
  <img src="https://mintcdn.com/genzlabs/Kl0JLEUAHzII8niH/images/hardware/nvl72-rack.png?fit=max&auto=format&n=Kl0JLEUAHzII8niH&q=85&s=59c022ad28b9edeebab26989cec4a2b5" alt="NVIDIA GB200 NVL72 rack" width="1920" height="1080" data-path="images/hardware/nvl72-rack.png" />
</Frame>

<CardGroup cols={2}>
  <Card title="NVIDIA DGX SuperPOD (DGX GB200)">
    <Frame>
      <img src="https://mintcdn.com/genzlabs/Kl0JLEUAHzII8niH/images/hardware/dgx-superpod.jpg?fit=max&auto=format&n=Kl0JLEUAHzII8niH&q=85&s=9f085160f0bb0177dc637f30b67ae519" alt="NVIDIA DGX SuperPOD built on DGX GB200" width="1200" height="630" data-path="images/hardware/dgx-superpod.jpg" />
    </Frame>

    Turnkey AI data-center platform built from DGX GB200 systems. This is the platform that houses Beta's 288 Blackwell GPUs.
  </Card>

  <Card title="NVIDIA Grace CPU Superchip">
    <Frame>
      <img src="https://mintcdn.com/genzlabs/Kl0JLEUAHzII8niH/images/hardware/grace-cpu.jpg?fit=max&auto=format&n=Kl0JLEUAHzII8niH&q=85&s=05086c796ca97a55aa6ce5043d83e9db" alt="NVIDIA Grace CPU Superchip" width="5120" height="920" data-path="images/hardware/grace-cpu.jpg" />
    </Frame>

    CPU platform used for HPC and data-processing nodes alongside the GPU tier. Empire AI lists 60 Grace CPU Superchip nodes for those workloads.
  </Card>

  <Card title="VAST Data AI Operating System">
    <Frame>
      <img src="https://mintcdn.com/genzlabs/Kl0JLEUAHzII8niH/images/hardware/vast.webp?fit=max&auto=format&n=Kl0JLEUAHzII8niH&q=85&s=18db354a3fd6c3a50fdbf660931e2230" alt="VAST Data storage system" width="1920" height="1080" data-path="images/hardware/vast.webp" />
    </Frame>

    **Tier 1 storage, 20+ PB.** All-flash platform designed for AI training pipelines and high-concurrency reads.
  </Card>

  <Card title="DDN data intelligence platform">
    <Frame>
      <img src="https://mintcdn.com/genzlabs/Kl0JLEUAHzII8niH/images/hardware/ddn.webp?fit=max&auto=format&n=Kl0JLEUAHzII8niH&q=85&s=7679abe0eae2da14707547f279ba83fc" alt="DDN storage platform" width="1200" height="628" data-path="images/hardware/ddn.webp" />
    </Frame>

    **Tier 2 storage, 10+ PB.** Additional high-performance data infrastructure for datasets, checkpoints, and shared research workflows.
  </Card>
</CardGroup>

## Why the Blackwell stack matters

The key design choice is not just "more GPUs." Beta is tuned for modern large-model workflows:

* FP4 support and the Transformer Engine make it easier to run very large model training and inference efficiently.
* High-bandwidth NVLink reduces the communication penalty that often slows distributed GPU jobs.
* Grace CPUs and large storage tiers support the data movement and preprocessing that AI pipelines depend on.

In practical terms, Beta is meant to support workloads that would be difficult or cost-prohibitive on standard institutional clusters: very large multimodal models, long-context training jobs, large-scale simulation-assisted AI, and high-resolution medical or climate datasets.
