> ## Documentation Index
> Fetch the complete documentation index at: https://sambanova-systems.mintlify.site/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# SambaRack overview

The SambaRack SN40L-16 system comprises a compute node, integrated networking, and power distribution units (PDUs). The standard configuration includes two PDUs; a four-PDU configuration may be provided for site-specific requirements.

## SambaRack SN40L-16 rack components

This table lists the primary components included in each rack. These components provide compute capacity, networking, management access, and redundant power for the SambaRack SN40L-16 system.

| Component                                    | Quantity | Description                                                                        |
| -------------------------------------------- | -------- | ---------------------------------------------------------------------------------- |
| SambaRack SN40L-16 node                      | 1        | Accelerator node providing compute resources                                       |
| Juniper QFX5130 Ethernet data switch         | 1        | High-bandwidth switch providing user access to inference services                  |
| Juniper EX-series access (management) switch | 1        | Dedicated network for system and component management                              |
| Lantronix serial console server              | 1        | Provides CLI access to manage all rack components                                  |
| Power Distribution Units (PDUs)              | 2        | Provides redundant power for system operation; some configurations include 4 PDUs. |

## SambaRack SN40L-16 Node components

This table details the components that make up a single SambaRack SN40L-16 node. These components deliver accelerator compute capability and support system management and monitoring.

| Component                         | Quantity | Description                                                                                                                                                                                                                                                               |
| --------------------------------- | -------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| SambaRack SN40L-2 modules (XRDUs) | 8        | Each module contains two Reconfigurable Data Units™ (RDUs), providing a total of 16 RDUs per node. Each XRDU includes a Baseboard Management Controller (BMC) for power control and telemetry. SN40L-2 modules are also referred to as XRDUs, a generation-agnostic term. |
| SambaRack SN40L-H host module     | 1        | x86-based server running Red Hat® Enterprise Linux®, used to manage accelerator node operations                                                                                                                                                                           |

The figure below shows the location of these components within the SambaRack SN40L-16 rack.

<Frame>
  <img src="https://mintcdn.com/sambanova-systems/emEy6D0rW6i9bD6c/images/docs/admin/sambarack-overview/sambarack-sn40l-front-2-pdu.png?fit=max&auto=format&n=emEy6D0rW6i9bD6c&q=85&s=850b9af33f5e6c1d3d42fea041544934" alt="SambaRack SN40L-16 rack front view showing component locations including SN40L-2 modules, SN40L-H host module, PDUs, and network equipment" style={{ maxWidth:"100%" }} width="801" height="884" data-path="images/docs/admin/sambarack-overview/sambarack-sn40l-front-2-pdu.png" />
</Frame>

| Location | Component                           |
| -------- | ----------------------------------- |
| 1        | (8) SN40L-2 modules                 |
| 2        | (1) SN40L-H host module             |
| 3        | (2) Power Distribution Units        |
| 4        | (1) Juniper QFX5130                 |
| 5        | (1) Juniper EX-series switch        |
| 6        | (1) Lantronix Serial Console Server |

## SambaRack administration

SambaRack administration is through a combination of SambaRack Manager which is a tool for centralized administration of SambaRacks and direct administration of individual devices.

## SambaRack software

Software for SambaRack includes the following items:

* **SambaRack SN40L-H host OS:** x86 host modules run Red Hat® Enterprise Linux® (RHEL).
* **SambaRack Manager:** utility for managing and updating SambaRack infrastructure and components.
* **SambaNova Runtime:** responsible for executing training and inference requests, transferring data, managing hardware components, error handing, resource management and more. SambaNova Runtime is installed and executed on SN40L-H host modules.
