Documentation Index
Fetch the complete documentation index at: https://sambanova-systems.mintlify.dev/docs/llms.txt
Use this file to discover all available pages before exploring further.
The SambaRack SN40L-16 system comprises a compute node, integrated networking, and power distribution units (PDUs). The standard configuration includes two PDUs; a four-PDU configuration may be provided for site-specific requirements.
SambaRack SN40L-16 rack components
This table lists the primary components included in each rack. These components provide compute capacity, networking, management access, and redundant power for the SambaRack SN40L-16 system.
| Component | Quantity | Description |
|---|
| SambaRack SN40L-16 node | 1 | Accelerator node providing compute resources |
| Juniper QFX5130 Ethernet data switch | 1 | High-bandwidth switch providing user access to inference services |
| Juniper EX-series access (management) switch | 1 | Dedicated network for system and component management |
| Lantronix serial console server | 1 | Provides CLI access to manage all rack components |
| Power Distribution Units (PDUs) | 2 | Provides redundant power for system operation; some configurations include 4 PDUs. |
SambaRack SN40L-16 Node components
This table details the components that make up a single SambaRack SN40L-16 node. These components deliver accelerator compute capability and support system management and monitoring.
| Component | Quantity | Description |
|---|
| SambaRack SN40L-2 modules (XRDUs) | 8 | Each module contains two Reconfigurable Data Units™ (RDUs), providing a total of 16 RDUs per node. Each XRDU includes a Baseboard Management Controller (BMC) for power control and telemetry. SN40L-2 modules are also referred to as XRDUs, a generation-agnostic term. |
| SambaRack SN40L-H host module | 1 | x86-based server running Red Hat® Enterprise Linux®, used to manage accelerator node operations |
| Location | Component |
|---|
| 1 | (8) SN40L-2 modules |
| 2 | (1) SN40L-H host module |
| 3 | (2) Power Distribution Units |
| 4 | (1) Juniper QFX5130 |
| 5 | (1) Juniper EX-series switch |
| 6 | (1) Lantronix Serial Console Server |
SambaRack administration
SambaRack administration is through a combination of SambaRack Manager which is a tool for centralized administration of SambaRacks and direct administration of individual devices.
SambaRack software
Software for SambaRack includes the following items:
- SambaRack SN40L-H host OS: x86 host modules run Red Hat® Enterprise Linux® (RHEL).
- SambaRack Manager: utility for managing and updating SambaRack infrastructure and components.
- SambaNova Runtime: responsible for executing training and inference requests, transferring data, managing hardware components, error handing, resource management and more. SambaNova Runtime is installed and executed on SN40L-H host modules.
