DataScale SN30 rack components and cabling

The following image and table identify the locations of the main components in the DataScale SN30 rack (rear facing).

The DataScale SN30 rack comes preconfigured and cabled, with each system connected to the appropriate switches and switch ports. The following images and tables identify the components that are either connected to switches or to other system components.

The Latronix serial console server is installed and cabled in the factory.

This component, located in RU42, occupies the front portion of the same rack unit as the Juniper EX series access switch. The serial console server uses standard Ethernet RJ45 cables and rollover DB9F to RJ45 console cables for the DataScale SN30-H host module.

A dedicated non-tagged VLAN network drop, which is on the access/management network, is required for the serial console server. This connection goes to the serial console server management port indicated by the number 1 in Lantronix serial console server (rear view). Having a dedicated serial console server network drop ensures that there is still network connectivity to the serial console server if anything happens to the Juniper EX series access switch.

Cabling requirements from the Lantronix serial console server to the other DataScale SN30 rack components are listed in the following table.

The Juniper EX series switch that is used for the access networks is installed and cabled in the factory.

This component is located in RU42 at the rear of the rack and is shared in the same rack unit as the Lantronix serial console server. This switch uses standard Cat6 Ethernet RJ45 cables. Customers can further segregate this switch using port-based VLANs to separate access to the management interfaces of the DataScale SN30 rack components and the interface of the SN30-Hs operating system(OS). The customer is responsible for configuring this added network segregation. Access network port cabling shows what device is connected to which port, and shows available ports that can be used if an additional network drop is required for the separate network. If requested, SambaNova staff can configure this port separation during initial deployment.

Cabling requirements from the Juniper EX series switch for the access network to the other DataScale SN30 rack components are listed in Access network port cabling.

The network management port is brought out to a dongle at the rear of the rack to allow customers to connect a dedicated cable to the management port of the Juniper EX series switch for recovery purposes. This dongle is labeled ACCSW Dedicated Management Uplink.

The DataScale SN30 rack is configured with a Juniper QFX5130 400GbE Ethernet switch. The connections to the SN30-2 and SN30-H provide 200GbE connectivity to the data switch using 400GbE to 2 x 200GbE splitter cables.

Intra-system cabling is installed in the factory before delivery.

The intra-system cables are not intended to be user serviceable. Intra-system SN30-H-to-SN30-2 and SN30-2-to-SN30-2 cables are specially designed QSFP-DD terminated cable pairs.

For cabling between the SN30-H host module and the SN30-2 modules in a system, the ports are grouped with a blue and green pair. For example, the SN30-2 module’s port 1 consists of an upper blue port 1 and lower green port 1, as shown in SN30-2 Intra-system connection port assignment.

For the SN30-H, there are two pairs of color-coded ports per PCIe card slot with only one of the pairs being used. For example, in slot 1 of an SN30-H:

However, for this particular card, only port pair 1 is used. Topology of connections between the SN30-Hs to SN30-2s in a system shows the cabling between the SN30-H and the SN30-2s in a system and illustrates port pair use:

Where identified, the source blue port from the identified PCIe slot in the host goes to the corresponding target blue port 1 in the identified SN30-2 RDU module. Similarly, the source green port from the identified PCIe slot in the host goes to the corresponding target green port in the identified SN30-2. For example, from the host’s PCIe slot 1, slot 1 – Blue (1B) goes to the the first SN30-2 XRDU in the node (SN30-H-#-XRDU0): Port 1 – Blue (1B).

The following table has details about each cable connection.

For the intra-system cabling between SN30-2 systems, the ports are grouped with a blue and green pair. For example, port 1 consists of blue port 1 above and green port 1 beneath, as shown in Topology of SN30-2 interconnects in a system.

The intra-system cabling of a SN30-2 system to other SN30-2 systems is done as follows:

Where identified, the source blue port goes to the corresponding target blue port, and the source green port goes to the corresponding target green port. For example, from the first SN30-2 in a system, the Port 2 – Blue (2B) goes to the second SN30-2 in the system: Port 3 – Blue (3B).

The following table has details about each cable connection.

DataScale SN30 racks are delivered preinstalled with power cables from the factory.

Four power distribution units (PDUs) are installed in the DataScale SN30 rack. The PDUs provide redundant power in case of a device PSU failure, a single PDU failure, or a datacenter power feed failure. They are located on the left side and the right side of the rack when you are facing the rear of the rack. The following table is a reference to the PDU identification and location within the rack.

Port population of the PDUs varies depending on the number of systems in the DataScale SN30 rack, but the same outlets are always used for the same systems regardless of rack configuration. PDU to component power supply mapping shows all the required connections for a two node rack. The information in the table also applies to a rack with fewer populated systems.