The 8U SuperBlade® networking options include four different Ethernet modules. For simple Layer 2 switching at 1-Gbps the MBM-GEM-004 and MBM-GEM-001 switch offers a cost-effective connectivity option for 20-Blade systems.
Access to 10-Gigabit Ethernet networks is provided by either the Layer 2/3 1/10-Gbps Ethernet Switches – MBM-XEM-002 and MBM-XEM-001 (up to 20 Blades).
For even faster connections, Supermicro offers two different connectivity options. A new InfiniBand switch based on EDR technology – SBM-IBS-E3616 provides connection from Blades to EDR (100G) InfiniBand networks. And other solution is based on Intel’s Omni-Path Architecture with 100G connectivity to the servers with SBM-OPA-C4020.
All SuperBlade® networking options are hot-pluggable.
Switches
The 10 Gigabit Ethernet switch modules (part ID MBM-XEM-001 and MBM-XEM-002) include connection to the SuperBlade's LAN interfaces. While MBM-XEM-001 and MBM-XEM-002 connect to the LAN interfaces onboard the Blade servers. These are layer 2 / layer 3 Ethernet switching modules also have two internal Ethernet paths to the SuperBlade Chassis Management Module CMM(s) to allow configuration and management of the switch. Offering such advanced features as link aggregation, VLAN, Spanning Tree, Access Control Lists and Jumbo Frame support, the switches provide a connection between the Ethernet controllers integrated on the mainboard to the external Ethernet systems.
MBM-XEM-002
General Specifications |
- Broadcom BCM56846 10GbE Low Latency Switch
- 2x40Gbs QSP and 4x10Gbs uplinks*
- 20x 10/1Gbps downlinks
- 1 Console port
- 1 USB port
|
Switching Capacity |
|
Physical Layer Features |
- Jumbo frames up to 9KB
- 40 gigabit optical/copper
- 10 gigabit optical Ethernet SFP+/copper
|
Layer 3 Features |
|
Layer 2 Features |
- 4K VLANS
- Spanning Tree (802.1D)
- Rapid Spanning Tree (802.1w)
- Multiple Spanning Trees (802.1s)
- IEEE 802.lQ VLANs/ port-based VLANs
- IEEE 802.3ad with LACP
- IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
|
Advanced Layer 2 Features |
- Storm control
- Flow control
- Port mirroring
- MLAG
|
Security Features |
- Switch access password protection
- RADIUS and TACACS+ Authentication
- Access Control Lists
- SSH, SSL Encryption
- DHCP Snooping
|
System Management |
- Industry Standard CLI
- Command Completion
- Context Sensitive Help
- SNMP v1/v2/v3
- SSH
- Syslog
- DHCP (Client)
- Web-based management interface
- NTP
- RMON
|
Multicast |
|
Weight |
|
Dimensions (W x D x H) |
- 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
|
Download |
|
* Supported with release 2.0.3-43 |
MBM-XEM-001
General Specifications |
- Intel® FM6348 10GbE Low Latency Switch
- 4x 40Gbps QSFP uplinks
- 20x 10/1Gbps downlinks
- 1 Console port
- 1 USB port
|
Switching Capacity |
|
Physical Layer Features |
- Jumbo frames up to 9KB
- 40 gigabit optical/copper
- 1 gigabit optical Ethernet copper
|
Layer 2 Features |
- 4K VLANS
- Spanning Tree (802.1D)
- Rapid Spanning Tree (802.1w)
- Multiple Spanning Trees (802.1s)
- IEEE 802.lQ VLANs/ port-based VLANs
- IEEE 802.3ac VLAN tagging
- IEEE 802.1AX LACP
- IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
|
Advanced Layer 2 Features |
- Storm control
- Flow control
- Port mirroring
- Static MAC filtering
- UDLD
- Uplink Failure Detection (UFD)
|
Data Center Features |
- L2 Data Center Bridging
- CEE v1.01 DCB for PFC/ETS
|
SDN |
|
Security Features |
- Switch access password protection
- RADIUS and TACACS+ Authentication
- Access Control Lists
- SSH, SSL Encryption
|
System Management |
- XML-RPC
- Industry Standard CLI
- Command completion
- Context Sensitive Help
- SNMP v1/v2/v3
- SSH
- TFTP Client
- Syslog
- DHCP (Client)
- Web-based management interface - HTTP/HTTPS
- NTP
|
Multicast |
|
Weight |
|
Dimensions (W x D x H) |
- 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
|
Download |
|
Switches
The 1 Gigabit Ethernet switch modules (part ID MBM-GEM-004 and MBM-GEM-001) include connection to the SuperBlade's LAN interfaces. While MBM-GEM-001 and MBM-GEM-004 connect to the LAN interfaces onboard the Blade servers. These are layer 2 / layer 3 Ethernet switching modules also have two internal Ethernet paths to the SuperBlade Chassis Management Module CMM(s) to allow configuration and management of the switch.
MBM-GEM-004
General Specifications |
- Broadcom BCM56151 1GbE Switch
- 4x 10Gbps SFP+ and 8x 1Gbps RJ45 uplinks
- 20x 1Gbps downlinks
- 1 Console port
|
Switching Capacity |
|
Physical Layer Features |
- Jumbo frames up to 9KB
- 10 gigabit optical Ethernet SFP+/copper
- 1 gigabit RJ45 Ethernet
|
Layer 2 Features |
- 4K VLANS
- Spanning Tree (802.1D)
- Rapid Spanning Tree (802.1w)
- Multiple Spanning Trees (802.1s)
- IEEE 802.lQ VLANs/ port-based VLANs
- IEEE 802.3ad with LACP
- IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
|
Advanced Layer 2 Features |
- Storm control
- Flow control
- Port mirroring
- Uplink Failure Detection (UFD)
- MLAG
|
Security Features |
- Switch access password protection
- RADIUS and TACACS+ Authentication
- Access Control Lists
- SSH, SSL Encryption
- Protected Ports
|
System Management |
- Industry Standard CLI
- Context Sensitive Help
- Command Completion
- SNMP v1/v2/v3
- SSH
- Syslog
- DHCP (Client)
- Web-based management interface
- NTP
- RMON
- Blade Network Manager (BNM)
|
Multicast |
|
Automation |
|
Weight |
|
Dimensions (W x D x H) |
- 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
|
Download |
|
MBM-GEM-001
General Specifications |
- Intel® FM5224 GbE Low Latency Switch
- 1Gbps RJ45, 2x 40Gbps QSFP or 8x 10Gbps SFP+ uplinks
- 20x 1Gbps downlinks
- 1 Console port
- 1 USB port
|
Switching Capacity |
|
Physical Layer Features |
- Jumbo frames up to 9KB
- 40 gigabit optical/copper
- 10 gigabit optical/copper
- 1 gigabit RJ45 Ethernet
|
Layer 2 Features |
- 4K VLANS
- Spanning Tree (802.1D)
- Rapid Spanning Tree (802.1w)
- Multiple Spanning Trees (802.1s)
- IEEE 802.lQ VLANs/ port-based VLANs
- IEEE 802.3ac VLAN tagging
- IEEE 802.1AX LACP
- IEEE 802.1AB Link Layer Discovery Protocol (LLDP)
|
Advanced Layer 2 Features |
- Storm control
- Flow control
- Port mirroring
- Static MAC filtering
- UDLD
- Uplink Failure Detection (UFD)
|
Data Center Features |
- L2 Data Center Bridging
- CEE v1.01 DCB for PFC/ETS
|
SDN |
|
Security Features |
- Switch access password protection
- RADIUS and TACACS+ Authentication
- Access Control Lists
- SSH, SSL Encryption
|
System Management |
- Industry Standard CLI
- Command completion
- Context-sensitive help
- SNMP v1/v2/v3
- SSH
- TFTP Client
- Syslog
- DHCP (Client)
- Web-based management interface - HTTP/HTTPS
- NTP
- XML-RPC
|
Multicast |
|
Weight |
|
Dimensions (W x D x H) |
- 267mm x 159mm x 36mm (10.5" x 6.25" x 1.4")
|
Download |
|
Switch Modules:
| MBM-XEM-002 | MBM-GEM-004 | MBM-XEM-001 | MBM-GEM-001 |
InfiniBand Switch Module
The InfiniBand switch is based on point-to-point bi-directional serial link systems. It provides high-speed interconnectivity among the blade modules and to external InfiiniBand peripherals and are especially useful in supporting clustered High-Performance-Computing. The SBM-IBS-E3616 InfiniBand switch supports up to twenty internal and 16 external connections (100G).
Omni-path Architecture Switch Module
Supermicro SBM-OPA-C4020 supports the 100Gbps Intel® Omni-Path Architecture (OPA) providing a unique HPC cluster solution offering excellent bandwidth, latency and message rate that is highly scalable and easily serviceable.
SBM-OPA-C4020 supporting Omni-Path Architecture leverages the Intel Scalable System Framework (SSF) to address evolving demands across high performance data analytics, machine learning, visualization, traditional modeling and simulation workloads. Designed specifically for HPC, the SBM-OPA-C4020 products offer 9.6 Tb/s total fabric bandwidth. High scalability with the capability of 27,648 nodes in 2-tier configuration. Supermicro SBM-OPA-C4020 is designed to overcome the scaling challenges of large-sized clusters. The enhancements include:
High Message Rate Throughput. The SSH-C48Q products are designed to support high message rate traffic from each node through the fabric. That means the fabric can support the high bandwidth as well as high message rate throughput associated with the ever-increasing processing power and core counts of Intel® Processor.
SBM-IBS-E3616
100Gb EDR InfiniBand Switch
Switch Chip |
|
Internal Ports |
- Twenty EDR ports at 100Gbps
|
External Uplink Ports |
- Sixteen EDR ports with QSFP28 connectors
|
Bandwidth |
- 7.62Tbps total switch bandwidth (36-Port)
|
SBM-OPA-C4020
100Gb Omni-path Switch
Switch Chip |
|
Internal Ports |
|
External Uplink Ports |
- Twenty four 100Gbs ports with QSFP28 connectors
|
Bandwidth |
- 9.6 Tbps total switch bandwidth (44-Port)
|
Mezzanine Cards
For any blade to access the InfiniBand or Omni-path module, it must have a respective Mezzanine card installed on its mainboard. The AOC-IBH-X4ES and AOC-OPH-WFR support EDR and Omni-path switch respectively.
AOC-IBH-X4ES (Mezzanine EDR HCA)
Chipset |
|
InfiniBand Ports |
|
Power Consumption |
|
AOC-OPH-WFR (Mezzanine OPA)
Chipset |
- Intel Omni-path Wolfriver
|
InfiniBand Ports |
|
Power Consumption |
- 13.12W typical/ 16.65W max
|
|
Part Number |
Qty |
Description |
---|
SFP+ Cable |
CBL-0347L |
- |
39.37" (100cm) 10GbE SFP+ TO SFP+, Twinax copper cable |
SFP+ Cable |
CBL-NTWK-0456 |
- |
78.74" (200cm) 10GbE SFP+ TO SFP+, Twinax copper cable |
SFP+ Cable |
CBL-0348L |
- |
118.11" (300cm) 10GbE SFP+ TO SFP+, Twinax copper cable |
SFP+ Cable |
CBL-0349L |
- |
196.85" (500cm) 10GbE SFP+ TO SFP+, Twinax copper cable |
QSFP Cable |
CBL-NTWK-0719 |
- |
40GbE to 4x10GbE Breakout cable (1m) |
QSFP Cable |
CBL-NTWK-0720 (3m) |
- |
40GbE to 4x10GbE Breakout cable (3m) |
QSFP Cable |
CBL-NTWK-0721 (5m) |
- |
40GbE to 4x10GbE Breakout cable (5m) |
QSFP Cable |
CBL-NTWK-0417-01 |
- |
1M QSFP TO QSFP with EEPROM. 30AWG |
QSFP Cable |
CBL-NTWK-0325-02 |
- |
2M QSFP TO QSFP with EEPROM. 26AWG |
QSFP Cable |
CBL-NTWK-0446-01 |
- |
3M QSFP TO QSFP with EEPROM. 28AWG |
QSFP Cable |
CBL-NTWK-0422-01 |
- |
5M QSFP TO QSFP with EEPROM. 26AWG |
SFP+ Transceiver |
AOC-E10GSFPSR |
- |
SFP+ Transceiver for use with fiber cable connections |
Active Optic Cable |
CBL-QSFP+AOC-10M |
- |
40Gbe IB -QBR QSFP+ Active Optical Cable 850nm 10M |
40G QSFP+ Tranceiver |
AOM-TQSFP-79EEPZ-AVG |
- |
QSFP+ eSR4 Pluggable Fiber Optics for 40Gbe &10Gb ethernet |
40G QSFP+ Tranceiver |
AOM-TQSFP-79EQPZ-AVG |
- |
QSFP+ iSR4 Pluggable Fiber Optics for 40Gbe, 4x10Gb ethernet & Infiniband |
40G QSFP+ Tranceiver |
AOM-TQSFP-79EQDZ-AVG |
- |
40Gbe and Infiniband QSFP+ Pluggable Fiber Optics |
Optional Parts List ( Infiniband )
|
Part Number |
Qty |
Description |
---|
InfiniBand |
CBL-NTWK-0942-MQ28E10M |
- |
InfiniBand, EDR, QSFP28, 100GbE, PASSIVE, LSZH, 1m, Mellanox |
InfiniBand |
CBL-NTWK-0942-MQ28E15M |
- |
InfiniBand, EDR, QSFP28, 100GbE, PASSIVE, LSZH, 1.5m, Mellanox |
InfiniBand |
CBL-NTWK-0942-MQ28E20M |
- |
InfiniBand, EDR, QSFP28, 100GbE, PASSIVE, LSZH, 2m, Mellanox |
InfiniBand |
CBL-NTWK-0942-MQ28E30M |
- |
InfiniBand, EDR, QSFP28, 100GbE, PASSIVE, LSZH, 3m, Mellanox |
Optional Parts List ( Omni-path )
|
Part Number |
Qty |
Description |
---|
Omni-Path |
CBL-NTWK-0892-OPC05 |
- |
Intel Omni-Path Passive Copper Cable QSFP28 26AWG 0.5M |
Omni-Path |
CBL-NTWK-0892-OPC10 |
- |
Intel Omni-Path Passive Copper Cable QSFP28 26AWG 1M |
Omni-Path |
CBL-NTWK-0892-OPC15 |
- |
Intel Omni-Path Passive Copper Cable QSFP28 26AWG 1.5M |
Omni-Path |
CBL-NTWK-0892-OPC20 |
- |
Intel Omni-Path Passive Copper Cable QSFP28 26AWG 2M |
Omni-Path |
CBL-NTWK-0892-OPC30 |
- |
Intel Omni-Path Passive Copper Cable QSFP28 26AWG 3M |
Omni-Path |
CBL-NTWK-0892-OPF30 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 3M |
Omni-Path |
CBL-NTWK-0892-OPF50 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 5M |
Omni-Path |
CBL-NTWK-0892-OPF100 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 10M |
Omni-Path |
CBL-NTWK-0892-OPF150 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 15M |
Omni-Path |
CBL-NTWK-0892-OPF200 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 20M |
Omni-Path |
CBL-NTWK-0892-OPF300 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 30M |
Omni-Path |
CBL-NTWK-0892-OPF400 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 40M |
Omni-Path |
CBL-NTWK-0892-OPF500 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 50M |
Omni-Path |
CBL-NTWK-0892-OPF600 |
- |
Intel Omni-Path Active Fiber Cable QSFP28-MPO 60M |
|