IN THIS ARTICLE
This article explains how to network a Qumulo cluster that uses K-144T or K-168T nodes.
REQUIREMENTS
- K-144T or K-168T hardware
- A network Switch that meets the following criteria:
- 10 Gbps ethernet
- Fully non-blocking architecture
- IPv6 capable
- Compatible network cables
- Enough ports to connect all nodes to the same switch fabric
- One static IP per node per defined VLAN
RECOMMENDATIONS
- One set of redundant switches
- Jumbo Frame support with a minimum of 9000 MTU configured on your Qumulo cluster
- One physical connection per node to each redundant switch
- One LACP port-channel on each node with the following configuration:
- Active mode
- Slow transmit rate
- Trunk port with a native VLAN
- DNS servers
- Time server (NTP)
- Firewall protocol/ports allowed for Proactive Monitoring
- N-1 (N=number of nodes) floating IPs per node per client-facing VLAN
Note: The number of floating IPs depends on your workflow and clients connecting to the cluster, with a minimum of 2 floating IPs per node per client-facing VLAN, but no more than 10 floating IPs per node per client-facing VLAN.
DETAILS
The K-144T and K-168T nodes use a networking configuration where both back end and front end traffic are handled by the same NIC.
Caution: Don't use the LOM ports. Use only the external NIC ports for the 10Gb connections.
For reliability, the recommended configuration is fully-cabled where both ports on each node should be connected. Connecting a single port on the NIC is not recommended, because if the single connection fails, the node will be unavailable.
Connect to Redundant Switches
The details below outline how to connect a four-node K-144T or K-168T cluster to dual switches for redundancy. This is the recommended configuration for K-144T or K-168T hardware. If either switch goes down, the cluster will still be accessible from the remaining switch.
- The two 10 Gb NIC ports on the nodes are connected to separate switches
- Uplinks to the client network should equal the bandwidth from the cluster to the switch
- The two ports form an LACP port channel through a multi-chassis link aggregation group
Connect to a Single Switch
The details below outline how to connect a four-node K-144T or K-168T cluster to a single switch. Note if this switch goes down, the cluster will not be accessible.
- Each node contains two 10 Gb ports that are connected to the switch
- Uplinks to the client network should equal the bandwidth from the cluster to the switch
- The two ports form an LACP port channel
For IPMI configuration details, such as port location and configuration, see IPMI Reference Guide for K-144T and K-168T.
Comments
0 comments