K-144T and K-168T Networking

IN THIS ARTICLE

This article explains how to network a Qumulo cluster that uses K-144T or K-168T nodes.

REQUIREMENTS

• K-144T or K-168T hardware
• A network Switch that meets the following criteria:
  
  • 10 Gbps ethernet
  • Fully non-blocking architecture
  • IPv6 capable
• Compatible network cables
• Enough ports to connect all nodes to the same switch fabric
• One static IP per node per defined VLAN

RECOMMENDATIONS

• One set of redundant switches
• Jumbo Frame support with a minimum of 9000 MTU configured on your Qumulo cluster
• One physical connection per node to each redundant switch
• One LACP port-channel on each node with the following configuration:
  • Active mode
  • Slow transmit rate
  • Trunk port with a native VLAN
• DNS servers
• Time server (NTP)
• Firewall protocol/ports allowed for Proactive Monitoring
• N-1 (N=number of nodes) floating IPs per node per client-facing VLAN
  Note: The number of floating IPs depends on your workflow and clients connecting to the cluster, with a minimum of 2 floating IPs per node per client-facing VLAN, but no more than 10 floating IPs per node per client-facing VLAN.

DETAILS

The  K-144T and K-168T nodes use a networking configuration where both back end and front end traffic are handled by the same NIC. 

Caution: Don't use the LOM ports. Use only the external NIC ports for the 10Gb connections.

For reliability, the recommended configuration is fully-cabled where both ports on each node should be connected. Connecting a single port on the NIC is not recommended, because if the single connection fails, the node will be unavailable. 

Connect to Redundant Switches 

The details below outline how to connect a four-node K-144T or K-168T cluster to dual switches for redundancy. This is the recommended configuration for K-144T or K-168T hardware. If either switch goes down, the cluster will still be accessible from the remaining switch.

• The two 10 Gb NIC ports on the nodes are connected to separate switches
• Uplinks to the client network should equal the bandwidth from the cluster to the switch
• The two ports form an LACP port channel through a multi-chassis link aggregation group

Connect to a Single Switch

The details below outline how to connect a four-node  K-144T or K-168T cluster to a single switch. Note if this switch goes down, the cluster will not be accessible.

• Each node contains two 10 Gb ports that are connected to the switch
• Uplinks to the client network should equal the bandwidth from the cluster to the switch
• The two ports form an LACP port channel 

For IPMI configuration details, such as port location and configuration, see IPMI Reference Guide for K-144T and K-168T.

ADDITIONAL RESOURCES

QQ CLI: Networks and IP Addresses