Print Email PDF

K-144T and K-168T Networking

IN THIS ARTICLE

This article explains how to network a Qumulo cluster that uses K-144T or K-168T nodes.

REQUIREMENTS

  • K-144T or K-168T hardware
  • A network Switch that meets the following criteria:
    • 10 Gbps ethernet
    • Fully non-blocking architecture
    • IPv6 capable
  • Compatible network cables
  • Enough ports to connect all nodes to the same switch fabric
  • One static IP per node per defined VLAN

RECOMMENDATIONS

  • One set of redundant switches
    • Jumbo Frame support with a minimum of 9000 MTU 
  • One physical connection per node to each redundant switch
  • One LACP port-channel on each node with the following configuration:
    • Active mode
    • Slow transmit rate
    • Trunk port with a native VLAN
  • DNS servers
  • Time server (NTP)
  • Firewall protocol/ports allowed for Proactive Monitoring
  • N-1 (N=number of nodes) floating IPs per node per client-facing VLAN
    Note: The number of floating IPs depends on your workflow and clients connecting to the cluster, with a minimum of 2 floating IPs per node per client-facing VLAN, but no more than 10 floating IPs per node per client-facing VLAN or 70 floating IPs per namespace.

DETAILS

The K-144T and K-168T nodes use a networking configuration where both back end and front end traffic are handled by the same NIC. 

Caution: Don't use the LOM ports. Use only the external NIC ports for the 10Gb connections.
port_diagram.png

For reliability, the recommended configuration is fully-cabled where both ports on each node should be connected. Connecting a single port on the NIC is not recommended, because if the single connection fails, the node will be unavailable. 

Connect to Redundant Switches 

The details below outline how to connect a four-node K-144T or K-168T cluster to dual switches for redundancy. This is the recommended configuration for K-144T or K-168T hardware. If either switch goes down, the cluster will still be accessible from the remaining switch.

  • The two 10 Gb NIC ports on the nodes are connected to separate switches
  • Uplinks to the client network should equal the bandwidth from the cluster to the switch
  • The two ports form an LACP port channel through a multi-chassis link aggregation group

Connect to a Single Switch

The details below outline how to connect a four-node K-144T or K-168T cluster to a single switch. Note if this switch goes down, the cluster will not be accessible.

  • Each node contains two 10 Gb ports that are connected to the switch
  • Uplinks to the client network should equal the bandwidth from the cluster to the switch
  • The two ports form an LACP port channel 

Tip: For IPMI configuration details, such as port location and configuration, see IPMI Quick Reference Guide for K-144T and K-168T.

ADDITIONAL RESOURCES

QQ CLI: Networks and IP Addresses

 

Like what you see? Share this article with your network! 

Was this article helpful?
0 out of 0 found this helpful

Comments

0 comments

Please sign in to leave a comment.

Have more questions?
Open a Case
Share it, if you like it.