IN THIS ARTICLE
Outlines how to utilize Continuous Replication with Qumulo Core 2.11.2 and above
- Replication Page Overview
- Create a Replication Relationship
- Authorize a Replication Relationship
- Edit a Replication Relationship
- Delete a Replication Relationship
- Additional Considerations
- Admin privileges required
- Source and target cluster running the same version of Qumulo Core 2.11.2 or above on any model of Qumulo hardware, including HPE
IMPORTANT! Replication between different versions is supported if either the source or target cluster is running version 2.12.0 of Qumulo Core or above. Check out the Replication: Version Requirements and Upgrade Recommendations article for more info.
Continuous Replication creates a copy of the data in a directory on your cluster and transfers it to a directory on a second target cluster. While Continuous Replication is running, Qumulo Core scans modified files for any changed regions and only sends those changes over to the target so that job runtime is proportional to the amount of data changes made. With the help of snapshots, Continuous Replication generates a point-in-time consistent copy of the source directory on the target cluster.
Replication Page Overview
In the Web UI, hover over the Cluster menu on the Source Cluster and select Replication under the Configurations section in the dropdown.
A list of replication relationships will display with the following details:
Source: specifies the file path of the source directory and displays the number of relationships
Target: specifies the file path of the target directory
Recovery Point: displays a timestamp from the last successful Replication on the source cluster and represents the time Qumulo Core took a snapshot of the source directory and started moving data across to the target
Status: represents the current status of each relationship including Replicating, Blackout Window, Awaiting Authorization, etc.
Actions: clickable menu ( ) that includes options like enable continuous replication, edit relationship, or delete relationship
In-between the Source and Target columns, you'll see a symbol on each replication job listing that represents the current status. Reference the table below:
Create a Replication Relationship
- Click the Create Relationship button on the replication page of the Source cluster .
- Fill in the following fields:
- Source Directory Path: path of the existing directory you wish to replicate
- Target Directory Path: path of existing directory on the target cluster where you wish to replicate data
- Target Address: one of the IP (preferably floating IP) addresses from a node on the target cluster
- Port Number: select the default port option 3712 or create a custom port configuration
NOTE: Custom port configuration may be necessary to meet enterprise network firewall rules. To override, select the Custom radio button and enter the port number. For questions on custom port configuration, reach out to Qumulo Care for additional information.
Verify that Continuous Replication is Enabled.
- Click Add Blackout Window.
Select the day(s) or times to suspend replication between the source and target directories.
- To add up to 10 additional blackout windows, click the + Add Blackout Window button
- For additional details, check out the Replication: Blackout Windows article
- Enable the Map Local User/Group IDs to Associated NFS IDs option (2.12.6 and above) to replicate files using locally-owned NFS IDs.
- See the Replication: NFS ID Mapping article for full details.
Click Save Relationship.
The relationship will now be available on the replication page where you can see the status and manage the replication job. A replication job will not start until the relationship has been authorized on the Target cluster. Continue on to the next section for steps on how to Authorize a Replication Relationship.
Authorize a Replication Relationship
- Log on to the Target cluster.
- Click See Details on the authorization request notification banner.
- Click Accept on the replication page to authorize the relationship.
IMPORTANT! Replication will not start if you are currently in a blackout window or if Continuous Replication for that relationship is disabled.
While a replication job is running, a progress bar will display on the replication page under the status column. Note that the percentage reflects both the number of files to be moved as well as the amount of data to be transferred and is not based solely on the amount of data being replicated.
Click on the Details option to review the Throughput, Run Time, and Data statistics of the current job in progress. Files that have not changed since the previous replication job will be reflected in the Unchanged column and will not be transferred.
Edit a Replication Relationship
- Click the menu underneath the Actions column on the replication relationship listing.
- Select the Edit relationship... option.
- Edit the settings and click Save Relationship.
- Note that you cannot edit the source and target directory paths. To make these changes, you must create a new relationship.
Delete a Replication Relationship
- Click menu underneath the Actions column on the replication relationship listing.
- Select the Delete relationship... option.
- Click Yes, Delete when prompted.
- Upgrading Qumulo Core while a replication job is running will cause the job in progress to fail. Once both clusters return to a state where replication is possible (same version), Continuous Replication can resume. Please wait until after the replication job completes to perform any upgrades.
- Utilizing Continuous Replication will increase load on the cluster and may cause latency delays depending on the applications in use while a job is running.
- At the beginning of a replication job, a snapshot is created for the directory. The old snapshot is programmatically deleted when it is no longer needed. There will be one reference snapshot used for replication on the cluster at all times. Admins can view the snapshot(s) used for replication along with other policy-based snapshots.
- A snapshot is taken of the directory on the target cluster at the conclusion of each successful job. The previous snapshot is then deleted so the directory always contains only the most recent snapshot.
- Target directory permissions will be updated from read/write to read-only when a replication relationship is created. If the relationship is deleted, the permissions will revert to read/write automatically.
- A replication relationship that includes the root directory of the target cluster is not permitted unless you are running version 2.12.0 or above. Including the root directory makes the entire target cluster read-only and may prohibit administrative functions such as upgrades. Check out the Replication: Version Requirements and Upgrade Recommendations article for more details.
- Continuous Replication does not support replicating local user or group information and will fail if it encounters a file associated with local users or groups.
- Qumulo Core supports up to 100 replication relationships.
You should now be able to successfully configure and manage Continuous Replication in Qumulo Core 2.11.2 and above
Like what you see? Share this article with your network!