IN THIS ARTICLE
- Outlines how QSFS makes use of SSDs in Qumulo Core.
- Cluster running Qumulo Core
In Qumulo Core, QSFS makes use of SSDs in 2 ways.
- 80% of SSD capacity serves as a naive read cache
- Currently, 80% of the usable SSD capacity (~2.6TB on a 4-node QC24; ~4.2TB on a 4-node QC208) is reserved as a read cache. As of the current release, the heuristics for determining what data is kept in this read cache is naive and unpredictable. It is based on a combination of what data has been written most recently and what data has been expired from SSDs to HDDs.
- Read performance is therefore determined by whether the data is in the cache. This is why we supply both cached and uncached read performance measurements.
- 20% of SSD capacity serves as a buffer to satisfy a burst write workload
- Assuming you have already written enough data to fill the 80% of SSD capacity reserved for the read cache (~2.6TB on a QC24), a helpful analogy for the remaining 20% of SSD capacity is a sink and drain:
Data being written to the cluster comes in through the faucet at a fast speed (we call this “Burst” write speed). At the same time, data is expired, or ‘drained’, to HDDs at a slower rate (this rate is determined in large part by the speed of HDDs). If data continues to be written to the cluster such that the drain can’t keep up and the sink fills up, further writes will be limited to the speed of the drain--we call this “Sustained” Write speed. You can think of the faucet being turned down such that the sink does not overflow. As soon as the cluster stops receiving writes (the faucet turns off or down), expiration (‘draining’) will continue until the sink is empty (meaning this 20% of SSD capacity is available again as a cushion for burst writes). Workloads that involve deleting or overwriting data quickly after it is written will enjoy a longer Burst period or a higher Sustained write speed because the cluster will not have to expire (or 'drain') this data.
Currently, a 4-node QC24 cluster under maximum write load will enjoy Burst speed for ~86 minutes.
You should now understand Qumulo Core's current hybrid architecture.
Like what you see? Share this article with your network!