Dell EMC PowerEdge and Canonical Charmed Ceph, a proven solution
Philip Williams
on 22 November 2021
Tags: ceph , data center , Dell , Storage
Here at Canonical, we have lots of industry partnerships where we work jointly, hand-in-hand, to produce the best possible outcomes for the open source community. From getting early access to next generation hardware to ensure Ubuntu is fully compatible when it’s released, to creating solution orientated reference architectures for products built on top of Ubuntu like Charmed Ceph, Canonical is committed to engineering the best possible computing experience.
Recently, our product management and hardware alliances teams came together with Dell Technologies to collaboratively define, test, and validate a Dell EMC PowerEdge based Charmed Ceph reference architecture.
Reference architecture
The goal of this exercise was to produce a guide to building a capacity orientated Ceph cluster that could be used for block (RBD), file (CephFS) or object (Swift or S3) workloads, and demonstrate the performance that can be achieved with similar hardware.
We took relatively standard components (four Dell EMC R740xd2 servers with Intel Xeon processors and NICs, a few SSDs, and lots of high capacity NL-SAS disks) and connected them all together with 25GbE networking.
The R740xd2 provides an ideal building block for Ceph clusters due to its highly configurable nature, which allows users to make performance, capacity, and price adjustments as needed. For example, to create a higher performance cluster, the CPUs could be swapped for another model that has more cores and cache, and the disks could be changed to NVMe and/or SSD if required.
Learn more
During this exercise, we tested the performance of the cluster with various different workloads, such as small block and large block, with and without bcache.
We also demonstrated the scalability of Ceph, by adding an extra storage node and re-running the performance tests to show the improvement in cluster performance. We were able to achieve over 75,000 random read IOPs, and over 6 GBps sequential read from a 4 node capacity orientated cluster, as well as demonstrating how our unique OSD deployment approach using bcache can provide up to 2.5x improvement in performance for small block workloads.
All of the test results and detailed hardware architecture information can be found in the whitepaper on Dell Technologies InfoHub, here. We also discussed our findings in this webinar which can be watched back on-demand.
What is Ceph?
Ceph is a software-defined storage (SDS) solution designed to address the object, block, and file storage needs of
both small and large data centres.
It's an optimised and easy-to-integrate solution for companies adopting open source as the new norm for high-growth
block storage, object stores and data lakes.
Newsletter signup
Related posts
What is object storage?
Object storage is a type of storage where data is manipulated as distinct units. It has accompanied the cloud computing revolution, with S3 (Simple Storage...
CentOS EOL – What does it mean for Ceph storage?
Out of the darkness and into the light, a new path forward Back in 2020, the CentOS Project announced that they would focus only on CentOS Stream, meaning...
Ceph Storage for AI
Use open source Ceph storage to fuel your AI vision The use of AI is a hot topic for any organisation right now. The allure of operational insights, profit,...