Ceph Data Placement with Upmap / Introducing Chorus | Ceph Days NYC 2024

Ceph data placement is a simple yet nuanced subject. Using it's secret sauce "CRUSH", Ceph empowers organizations to easily implement complex data placement policies in a way which maximizes the reliability of the storage infrastructure. However CRUSH is not perfect -- imbalances lead to costly space inefficiencies. To fix this, Ceph introduce the upmap balancer several releases ago. But the internal mechanism upmap created a new opportunity in Ceph -- arbitrary data placement to enable new and extremely powerful cluster maintenance operations.

In this talk, Dan will describe "how it works" internally, and present practical easy to use tools to make the lives of Ceph operators better.

One more thing... Dan will conclude with an introduction of Chorus, a Swiss-Army Knife frontend for S3.