How Discord Migrated Trillions of Messages from Cassandra to ScyllaDB

🎥 Watch all the latest ScyllaDB Summit talks here: https://www.scylladb.com/scylladb-sum...

Note: Subtitles are available.

Learn why and how Discord’s persistence team recently completed their most ambitious migration yet: moving their massive set of trillions of messages from Cassandra to ScyllaDB. Bo Ingram, Senior Software Engineer at Discord, provides a technical look, including:

Their reasons for moving from Apache Cassandra to ScyllaDB
Their strategy for migrating trillions of messages
How they designed a new storage topology – using a hybrid-RAID1 architecture – for extremely low latency on GCP
The role of their existing Rust messages service, new Rust data service library, and new Rust data migrator in this project
What they’ve achieved so far, lessons learned, and what they’re tackling next