Distributed SQLite with Litestream and LiteFS

Want to learn more SQLite? Check out the full course: https://highperformancesqlite.com.

Get production ready SQLite with Turso: https://tur.so/af.

Ben and Aaron discuss replication and backups in SQLite, Litestream and LiteFS, and future mad scientist projects Ben is working on.

Follow Ben:
• Ben Johnson on Twitter: https://x.com/benbjohnson
• Litestream: https://litestream.io/
• LiteFS: https://fly.io/docs/litefs/

Follow me:
Twitter:   / aarondfrancis  
LinkedIn:   / aarondfrancis  
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.

Chapters:
00:00 - Introduction
01:02 - Ben Johnson's Role at Fly.io
02:27 - Creating BoltDB for Shopify
04:45 - Litestream Overview and Technical Details
05:50 - Running Databases Next to Applications
06:48 - Backing Up SQL Databases with Litestream
07:45 - Preventing Data Loss with Continuous Backup
09:03 - WAL Mode and Checkpointing in SQLite
12:12 - How Litestream Works and Design Goals
14:05 - Shadow WAL and Network Latency Handling
18:00 - Data Compression and File Recovery
19:54 - Handling Transactions and Shadow WALs in Practice
22:05 - Litestream Recovery Process and Best Practices
24:02 - Introducing LightFS for Distributed SQLite
28:40 - Using LightFS as a Custom Filesystem
31:25 - Failover and Read Replicas with LightFS
34:15 - Right Forwarding and Application Consistency
36:00 - Getting Started with LightFS on Fly.io
37:45 - Vision for Litestream and LightFS
39:00 - LightFS Cloud: A Paid Backup Service
41:10 - SQLite Performance and Simplicity
43:15 - The Growing Popularity of SQLite
45:20 - Use Cases for SQLite in Modern Applications
49:00 - Future Possibilities: Remote SQLite over SSH
52:05 - The SQLite Community and Innovation
54:00 - Where to Follow Ben Johnson