Chunked Responses: Scaling File Exports for Production

While it's possible to build file export features that work on your machine, it's important to keep track of memory usage. Using Elixir's Stream module and chunked responses, it's possible to dramatically reduce memory consumption per request—allowing your application to go further without needing massive servers.

In this video, I walk through the process of optimizing a demo app's CSV export feature. Along the way, you'll learn about the difference between eager and lazy processing of enumerable data.

Links
Screen recording software I use (affiliate): https://screen.studio/@Yy75o
Project source repo: https://github.com/ChristianAlexander...

Timestamps
DEMO - 00:00
The Project - 1:04
Observing Memory - 3:18
Streaming - 4:30
Building a Stream - 5:30
RESULTS - 7:37