Warp Solutions: Estuary & WarpStream

Series: Warp Solutions
Subject: Use Estuary to pipe data from WarpStream to MotherDuck
Guest: Dani Pálma - Data Engineer at Estuary

Dani and Shawn spin up a serverless WarpStream Apache Kafka-compatible cluster and then use ShadowTraffic to pipe simulated data for Customers and Orders into it. After that, they configure Estuary to connect to the WarpStream cluster as a source and MotherDuck as a destination. Finally, the data is piped into MotherDuck, and basic queries are performed.

www.warpstream.com
www.estuary.dev

ShadowTraffic was used for the creation of the sample data, available at shadowtraffic.io
MotherDuck was used as the destination for the streaming data.

#apachekafka #warpstream #streambased #duckdb #datastreaming #dataengineering