I Built Vercel in 2 Hours (Kafka, ClickHouse, Postgres) | Log Collection and Pipeline

Signup to Aiven (300 credits + 100 extra credits by using this link) https://console.aiven.io/signup?refer...

In this video, we will build the Log collections and aggregation pipeline of Vercel Clone that we built in the last video.

Part 1 (Vercel Clone):    • I built Vercel in 2 Hours (System Des...  

Kafka Crash Course:    • Apache Kafka Crash Course | What is K...  

Source Code (v2.0): https://github.com/piyushgarg-dev/ver...
Whiteboard Diagram: https://app.eraser.io/workspace/xMG5D...
ClickHouse SQL Command: https://gist.github.com/piyushgarg-de...

Quick Links
Full Stack Twitter Clone https://learn.piyushgarg.dev/learn/tw...
Docker Course https://learn.piyushgarg.dev/learn/do...
Master NextJS 14 https://learn.piyushgarg.dev/learn/ne...

Timestamps
00:00 Introduction
00:50 Recap (Architecture V1.0)
03:18 Database Integration and Log Aggregation
04:41 Database Schema Design
09:25 Postgresql Prisma Database Setup
28:45 Kafka and Clickhouse DB for Log Collection
44:22 Setting up Kafka Consumer
1:00:00 Querying Logs from Clickhouse DB
1:04:00 Subdomain Reverse Proxy Mapping
1:12:00 Outro

Video Titles
- Build Vercel Server Clone
- How to Build Vercel
- I Coded Vercel
- Clickhouse DB Log Collection

Hashtags
#nodejs #redis #docker #nextjs #vercel #kafka #fullstackwebdevelopment #mernstack #webdevelopment