How to avoid common mistakes with using Apache Kafka

How do you develop a robust applications dealing with Kafka? How can we use CI/CD to make our life simpler? How to handle invalid messages, schema evolution, and data quality? Many challenges ahead. Here, I will focus on common mistakes and challenges in the Kafka landscape and how to mitigate them. We will cover how CI/CD practices help address these issues and their limitations. We'll discuss how to deal with poison pills and DLQ (what makes a good DLQ?), and how to deal with your Product Owner requirements. Finally, we'll compare the creation of a custom SDK versus using a Kafka proxy, and look ahead to future innovations that could transform the Kafka landscape. Don't miss this opportunity to enhance your Kafka knowledge and skills.