Bhavani Ravi - Apache Airflow in Production - Bad vs Best Practices

Apache Airflow has become a popular open-source platform for managing and orchestrating data pipelines. However, as with any technology, there are good and bad ways to use it. This talk will explore the bad and best practices when deploying Apache Airflow in a production environment. From common pitfalls, such as misconfigured tasks and lack of scalability, to best practices, such as robust monitoring and proper security measures, this talk will provide practical advice for anyone looking to implement Apache Airflow in their production environment.

Speaker: Bhavani Ravi

More: https://2023.berlinbuzzwords.de/sessi...

Web: https://2023.berlinbuzzwords.de/
Fediverse: https://floss.social/@berlinbuzzwords
Linkedin:   / 13978964  
Twitter:   / berlinbuzzwords