Скачать или смотреть MariaDB Airflow Connector - Hooks and Operators

In this video, I showcase my submission for the MariaDB-Python Hackathon — a fully functional Apache Airflow MariaDB Connector that brings native MariaDB support to Airflow.
Unlike the traditional MySQL connector, this plugin uses the MariaDB Python library, enabling:

Faster data operations (executemany, select, JSON updates)

Direct integration with MariaDB ColumnStore

High-speed bulk loading via cpimport abstraction

Seamless data transfers between MariaDB and S3

I also walk through an OpenFlights ETL DAG that downloads, loads, and analyzes data in MariaDB, demonstrating the connector’s efficiency and scalability.

Tech Stack: Apache Airflow | MariaDB ColumnStore | Python (mariadb lib) | AWS S3 (LocalStack) | Docker

#mariadb #database #dataengineering