Скачать или смотреть Airflow Tutorial: Automate SFTP Operations using Apache Airflow

While not necessary, if you enjoyed this video, buying me a coffee is greatly appreciated!
https://www.buymeacoffee.com/prodprog... (no refunds)

I do so much work with SFTP servers that I have been looking for solutions to help automate some of this repetitive work. One possible solution that I have been looking into is Apache Airflow. In this video, I give a tour of Apache Airflow's features and how you can go about writing Airflow workflows (DAGs) that download and upload files from SFTP servers.

Code from this tutorial:

airflow-installation.txt:
https://gist.github.com/productivity-...

sftp_operators_workflow.py:
https://gist.github.com/productivity-...

sftp_hooks_workflow.py:
https://gist.github.com/productivity-...

Introduction: 00:00
Installing Airflow: 00:55
First Airflow DAG/Workflow: 01:29
Configuring SFTP Connections: 03:25
Triggering the DAG/Workflow: 07:28
Problems with this Workflow: 10:19
Using Airflow Hooks: 11:53