Creating Your First Airflow DAG for External Python Scripts

I show how to start automatically triggering or scheduling external python scripts using Apache Airflow. Here are the steps:
Clone repo at https://github.com/vastevenson/vs-air...
Make sure that pip is fully upgraded prior to proceeding
Run command: pip install apache-airflow (note this will install the most recent, stable version of Airflow, no need to specify exact version or constraints)
Install Docker and Docker Compose
Run command docker-compose up -d from the directory with the Dockerfile exists
Confirm that you can hit localhost:8080 with a GET request, should see Airflow UI
You can also monitor the logs of the Airflow environment as follows: docker-compose logs
You can stop the Airflow environment as follows: docker-compose down

Note: referencing external Python scripts can only be done from the directory where you’ve configured Airflow to look for dags.