Configuring logs in airflow.cfg
We had our first contact with the airflow.cfg file in the Storing log files in a remote location recipe. At a glance, we saw how powerful and handy this configuration file is. There are many ways to customize and improve Airflow just by editing it.
This exercise will teach how you to enhance your logs by setting applicable configurations in the airflow.cfg file.
Getting ready
Refer to the Technical requirements section for this recipe, since we will handle it with the same technology.
Airflow DAG code
To avoid redundancy and focus on the goal of this recipe, which is to configure remote logging in Airflow, we will use the same DAG as the Creating basic logs in Airflow recipe. However, feel free to create another DAG with a different name but the same code.
How to do it…
Since we will use the same DAG code from Creating basic logs in Airflow, let’s jump right to the required configuration to format our logs...
