📄️ Airflow Best Practices
This page should serve as a reference for tips and tricks that we recommend for the best Airflow experience. Please read the official Airflow Best Practices doc first.
📄️ Airflow Config Defaults
For security reasons, we do not expose the Airflow config to end users via the Airflow *Admin -> Configuration menu option.
📄️ Airflow Variables
Datacoves injects several environment variables into Apache Airflow to streamline workflow configurations. Below is a list of important variables you may encounter:
📄️ DAG Generators
Within dbt-coves generate airflow-dags, DAG Generators are responsible of outputting Python code for Airflow Task Groups from other services.
📄️ Datacoves Airflow Decorators
With the introduction of the task flow API in Airflow we have released the Datacoves decorators to make writing DAGs simple!
📄️ Datacoves CLI Commands
The datacoves bash commands are meant to simplify your workflow. Currently, the datacoves command has the following sub commands:
📄️ Datacoves Environment Service Connection Variables
When creating a service connection and setting the Delivery Mode to environment variables, Datacoves will inject the following environment variables in Airflow.
📄️ Datacoves Operators
When utilizing dbt-coves to generate DAGs, it's crucial to grasp the functionality of the two frequently used operators and their behind-the-scenes operations, enhancing your Airflow experience.