Edit on github

Configuring Airflow

You don't need Airflow to begin using Datacoves, but at some point you will want to schedule your dbt jobs. The following steps will help you get started using Airflow. Keep in mind this is the basic setup, you can find additional Aiflow information in the how-tos and reference sections.

  1. To complete the initial configuration of Airflow, you will need to make changes to your project. This includes creating the dbt profile for Airflow to use as well as the Airflow DAG files that will schedule your dbt runs.

    Initial Airflow Setup

  2. Airflow will authenticate to your data warehouse using a service connection. The credentials defined here will be used by dbt when your jobs run.

    Setup Service Connection

  3. Datacoves uses a specific folder structure for Airflow. You will need to add some folders and files to your repository for Airflow to function as expected.

    Update Repository

  4. When Airflow jobs run you may want to receive notifications. We have a few ways to send notifications in Datacoves. Choose the option that makes sense for your use case.

Getting Started Next Steps

Once Airflow is configured, you can begin scheduling your dbt jobs by creating Airflow DAGs !