dbt Cloud Orchestration Beta
Use dbt Cloud* Orchestration to trigger transformation runs from Fivetran.
Overview
Fivetran integrates with dbt Cloud so that you can trigger job runs based on your connector syncs or a frequency-based schedule. Dbt Cloud is dbt Lab’s hosted transformations product that lets you run sophisticated transformations. Orchestration allows you to take advantage of dbt Cloud jobs, projects, browser-based IDE, and data lineage while coordinating with Fivetran connectors.
Setup guide
Follow our step-by-step dbt Cloud Orchestration setup guide to trigger transformation runs from Fivetran.
Scheduling
Scheduling with dbt Cloud reflects transformation scheduling. Our dbt Cloud-integrated scheduler requires you to select the connectors you want to trigger dbt Cloud jobs, versus our dbt Core scheduler, which infers associated connectors automatically through lineage and output models.
There are two types of available scheduling:
- Custom Scheduling: Run transformations on a set schedule, with the ability to specify a specific time of day for once-per-day runs.
- Integrated Scheduling: Trigger transformation runs based on selected connectors' sync schedules.
Limitations
- You can only set up a single project per destination. If you want to set up an already selected project on another destination, you must first remove it from the previous one.
- Integrated scheduling requires that all connectors that are triggering a dbt Cloud job be associated with the same destination.
- Connector syncs trigger dbt Cloud runs regardless of if new data lands with a sync.
Let us know if you would like to see more features by emailing us at: james.hooker@fivetran.com.
* dbt Cloud is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.