Does Fivetran Support Delta Lake CDF on Databricks Destinations?

Question

Does Fivetran support enabling Delta Lake change data feed (CDF) on Databricks destination tables?

Environment

Destination: Databricks

Answer

Yes. Fivetran supports enabling Delta Lake change data feed (CDF) on Databricks destination tables.

Enabling CDF on a Databricks Delta table:

• Does not prevent us from syncing to the table.
• Does not require you to update your connection configuration.
• Does not alter the table schema used by Fivetran.

We continue to sync data to the table as normal after you enable CDF.

Considerations

• CDF captures changes only from the time it is enabled.
• Storage usage may increase due to retained change logs, depending on your Databricks retention settings.
• Delta protocol versions must meet Databricks requirements for CDF:
  • minReaderVersion = 1
  • minWriterVersion = 4 or higher

These protocol settings are automatically updated by Databricks when CDF is enabled.

For more information, see the Databricks documentation on change data feed.