System Columns and Tableslink
Updated November 16, 2023
We value transparency and want you to have complete access about what Fivetran does with your data, so we created system columns and tables, which is something like metadata about your data.
System columnslink
Wherever applicable, Fivetran adds extra columns to every table that is added to your destination, to give you insight into the progress and changes of your integration:
_fivetran_synced(UTC TIMESTAMP) indicates the time when Fivetran last successfully synced the row._fivetran_deleted(BOOLEAN) to mark rows that were deleted or the past versions of the rows changed in the source system._fivetran_index(INTEGER) enables the user to make sense of the order of updates for primary keyless tables._fivetran_id(TEXT) is a Fivetran-generated internal unique surrogate primary key. Its value is generated based on the row's set of values and helps us avoid duplicate rows in primary keyless tables.
When you activate history mode for a table, Fivetran adds the following three extra columns:
_fivetran_active(BOOLEAN) to identify an active record._fivetran_start(UTC DATETIME) to record the time that a record is ingested by Fivetran. This value may not be identical to the time the record was created in the source system._fivetran_end(UTC DATETIME) to record the time when a record became inactive in the source system.
NOTE: When you activate history mode for a table, you can opt to remove the
_fivetran_deletedcolumn for that table.
Other system tableslink
Certain integrations have unique Fivetran-created system tables that give specific information about that integration. See each individual integration page for more information.
MAR impactlink
Fivetran's system tables count towards free Monthly Active Rows (MAR):
FIVETRAN_API_CALLFIVETRAN_FORMULAFIVETRAN_FORMULA_FAILURE_REASONFIVETRAN_FORMULA_MODELFIVETRAN_QUERYFIVETRAN_PICKLIST_FIELDFIVETRAN_PICKLIST_FIELD_VALUEFIVETRAN_DEPENDENT_PICKLIST_RELATION
The MAR that the Fivetran Platform Connector generates is free.