January 2025

Connector SDK

Fivetran Connector SDK

Edit connection details

You can now update your connection configuration in the dashboard. To do so, log into your dashboard, go to the Setup tab of your SDK connection, and click Edit connection details. This enables you to deploy an SDK connection without specifying any configuration details, and then later adding the configuration through the setup form.

100 fields maximum in configuration.json

No more than 100 fields are allowed in the configuration.json when deploying your SDK connection.

`fivetran-connector-sdk` PyPI package

We have released version 0.13.10.1 of the fivetran-connector-sdk PyPI package. This release adds the following:

A user confirmation prompt to automatically update faulty requirements.txt files.
Added support for installing packages directly from Git sources via requirements.txt.
Enhanced logging and exception handling for improved debugging and reliability.

Lite Connectors

Lite connectors are now available for the following sources:

Transformations for dbt Core

Updated dbt Quickstart packages

We have updated the Quickstart packages for the following connectors:

Marketo to version 0.13.1
Qualtrics to version 0.3.0
Quickbooks to version 0.17.1
Servicenow to version 0.4.0
Shopify to version 0.15.0
Zendesk Support to version 0.19.3
Zuora to version 0.3.1

New connectors

CockroachDB

CockroachDB is a horizontally-scaling, distributed SQL database. Read our CockroachDB documentation.

Schema changes

Chargebee Product Catalog 1.0

Effective January 3, 2025 we use a new January 2025 schema. Review the latest ERD to better understand the schema changes. Also, see our Schema Migrations article for more details.

We are making these schema changes to introduce feature enhancements and improve schema usability.

You should review the changes and update your downstream queries if necessary. Failing to do so may lead to missing or incomplete data in your data pipelines.

117 total changes • 56 possible breaking changes

Table/column	Change type	Old name	New name	Notes
`ADDON`
column	New Column		`proration_type`
`ADDON_TAX_PROVIDER_FIELD`
table	New Table		`ADDON_TAX_PROVIDER_FIELD`
`ADDON_TIER`
table	New Table		`ADDON_TIER`
`CREDIT_NOTE_DISCOUNT`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`credit_note_id`	`credit_note_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`CREDIT_NOTE_LINE_ITEM`
table	New Table
`CREDIT_NOTE_LINE_ITEM_DISCOUNT`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`credit_note_id`	`credit_note_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`CREDIT_NOTE_LINE_ITEM_TAX`
table	New Table
`CREDIT_NOTE_LINE_ITEM_TIER`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`credit_note_id`	`credit_note_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`CREDIT_NOTE_TAX`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`credit_note_id`	`credit_note_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`CUSTOMER_BALANCE`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`customer_id`	`customer_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`CUSTOMER_TAX_PROVIDER_FIELD`
table	New Table		`CUSTOMER_TAX_PROVIDER_FIELD`
`EVENT`
table	New Table		`EVENT`
`EVENT_METADATA`
table	New Table		`EVENT_METADATA`
`EVENT_WEBHOOK`
table	New Table		`EVENT_WEBHOOK`
`GIFT_TIMELINE`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`gift_id`	`gift_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`HOSTED_PAGE`
column	New Column		`business_entity_id`
`INVOICE`
column	New Column		`einvoice_reference_number`
column	New Column		`local_currency_exchange_rate`
column	New Column		`site_details_at_creation_organization_address_city`
column	New Column		`site_details_at_creation_organization_address_country_code`
column	New Column		`site_details_at_creation_organization_address_line_1`
column	New Column		`site_details_at_creation_organization_address_state`
column	New Column		`site_details_at_creation_organization_address_zip`
column	New Column		`site_details_at_creation_organization_email`
column	New Column		`site_details_at_creation_organization_name`
column	New Column		`site_details_at_creation_organization_phone`
column	New Column		`site_details_at_creation_organization_website`
column	New Column		`site_details_at_creation_timezone`
column	New Column		`statement_descriptor`
column	New Column		`statement_descriptor_id`
column	New Column		`tax_category`
column	New Column		`tax_origin_country`
column	New Column		`tax_origin_registration_number`
`INVOICE_DISCOUNT`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`invoice_id`	`invoice_id` 🔑	Added to primary key.
column	Primary Key Change	`invoice_updated_at`	`invoice_updated_at` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`INVOICE_DUNNING_ATTEMPT`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`invoice_id`	`invoice_id` 🔑	Added to primary key.
column	Primary Key Change	`invoice_updated_at`	`invoice_updated_at` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`INVOICE_LINE_ITEM`
table	New Table
`INVOICE_LINE_ITEM_DISCOUNT`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`invoice_id`	`invoice_id` 🔑	Added to primary key.
column	Primary Key Change	`invoice_updated_at`	`invoice_updated_at` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`INVOICE_LINE_ITEM_TAX`
table	New Table
`INVOICE_NOTE`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`invoice_id`	`invoice_id` 🔑	Added to primary key.
column	Primary Key Change	`invoice_updated_at`	`invoice_updated_at` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`INVOICE_TAX`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`invoice_id`	`invoice_id` 🔑	Added to primary key.
column	Primary Key Change	`invoice_updated_at`	`invoice_updated_at` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`LINE_ITEM`
table	Discontinued Table	`LINE_ITEM`		Data is available in the `INVOICE_LINE_ITEM`, `QUOTE_LINE_ITEM`, and `CREDIT_NOTE_LINE_ITEM` tables.
`LINE_ITEM_TAX`
table	Discontinued Table	`LINE_ITEM_TAX`		Data is available in the `INVOICE_LINE_ITEM_TAX`, `CREDIT_NOTE_LINE_ITEM_TAX`, `QUOTE_LINE_ITEM_TAX`, and `ORDER_LINE_ITEM_TAX` tables.
`ORDER_LINE_ITEM_DISCOUNT`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`order_id`	`order_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`ORDER_LINE_ITEM_TAX`
table	New Table	`_FIVETRAN_ID` 🔑		No longer a primary key.
`PAYMENT_SOURCE`
column	New Column		`bank_account_direct_debit_scheme`
column	New Column		`boleto_email`
column	New Column		`boleto_first_name`
column	New Column		`boleto_last_4`
column	New Column		`boleto_last_name`
column	New Column		`klarna_pay_now_email`
column	New Column		`venmo_user_name`
`PLAN_TAX_PROVIDER_FIELD`
table	New Table		`PLAN_TAX_PROVIDER_FIELD`
`PLAN_TIER`
table	New Table		`PLAN_TIER`
`QUOTE_DISCOUNT`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`quote_id`	`quote_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`QUOTE_LINE_ITEM`
table	New Table
`QUOTE_LINE_ITEM_DISCOUNT`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`quote_id`	`quote_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`QUOTE_LINE_ITEM_TAX`
table	New Table
`QUOTE_LINE_ITEM_TIER`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`quote_id`	`quote_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`QUOTE_TAX`
column	Discontinued Column	`_fivetran_id` 🔑		No longer a primary key.
column	Primary Key Change	`quote_id`	`quote_id` 🔑	Added to primary key.
column	Primary Key Change		`index` 🔑	New primary key.
`SUBSCRIPTION`
column	New Column		`contract_term_total_contract_value_before_tax`
`TIER`
table	Discontinued Table	`TIER`		Data is available in the `UNBILLED_CHARGE_TIER`, `ADDON_TIER`, and `PLAN_TIER` tables.
`TRANSACTION`
column	New Column		`custom_payment_method_id`
column	New Column		`custom_payment_method_name`
column	New Column		`error_cause_customer_message`
column	New Column		`error_cause_id`
column	New Column		`error_cause_merchant_message`
column	New Column		`error_detail_decline_code`
column	New Column		`error_detail_decline_message`
column	New Column		`error_detail_error_category`
column	New Column		`error_detail_error_code`
column	New Column		`error_detail_error_field`
column	New Column		`error_detail_error_message`
column	New Column		`error_detail_network_error_code`
column	New Column		`error_detail_network_error_message`
column	New Column		`error_detail_processor_error_code`
column	New Column		`error_detail_processor_error_message`
column	New Column		`error_detail_recommendation_code`
column	New Column		`error_detail_recommendation_message`
column	New Column		`error_detail_request_id`
`UNBILLED_CHARGE_TIER`
table	New Table		`UNBILLED_CHARGE_TIER`

Factbird

Effective January 15, 2025 we use a new January 2025 schema. Review the latest ERD to better understand the schema changes. Also, see our Schema Migrations article for more details.

We are updating the connector schema to improve schema usability.

You should review the changes and update your downstream queries if necessary. Failing to do so may lead to missing or incomplete data in your data pipelines.

4 total changes • 2 possible breaking changes

Table/column	Change type	Old name	New name	Notes
`OEE`
column	Primary Key Change	`_fivetran_id` 🔑	`_fivetran_id` 🔑	Primary key calculation change.
column	New Column		`consolidated_time_from`
column	New Column		`consolidated_time_to`
`SENSOR_GROUP`
column	Discontinued Column	`external_id`

LearnUpon

Effective January 13, 2025 we use a new January 2025 schema. Review the latest ERD to better understand the schema changes. Also, see our Schema Migrations article for more details.

We are updating the connector schema to support a new feature enhancement and improve schema usability.

You should review the changes and update your downstream queries if necessary. Failing to do so may lead to missing or incomplete data in your data pipelines.

17 total changes • 5 possible breaking changes

Table/column	Change type	Old name	New name
`COURSE`
column	New Column		`thumbnail_image_url`
`COURSE_INSTRUCTOR`
column	New Column		`created_at`
`ENROLLMENT`
column	New Column		`from_catalog`
column	New Column		`from_store`
column	New Column		`group_id`
column	New Column		`is_overdue`
column	New Column		`updated_at`
`GROUP_INVITIE`
column	New Column		`accept_url`
`GROUP_MEMBERSHIP`
column	Discontinued Column	`group_id`
column	Rename Column	`groups_id` 🔑	`group_id` 🔑
`LEARNING_PATH`
column	New Column		`thumbnail_image_url`
`MODULE`
column	New Column		`sequence`
`USER_CUSTOM_DATA`
column	Rename Column	`users_id` 🔑	`user_id` 🔑
`USER_CUSTOM_DATA_FIELD_VALUE`
column	Discontinued Column	`id`
column	Rename Column	`users_id` 🔑	`user_id` 🔑
`USERS`
column	New Column		`timezone_id`
column	New Column		`updated_at`

Medallia Agile Research

Effective January 6, 2025 we use a new January 2025 schema. Review the latest ERD to better understand the schema changes. Also, see our Schema Migrations article for more details.

We are updating the connector schema to support a new feature enhancement.

5 total changes • 0 possible breaking changes

Table/column	Change type	New name
`SURVEY_RESPONDENT_RESPONSE`
column	New Column	`data_label`
column	New Column	`response_caption`
column	New Column	`scale_value`
column	New Column	`score`
column	New Column	`value`

Partnerize

Effective January 8, 2025 we use a new January 2024 schema. Review the latest ERD to better understand the schema changes. Also, see our Schema Migrations article for more details.

We are updating the connector schema to adhere to standard naming conventions.

You should review the changes and update your downstream queries if necessary. Failing to do so may lead to missing or incomplete data in your data pipelines.

2 total changes • 2 possible breaking changes

Table/column	Change type	Old name	New name
`CAMPAIGN_TRANSACTION`
column	Rename Column	`created_by`	`publisher_created_by`
column	Rename Column	`reporting_timezone`	`publisher_reporting_timezone`

Rollbar

Effective January 6, 2025 we use a new January 2025 schema. Review the latest ERD to better understand the schema changes. Also, see our Schema Migrations article for more details.

We are updating the connector schema to improve schema usability.

You should review the changes and update your downstream queries if necessary. Failing to do so may lead to missing or incomplete data in your data pipelines.

6 total changes • 2 possible breaking changes

Table/column	Change type	Old name	New name	Notes
`ITEM_OCCURRENCE`
table	New Table		`ITEM_OCCURRENCE`
`OCCURRENCE`
table	Discontinued Table	`OCCURRENCE`		Data is available in the `ITEM_OCCURRENCE` and `PROJECT_OCCURRENCE` tables.
`PROJECT_AI`
table	New Table		`PROJECT_AI`
`PROJECT_GLOBAL`
table	New Table		`PROJECT_GLOBAL`
`PROJECT_GLOBAL_AI`
table	Discontinued Table	`PROJECT_GLOBAL_AI`		Data is available in the `PROJECT_AI` and `PROJECT_GLOBAL` tables.
`PROJECT_OCCURRENCE`
table	New Table		`PROJECT_OCCURRENCE`

Shopify

We have migrated from REST API to GraphQL for the ORDER_RISK endpoint to align with Shopify’s updated standards. For more information, see Shopify's documentation. As part of this migration, we have made the following schema changes:

We have added the follow tables:

ORDER_RISK_FACT
ORDER_RISK_ASSESSMENT
ORDER_RISK_SUMMARY

You need to perform a re-sync to backfill historical data for the new tables. We are gradually rolling out this change to all existing connectors.

We have migrated from REST API to GraphQL for the PRODUCT endpoint to align with Shopify’s updated standards. For more information, see Shopify's documentation. As part of this migration, we have made the following schema changes:

We have added the following new columns to the PRODUCT table:
- compare_at_price_range_*
- description
- description_html
- featured_media_id
- gift_card_template_suffix
- has_only_default_variant
- has_out_of_stock_variants
- has_variants_that_requires_components
- is_gift_card
- legacy_resource_id
- online_store_preview_url
- max_variant_price_amount
- max_variant_price_currency_code
- min_variant_price_amount
- min_variant_price_currency_code
- requires_selling_plan
- seo_description
- seo_title
- total_inventory
- tracks_inventory
We have removed the following columns from the PRODUCT table:
- body_html
- published_scope
We have added the linked_metafield_key and linked_metafield_namespace columns to the PRODUCT_OPTION table.
We have added the following new columns to the PRODUCT_VARIANT table:
- available_for_sale
- display_name
- legacy_resource_id
- requires_components
- sellable_online_quantity
We have removed the following columns from the PRODUCT_VARIANT table:
- fulfillment_service
- grams
- inventory_management
- inventory_quantity_management
- inventory_quantity_adjustment
- old_inventory_quantity
- option_*
- presentment_prices
- requires_shipping
- weight
- weight_unit
We have added the following new columns to the PRODUCT_IMAGE table:
- alt_text
- media_id
- status
- url
We have removed the following columns from the PRODUCT_IMAGE table:
- alt
- created_at
- is_default
- position
- src
- updated_at
- variant_ids
We have added the following new columns to the INVENTORY_ITEM table:
- duplicate_sku_count
- harmonized_system_code
- inventory_history_url
- legacy_resource_id
- measurement_id
- measurement_weight_value
- measurement_weight_unit
- tracked_editable_locked
- tracked_editable_reason
- unit_cost_amount
- unit_cost_currency_code
We have removed the cost column from the INVENTORY_ITEM table.
We have added the following new columns to the INVENTORY_LEVEL table:
- can_deactivate
- created_at
- deactivation_alert
- id
We have removed the available column from the INVENTORY_LEVEL table.
We have three new tables, PRODUCT_OPTION_VALUE, PRODUCT_VARIANT_OPTION_VALUE and INVENTORY_QUANTITY.

You need to perform a re-sync to backfill historical data for the new columns. We are gradually rolling out this change to all existing connectors.

Zip

Effective January 10, 2025 we use a new January 2025 schema. Review the latest ERD to better understand the schema changes. Also, see our Schema Migrations article for more details.

We are updating the connector schema to improve schema usability.

1 total changes • 0 possible breaking changes

Table/column	Change type		Old name	New name	Notes
`REQUEST`
column	New Column			`amount_usd`

Improvements

Airtable

Effective January 5, 2025, our REST API no longer supports the base_id and table_name configuration parameters for Airtable connectors. We will sunset these parameters on April 5, 2025.

Azure Service Bus

We have updated the connection methods for configuring the Azure Service Bus connector via the REST API. We now use DIRECT, SSH_TUNNEL, and PRIVATE_LINK for configuration. Previously, we used direct, sshTunnel, and privateLink.

For more information, see our REST API configuration.

Bitly

We have added table re-sync support. Previously, we only supported connector-level re-syncs.

NOTE: Event-based tables and tables with a retention period at the source don't support this feature.

Canvas by Instructure

We now re-import the COURSE table and its child tables once a week to capture updates and deletes.

File connectors

We have renamed the Folder Path field to Base folder path in the following connector setup forms:

New connectors created on or after January 2, 2025, will have this change. We are gradually rolling it out to all existing connectors.

Google Drive

We have renamed the Folder URL field to Base folder URL in the connector setup form. New connectors created on or after January 2, 2025, will have this change.

We are gradually rolling out these changes to all existing connectors.

Loop

If the exchange_variant column in the RETURN_CANCELLED_LINE_ITEM table is empty, we now update it to Not Exchange so that it is visible in your destination.

MySQL

We now support MySQL version 8.4.

Rootly

We have added table re-sync support. Previously, we only supported connector-level re-syncs.

NOTE: Event-based tables and tables with a retention period at the source don't support this feature.

SAP ERP on HANA

We added support for applying filters to tables in the SAP ERP on HANA connector. This feature allows you to replicate a smaller, more restricted set of your data.

For more information, see our SAP ERP on HANA documentation and SAP ERP on HANA setup guide.

January 2025

Connector SDK

Fivetran Connector SDK

Edit connection details

100 fields maximum in configuration.json

fivetran-connector-sdk PyPI package

Lite Connectors

Transformations for dbt Core

Updated dbt Quickstart packages

New connectors

CockroachDB

Schema changes

Chargebee Product Catalog 1.0

Factbird

LearnUpon

Medallia Agile Research

Partnerize

Rollbar

Shopify

Zip

Improvements

Airtable

Azure Service Bus

Bitly

Canvas by Instructure

File connectors

Google Drive

Loop

MySQL

Rootly

SAP ERP on HANA

`fivetran-connector-sdk` PyPI package