January 2025
Connector SDK
Fivetran Connector SDK
Edit connection details
You can now update your connection configuration in the dashboard. To do so, log into your dashboard, go to the Setup tab of your SDK connection, and click Edit connection details. This enables you to deploy an SDK connection without specifying any configuration details, and then later adding the configuration through the setup form.
100 fields maximum in configuration.json
No more than 100 fields are allowed in the configuration.json
when deploying your SDK connection.
fivetran-connector-sdk
PyPI package
We have released version 0.13.10.1
of the fivetran-connector-sdk
PyPI package. This release adds the following:
- A user confirmation prompt to automatically update faulty
requirements.txt
files. - Added support for installing packages directly from Git sources via
requirements.txt
. - Enhanced logging and exception handling for improved debugging and reliability.
Lite Connectors
Lite connectors are now available for the following sources:
- Ashby
- Cloudbeds
- Cornerstone
- Donus
- Hilti On!Track
- Jama Software
- Khoros Marketing
- Leap CRM
- ShareASale
- Venminder
- Workleap Officevibe
- Zoho Inventory
Transformations for dbt Core
Updated dbt Quickstart packages
We have updated the Quickstart packages for the following connectors:
- Marketo to version 0.13.1
- Qualtrics to version 0.3.0
- Quickbooks to version 0.17.1
- Servicenow to version 0.4.0
- Shopify to version 0.15.0
- Zendesk Support to version 0.19.3
- Zuora to version 0.3.1
New connectors
CockroachDB
CockroachDB is a horizontally-scaling, distributed SQL database. Read our CockroachDB documentation.
Schema changes
Chargebee Product Catalog 1.0
Table/column | Change type | Old name | New name | Notes | |
---|---|---|---|---|---|
ADDON | |||||
column | New Column | proration_type | |||
ADDON_TAX_PROVIDER_FIELD | |||||
table | New Table | ADDON_TAX_PROVIDER_FIELD | |||
ADDON_TIER | |||||
table | New Table | ADDON_TIER | |||
CREDIT_NOTE_DISCOUNT | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | credit_note_id | credit_note_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
CREDIT_NOTE_LINE_ITEM | |||||
table | New Table | ||||
CREDIT_NOTE_LINE_ITEM_DISCOUNT | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | credit_note_id | credit_note_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
CREDIT_NOTE_LINE_ITEM_TAX | |||||
table | New Table | ||||
CREDIT_NOTE_LINE_ITEM_TIER | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | credit_note_id | credit_note_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
CREDIT_NOTE_TAX | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | credit_note_id | credit_note_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
CUSTOMER_BALANCE | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | customer_id | customer_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
CUSTOMER_TAX_PROVIDER_FIELD | |||||
table | New Table | CUSTOMER_TAX_PROVIDER_FIELD | |||
EVENT | |||||
table | New Table | EVENT | |||
EVENT_METADATA | |||||
table | New Table | EVENT_METADATA | |||
EVENT_WEBHOOK | |||||
table | New Table | EVENT_WEBHOOK | |||
GIFT_TIMELINE | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | gift_id | gift_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
HOSTED_PAGE | |||||
column | New Column | business_entity_id | |||
INVOICE | |||||
column | New Column | einvoice_reference_number | |||
column | New Column | local_currency_exchange_rate | |||
column | New Column | site_details_at_creation_organization_address_city | |||
column | New Column | site_details_at_creation_organization_address_country_code | |||
column | New Column | site_details_at_creation_organization_address_line_1 | |||
column | New Column | site_details_at_creation_organization_address_state | |||
column | New Column | site_details_at_creation_organization_address_zip | |||
column | New Column | site_details_at_creation_organization_email | |||
column | New Column | site_details_at_creation_organization_name | |||
column | New Column | site_details_at_creation_organization_phone | |||
column | New Column | site_details_at_creation_organization_website | |||
column | New Column | site_details_at_creation_timezone | |||
column | New Column | statement_descriptor | |||
column | New Column | statement_descriptor_id | |||
column | New Column | tax_category | |||
column | New Column | tax_origin_country | |||
column | New Column | tax_origin_registration_number | |||
INVOICE_DISCOUNT | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | invoice_id | invoice_id 🔑 | Added to primary key. | |
column | Primary Key Change | invoice_updated_at | invoice_updated_at 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
INVOICE_DUNNING_ATTEMPT | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | invoice_id | invoice_id 🔑 | Added to primary key. | |
column | Primary Key Change | invoice_updated_at | invoice_updated_at 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
INVOICE_LINE_ITEM | |||||
table | New Table | ||||
INVOICE_LINE_ITEM_DISCOUNT | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | invoice_id | invoice_id 🔑 | Added to primary key. | |
column | Primary Key Change | invoice_updated_at | invoice_updated_at 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
INVOICE_LINE_ITEM_TAX | |||||
table | New Table | ||||
INVOICE_NOTE | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | invoice_id | invoice_id 🔑 | Added to primary key. | |
column | Primary Key Change | invoice_updated_at | invoice_updated_at 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
INVOICE_TAX | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | invoice_id | invoice_id 🔑 | Added to primary key. | |
column | Primary Key Change | invoice_updated_at | invoice_updated_at 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
LINE_ITEM | |||||
table | Discontinued Table | LINE_ITEM | Data is available in the INVOICE_LINE_ITEM , QUOTE_LINE_ITEM , and CREDIT_NOTE_LINE_ITEM tables. | ||
LINE_ITEM_TAX | |||||
table | Discontinued Table | LINE_ITEM_TAX | Data is available in the INVOICE_LINE_ITEM_TAX , CREDIT_NOTE_LINE_ITEM_TAX , QUOTE_LINE_ITEM_TAX , and ORDER_LINE_ITEM_TAX tables. | ||
ORDER_LINE_ITEM_DISCOUNT | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | order_id | order_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
ORDER_LINE_ITEM_TAX | |||||
table | New Table | _FIVETRAN_ID 🔑 | No longer a primary key. | ||
PAYMENT_SOURCE | |||||
column | New Column | bank_account_direct_debit_scheme | |||
column | New Column | boleto_email | |||
column | New Column | boleto_first_name | |||
column | New Column | boleto_last_4 | |||
column | New Column | boleto_last_name | |||
column | New Column | klarna_pay_now_email | |||
column | New Column | venmo_user_name | |||
PLAN_TAX_PROVIDER_FIELD | |||||
table | New Table | PLAN_TAX_PROVIDER_FIELD | |||
PLAN_TIER | |||||
table | New Table | PLAN_TIER | |||
QUOTE_DISCOUNT | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | quote_id | quote_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
QUOTE_LINE_ITEM | |||||
table | New Table | ||||
QUOTE_LINE_ITEM_DISCOUNT | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | quote_id | quote_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
QUOTE_LINE_ITEM_TAX | |||||
table | New Table | ||||
QUOTE_LINE_ITEM_TIER | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | quote_id | quote_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
QUOTE_TAX | |||||
column | Discontinued Column | _fivetran_id 🔑 | No longer a primary key. | ||
column | Primary Key Change | quote_id | quote_id 🔑 | Added to primary key. | |
column | Primary Key Change | index 🔑 | New primary key. | ||
SUBSCRIPTION | |||||
column | New Column | contract_term_total_contract_value_before_tax | |||
TIER | |||||
table | Discontinued Table | TIER | Data is available in the UNBILLED_CHARGE_TIER , ADDON_TIER , and PLAN_TIER tables. | ||
TRANSACTION | |||||
column | New Column | custom_payment_method_id | |||
column | New Column | custom_payment_method_name | |||
column | New Column | error_cause_customer_message | |||
column | New Column | error_cause_id | |||
column | New Column | error_cause_merchant_message | |||
column | New Column | error_detail_decline_code | |||
column | New Column | error_detail_decline_message | |||
column | New Column | error_detail_error_category | |||
column | New Column | error_detail_error_code | |||
column | New Column | error_detail_error_field | |||
column | New Column | error_detail_error_message | |||
column | New Column | error_detail_network_error_code | |||
column | New Column | error_detail_network_error_message | |||
column | New Column | error_detail_processor_error_code | |||
column | New Column | error_detail_processor_error_message | |||
column | New Column | error_detail_recommendation_code | |||
column | New Column | error_detail_recommendation_message | |||
column | New Column | error_detail_request_id | |||
UNBILLED_CHARGE_TIER | |||||
table | New Table | UNBILLED_CHARGE_TIER |
Factbird
Table/column | Change type | Old name | New name | Notes | |
---|---|---|---|---|---|
OEE | |||||
column | Primary Key Change | _fivetran_id 🔑 | _fivetran_id 🔑 | Primary key calculation change. | |
column | New Column | consolidated_time_from | |||
column | New Column | consolidated_time_to | |||
SENSOR_GROUP | |||||
column | Discontinued Column | external_id |
LearnUpon
Table/column | Change type | Old name | New name | Notes | |
---|---|---|---|---|---|
COURSE | |||||
column | New Column | thumbnail_image_url | |||
COURSE_INSTRUCTOR | |||||
column | New Column | created_at | |||
ENROLLMENT | |||||
column | New Column | from_catalog | |||
column | New Column | from_store | |||
column | New Column | group_id | |||
column | New Column | is_overdue | |||
column | New Column | updated_at | |||
GROUP_INVITIE | |||||
column | New Column | accept_url | |||
GROUP_MEMBERSHIP | |||||
column | Discontinued Column | group_id | |||
column | Rename Column | groups_id 🔑 | group_id 🔑 | ||
LEARNING_PATH | |||||
column | New Column | thumbnail_image_url | |||
MODULE | |||||
column | New Column | sequence | |||
USER_CUSTOM_DATA | |||||
column | Rename Column | users_id 🔑 | user_id 🔑 | ||
USER_CUSTOM_DATA_FIELD_VALUE | |||||
column | Discontinued Column | id | |||
column | Rename Column | users_id 🔑 | user_id 🔑 | ||
USERS | |||||
column | New Column | timezone_id | |||
column | New Column | updated_at |
Medallia Agile Research
Table/column | Change type | Old name | New name | Notes | |
---|---|---|---|---|---|
SURVEY_RESPONDENT_RESPONSE | |||||
column | New Column | data_label | |||
column | New Column | response_caption | |||
column | New Column | scale_value | |||
column | New Column | score | |||
column | New Column | value |
Partnerize
Table/column | Change type | Old name | New name | Notes | |
---|---|---|---|---|---|
CAMPAIGN_TRANSACTION | |||||
column | Rename Column | created_by | publisher_created_by | ||
column | Rename Column | reporting_timezone | publisher_reporting_timezone |
Rollbar
Table/column | Change type | Old name | New name | Notes | |
---|---|---|---|---|---|
ITEM_OCCURRENCE | |||||
table | New Table | ITEM_OCCURRENCE | |||
OCCURRENCE | |||||
table | Discontinued Table | OCCURRENCE | Data is available in the ITEM_OCCURRENCE and PROJECT_OCCURRENCE tables. | ||
PROJECT_AI | |||||
table | New Table | PROJECT_AI | |||
PROJECT_GLOBAL | |||||
table | New Table | PROJECT_GLOBAL | |||
PROJECT_GLOBAL_AI | |||||
table | Discontinued Table | PROJECT_GLOBAL_AI | Data is available in the PROJECT_AI and PROJECT_GLOBAL tables. | ||
PROJECT_OCCURRENCE | |||||
table | New Table | PROJECT_OCCURRENCE |
Shopify
We have migrated from REST API to GraphQL for the ORDER_RISK
endpoint to align with Shopify’s updated standards. For more information, see Shopify's documentation. As part of this migration, we have made the following schema changes:
We have added the follow tables:
ORDER_RISK_FACT
ORDER_RISK_ASSESSMENT
ORDER_RISK_SUMMARY
You need to perform a re-sync to backfill historical data for the new tables. We are gradually rolling out this change to all existing connectors.
We have migrated from REST API to GraphQL for the PRODUCT
endpoint to align with Shopify’s updated standards. For more information, see Shopify's documentation. As part of this migration, we have made the following schema changes:
We have added the following new columns to the
PRODUCT
table:compare_at_price_range_*
description
description_html
featured_media_id
gift_card_template_suffix
has_only_default_variant
has_out_of_stock_variants
has_variants_that_requires_components
is_gift_card
legacy_resource_id
online_store_preview_url
max_variant_price_amount
max_variant_price_currency_code
min_variant_price_amount
min_variant_price_currency_code
requires_selling_plan
seo_description
seo_title
total_inventory
tracks_inventory
We have removed the following columns from the
PRODUCT
table:body_html
published_scope
We have added the
linked_metafield_key
andlinked_metafield_namespace
columns to thePRODUCT_OPTION
table.We have added the following new columns to the
PRODUCT_VARIANT
table:available_for_sale
display_name
legacy_resource_id
requires_components
sellable_online_quantity
We have removed the following columns from the
PRODUCT_VARIANT
table:fulfillment_service
grams
inventory_management
inventory_quantity_management
inventory_quantity_adjustment
old_inventory_quantity
option_*
presentment_prices
requires_shipping
weight
weight_unit
We have added the following new columns to the
PRODUCT_IMAGE
table:alt_text
media_id
status
url
We have removed the following columns from the
PRODUCT_IMAGE
table:alt
created_at
is_default
position
src
updated_at
variant_ids
We have added the following new columns to the
INVENTORY_ITEM
table:duplicate_sku_count
harmonized_system_code
inventory_history_url
legacy_resource_id
measurement_id
measurement_weight_value
measurement_weight_unit
tracked_editable_locked
tracked_editable_reason
unit_cost_amount
unit_cost_currency_code
We have removed the
cost
column from theINVENTORY_ITEM
table.We have added the following new columns to the
INVENTORY_LEVEL
table:can_deactivate
created_at
deactivation_alert
id
We have removed the
available
column from theINVENTORY_LEVEL
table.We have three new tables,
PRODUCT_OPTION_VALUE
,PRODUCT_VARIANT_OPTION_VALUE
andINVENTORY_QUANTITY
.
You need to perform a re-sync to backfill historical data for the new columns. We are gradually rolling out this change to all existing connectors.
Zip
Table/column | Change type | Old name | New name | Notes | |
---|---|---|---|---|---|
REQUEST | |||||
column | New Column | amount_usd |
Improvements
Airtable
Effective January 5, 2025, our REST API no longer supports the base_id
and table_name
configuration parameters for Airtable connectors. We will sunset these parameters on April 5, 2025.
Azure Service Bus
We have updated the connection methods for configuring the Azure Service Bus connector via the REST API. We now use DIRECT
, SSH_TUNNEL
, and PRIVATE_LINK
for configuration. Previously, we used direct
, sshTunnel
, and privateLink
.
For more information, see our REST API configuration.
Bitly
We have added table re-sync support. Previously, we only supported connector-level re-syncs.
NOTE: Event-based tables and tables with a retention period at the source don't support this feature.
Canvas by Instructure
We now re-import the COURSE
table and its child tables once a week to capture updates and deletes.
File connectors
We have renamed the Folder Path field to Base folder path in the following connector setup forms:
New connectors created on or after January 2, 2025, will have this change. We are gradually rolling it out to all existing connectors.
Google Drive
We have renamed the Folder URL field to Base folder URL in the connector setup form. New connectors created on or after January 2, 2025, will have this change.
We are gradually rolling out these changes to all existing connectors.
Loop
If the exchange_variant
column in the RETURN_CANCELLED_LINE_ITEM
table is empty, we now update it to Not Exchange
so that it is visible in your destination.
MySQL
We now support MySQL version 8.4.
Rootly
We have added table re-sync support. Previously, we only supported connector-level re-syncs.
NOTE: Event-based tables and tables with a retention period at the source don't support this feature.
SAP ERP on HANA
We added support for applying filters to tables in the SAP ERP on HANA connector. This feature allows you to replicate a smaller, more restricted set of your data.
For more information, see our SAP ERP on HANA documentation and SAP ERP on HANA setup guide.