Release Notes

December 2024

We have updated the Quickstart packages for the following connectors:

Fivetran Log to version 1.10.0
Greenhouse to version 0.8.0
LinkedIn Ad Analytics to version 0.10.0
Mailchimp to version 0.10.0
Marketo to version 0.12.1
Quickbooks to version 0.17.0
Shopify to version 0.14.0
Stripe to version 0.15.1
Tiktok Ads to version 0.7.0
Twilio to version 0.4.0
Zendesk Support to version 0.19.1

We have also updated the Quickstart package for the Ad Reporting multi-connector data model to version 1.10.0.

We have added the following new tables:

APP
CATALOG
DISPUTE
PRODUCT_PUBLICATION
PUBLICATION
RETURN
RETURN_LINE_ITEM

We are gradually rolling out this change to all existing connectors.

Perform resync of ORDER table to fetch historical data for RETURN and RETURN_LINE_ITEM

We will re-import the remaining tables and their child tables daily to capture updates and deletes.

November 2024

We have fixed a data integrity issue in the currency column of the CUSTOMER table. If you observe null values for the column in your destination, trigger a re-sync of the CUSTOMER table.

September 2024

We have upgraded our connector to Shopify API v2024-04. As a part of the upgrade, we have added a new column, is_removed, to the ORDER_SHIPPING_LINE table. We are gradually rolling out this improvement to all existing connectors.

We have added two new tables, COMPANY and COMPANY_CONTACT.

We are gradually rolling out this change to all existing connectors.

August 2024

We have added the following new tables:

ADJUSTMENT_ORDER_TRANSACTION
BALANCE_TRANSACTION

July 2024

We have added two new columns, company_id and company_location_id, to the ORDER table. Be sure to re-sync the ORDER table to backfill the data for these columns or contact our support team to re-sync it for you.

June 2024

We have fixed an issue in our Shopify connector where we were unable to capture deletes in the METAFIELD table. This issue occurs only when you delete all the metafields in the source. We recommend that you re-sync your connector if you observe any data integrity issues. We are gradually rolling out this change to all existing connectors.

March 2024

We have upgraded our Shopify connector from version 2023-04 to 2024-01 of the Shopify API. As part of the upgrade, we have deprecated the delivery_category column of the ORDER_SHIPPING_LINE table. We are gradually rolling out this change to all existing connectors. For more information about the change, see Shopify API's changelog.

November 2023

We have added a new table, PAYOUT. By default, we do not sync this table. However, if you want to sync the new table, select it in the Schema tab of your connector details page. We are gradually rolling out this change to all existing connectors.

We now capture deletes for the METAFIELD table.

August 2023

We have added four new tables:

CUSTOMER_VISIT
FULFILLMENT_ORDER
FULFILLMENT_ORDER_FULFILLMENT_HOLD
FULFILLMENT_ORDER_LINE_ITEM

We can now sync data from the CUSTOMER VISIT and FULFILLMENT_ORDER endpoints. By default, we exclude these new tables from the sync as syncing them might reduce the sync performance. To sync the historical data of the FULFILLMENT_ORDER table, re-sync the ORDER table.

June 2023

We have upgraded our Shopify connector from version 2022-07 to 2023-04 of the Shopify API. As part of the upgrade, we have deprecated the following columns:

fulfillment_service column of the ABANDONED_CHECKOUT_LINE table
fulfillment_service column of the FULFILLMENT_ORDER_LINE table
fulfillment_service column of the ORDER_LINE table
can_delete and lifetime_duration columns of the CUSTOMER table
total_price_usd and processing_method columns of the ORDER table
total_price_usd column of the DRAFT_ORDER table
destination_location_*, fulfillment_service, and origin_location_* columns of the ORDER_LINE table

We are gradually rolling out these changes to all existing connectors.

April 2023

Shopify connectors created after April 17, 2023 use the Fivetran app by default. For more information, see our setup instructions. However, you can continue to create a connector using a non-Fivetran app (custom, private or another public app) by using the Fivetran REST API.

December 2022

We have upgraded our Shopify connector from version 2022-01 to 2022-7 of the Shopify API and made the following schema changes:

We have added two new tables, CUSTOMER_SEGMENT and PRICE_RULE_PREREQ_CUSTOMER_SEGMENT.
We have added the following new fields to the CUSTOMER table:
- email_marketing_consent_state
- email_marketing_consent_consent_updated_at
- email_marketing_consent_marketing_opt_in_level
We have deprecated the CUSTOMER_SAVED_SEARCH and PRICE_RULE_PREREQ_SAVED_SEARCH tables.
We have deprecated the following fields from the CUSTOMER table:
- accepts_marketing
- accepts_marketing_updated_at
- marketing_opt_in_level

We are gradually rolling out these changes to all existing connectors.

November 2022

We have added a new column, checkout_id, to the ORDERS table.

September 2022

We have changed the new connector creation process for Shopify connectors. Shopify connectors created on or after October 7, 2022, require a Shopify custom app. For more information, see our setup instructions.

We will continue to support the existing Shopify connectors without a custom app.

June 2022

We have upgraded our Shopify connector from version 2021-07 to 2022-01 of the Shopify API. For more information, see Shopify's 2022-01 release notes. We have removed the value_type column from the METAFIELD table. Use the type column in place of the value_type column in your queries.

January 2022

We have released a pre-built, dbt Core-compatible data model to combine Shopify ecommerce data with data from marketing connectors. The Shopify Holistic model supports combining Shopify data with email and SMS marketing data from Fivetran's Klaviyo data model. Find the model in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

November 2021

We have added a new column, body_html, to the PRODUCT and COLLECTION tables.

September 2021

We have added a new column, type, to the METAFIELD table.

We have added a new column, template_suffix, to the COLLECTION and PRODUCT tables.

We have added two new columns, created_at and updated_at, to the ABANDONED_CHECKOUT_DISCOUNT_CODE table.

We have added two new columns, currency and metafield, to the CUSTOMER table.

We have added two new columns, tax_exemptions and tax_lines, to the DRAFT_ORDER table.

We have added two new columns, presentment_prices and inventory_quantity_adjustment, to the PRODUCT_VARIANT table.

We have added two new columns, extended_authorization_standard_authorization_expires_at and extended_authorization_extended_authorization_expires_at, to the TRANSACTION table.

We have added the following new columns to the FULFILLMENT table:

service
name
receipt_authorization

The Shopify connector's priority-first syncs now fetch the most recent 15 days' worth of data. Previously, the priority fetch period was 30 days.

We have upgraded our Shopify connector from version 2020-10 to 2021-07 of the Shopify API.

August 2021

We now use webhooks to capture deletes for the following tables:

CHECKOUT
COLLECTION
CUSTOMER
CUSTOMER_SAVED_SEARCH
DRAFT_ORDER
FULFILLMENT_EVENT
INVENTORY_ITEM
LOCATION
ORDER
PRODUCT

July 2021

We have added the following new columns to the ORDER table:

current_total_price
current_total_discounts
current_total_tax
current_total_discounts_set
current_total_duties_set
current_total_price_set
current_subtotal_price_set
current_total_tax_set

We have deprecated the following columns from the ABANDONED_CHECKOUT_DISCOUNT_CODE table:

discount_id
created_at
updated_at
usage_count

Make sure to update your queries with the DISCOUNT_CODE table columns.

May 2021

We have added a new table, SHOP, to support Shopify's Shop resource.

We have added a new table, METAFIELD, to support Shopify's Metafield resource. We support the metafields of the following endpoints:

COLLECTION
CUSTOMER
DRAFT_ORDER
ORDER
PRODUCT
PRODUCT_IMAGE
PRODUCT_VARIANT
SHOP

By default, we sync the metafields of the CUSTOMER and SHOP endpoints.

To sync the metafields of other supported endpoints, go to the Schema tab of your connector details page and select the related *_METAFIELD options. For example, to sync the metafields of the ORDER endpoint, select ORDER_METAFIELD.

IMPORTANT: You may observe slow sync speeds if you sync the metafields of the non-default endpoints.

We have added a new table, ORDER_RISK. By default, we exclude the table from your syncs. On your Connector Details page, go to the Schema tab and select the table. For more information, see Shopify's Order Risk documentation.

The Shopify connector now supports table-level re-syncs.

The Shopify connector now supports table blocking for all Shopify tables. You can now choose which tables to sync and which to block from syncing to your destination. On your Connector Details page, go to the Schema tab and select or deselect the tables. If you want to sync a child table, you must include the parent table in the sync.

We now support table grouping in the Schema tab of your connector details page.

March 2021

The Shopify connector now supports priority-first sync. Priority-first syncs fetch your most recent data first so that it's quickly ready for you to use. Shopify's priority-first syncs fetch the past 30 days' worth of data from the following tables:

ABANDONED_CHECKOUT
COLLECTION
CUSTOMER
DRAFT_ORDER
ORDER
PRICE_RULE
PRODUCT
TENDER_TRANSACTION

To learn more, see our priority-first sync documentation.

We have added the _fivetran_deleted column to the USER table.

We have added a new column, is_account_owner, to replace the account_owner column in the USER table. We will discontinue the account_owner column from the USER table after June 30, 2021. Be sure to update your queries.

We have added a new column, client_details_user_agent, to the ORDER table. See Shopify's Order documentation for more information.

February 2021

We have added the following new columns to the FULFILLMENT table:

shipment_status
tracking_numbers
tracking_urls

We have added the following new columns to the FULFILLMENT_ORDER_LINE table:

order_id
product_id
variant_id
fulfillable_quantity
fulfillment_service
gift_card
grams
name
price_set
price
properties
quantity
requires_shipping
sku
taxable
title
variant_title
vendor

January 2021

We have expanded the public API endpoints Create a Connector and Modify a Connector. Now you can authorize the following connectors by adding the auth section to payloads:

We now sync the properties field as JSON objects. We have added a new column, properties replacing the property_* column in the following tables:

ABANDONED_CHECKOUT_LINE
DRAFT_ORDER_LINE
ORDER_LINE

We now sync the note_attributes field as JSON objects. We have added a new column, note_attributes replacing the note_attribute__* column in the following tables:

ABANDONED_CHECKOUT
DRAFT_ORDER
ORDER

We will discontinue the properties_* and note_attribute__* columns from the Shopify schema after March 31, 2021. Be sure to update your queries.

We will discontinue the ORDER_NOTE_ATTRIBUTE and DRAFT_ORDER_NOTE_ATTRIBUTE tables after March 31, 2021. Be sure to update your queries.

We have removed the default_address_id column from the CUSTOMER table. You can use the is_default column in the CUSTOMER_ADDRESS table instead. First, re-sync the CUSTOMER_ADDRESS table to populate the is_default column, then update your queries.

We have removed the is_default column from the ADDRESS table.

We have added two new columns, delivery_expectation_range_min and delivery_expectation_range_max, to the ABANDONED_CHECKOUT_SHIPPING_LINE table.

We have added the following new columns to the CUSTOMER table:

can_delete
lifetime_duration
multipass_identifier

November 2020

We have upgraded our Shopify connector and made the following schema changes:

We now sync the default product image record to the PRODUCT table.
We have added a new table, ORDER_ADJUSTMENTS, which stores the refunded shipping costs and the differences between calculated and actual refund amounts. See Shopify's Refund Order API documentation for more information.
We have added the following new fields to the tables below:
- price_set to the DRAFT_ORDER_LINE table
- type to the ORDER_DISCOUNT_CODE table
- prerequisite_to_entitlement_purchase_* to the PRICE_RULE table
- order_id and total_duties_set to the REFUND table
- is_default and variant_ids to the PRODUCT_IMAGE table
- usage_count and updated_at to the DISCOUNT_CODE table
- variant_title and gift_card to the ABANDONED_CHECKOUT_LINE table
- discounted_price_set and price_set to the ORDER_SHIPPING_LINE table
- presentment_currency and total_duties to the ABANDONED_CHECKOUT table
- acceptsMarketingUpdatedAt and marketingOptInLevel to the CUSTOMER table
- country_code_of_origin and province_code_of_origin to the INVENTORY_ITEM table
We have added three new fields, option1, option2, and option3, to the PRODUCT_VARIANT table.
We have added three new fields, rules, sort_order, and disjunctive, to the CUSTOM_COLLECTION and SMART_COLLECTION tables.
We have added the following new fields to the LOCATION table:
- country_code
- country_name
- localized_country_name
- localized_province_name
- province_code
We have added the following new fields to the ABANDONED_CHECKOUT_DISCOUNT_CODE table:
- created_at
- type
- updated_at
- usage_count
We have added the following new fields to the ABANDONED_CHECKOUT_SHIPPING_LINE table:
- delivery_expectation_range
- delivery_expectation_type
- original_shop_markup
- original_shop_price
- presentment_title
We have added the following new fields to the ORDER_LINE table:
- pre_tax_price_set
- price_set
- product_exists
- tax_code
- total_discount_set
- variant_inventory_management
- variant_title
- destination_location_*
- origin_location_*
We have added the following new fields to the ORDER_LINE_REFUND table:
- subtotal
- subtotal_set
- total_tax
- total_tax_set
We have added the following new fields to the ORDER table:
- confirmed
- current_total_duties_set
- customer_locale
- device_id
- landing_site_ref
- original_total_duties_set
- payment_gateway_names
- presentment_currency
- reference
- source_identifier
- source_url
- subtotal_price_set
- total_discounts_set
- total_line_items_price_set
- total_price_set
- total_price_usd
- total_shipping_price_set
- total_tax_set
- total_tip_received

We have added a new table, TENDER_TRANSACTION. See Shopify's documentation for more information.

You can now exclude the PRICE_RULE and ORDER_ADJUSTMENT tables from the sync. On your connector details page, go to the Schema tab and deselect the tables to reduce your MAR usage.

You can now exclude the following tables from the sync to improve the connector's sync speed:

DISCOUNT_CODE
FULFILLMENT_EVENT
TRANSACTION

On your connector details page, go to the Schema tab and deselect the tables you want to exclude.

September 2020

We have added two new tables, GIFT_CARD and USER to support Shopify Plus APIs.

We have replaced the COLLECT table with the COLLECTION_PRODUCT table. We have deprecated the COLLECT table because the Shopify API no longer supports the Collect endpoint.

We have added the following new fields to the tables below:

app_id to the ORDER table
note to the CUSTOMER table

We have released pre-built, dbt Core-compatible data models for Shopify. Find the models in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

July 2020

We have deprecated the CHECKOUT and GIFT_CARD tables. We have also deprecated the following child tables of the CHECKOUT table:

APPLIED_DISCOUNT
CHECKOUT_DISCOUNT_CODE
CHECKOUT_LINE
CHECKOUT_SHIPPING_LINE
CHECKOUT_TAX_LINE
CHECKOUT_URL_TAG

We have deprecated the featured field from the COLLECT table because the Shopify API no longer supports it. See Shopify's documentation for more information.

May 2020

We have fixed the Product Records are not sorted! API exception by adding a check to avoid cursor overflows.

We now save the state of the CUSTOMER table at regular intervals during the historical sync to ensure data integrity. Saving the state also ensures that the sync progress is not lost in case of a sync failure.

We have added a new column, index, to the ORDER_LINE table. index gives the order of items in a Shopify order.

April 2020

You can now configure your Shopify connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

We have added a new table, DRAFT_ORDER_TAG.

We have added a new table, ABANDONED_CHECKOUT, to replace the CHECKOUT table. We have also added six new child tables to replace the following child tables:

ABANDONED_APPLIED_DISCOUNT replaces APPLIED_DISCOUNT
ABANDONED_CHECKOUT_DISCOUNT_CODE replaces CHECKOUT_DISCOUNT_CODE
ABANDONED_CHECKOUT_LINE replaces CHECKOUT_LINE
ABANDONED_CHECKOUT_SHIPPING_LINE replaces CHECKOUT_SHIPPING_LINE
ABANDONED_CHECKOUT_TAX_LINE replaces CHECKOUT_TAX_LINE
ABANDONED_CHECKOUT_URL_TAG replaces CHECKOUT_URL_TAG

We will discontinue the replaced tables after July 20, 2020. Be sure to update your queries with the new table names before we remove the old tables.

December 2019

We have added the following new tables:

COUNTRY
PROVINCE
CUSTOMER_SAVED_SEARCH

We have added the following new tables associated with the PRICE_RULE table:

PRICE_RULE_ENT_PRODUCT
PRICE_RULE_ENT_VARIANT
PRICE_RULE_ENT_COLLECTION
PRICE_RULE_ENT_COUNTRY
PRICE_RULE_PREREQ_COLLECTION
PRICE_RULE_PREREQ_CUSTOMER
PRICE_RULE_PREREQ_PRODUCT
PRICE_RULE_PREREQ_SAVED_SEARCH
PRICE_RULE_PREREQ_VARIANT

We have added the following columns to the PRICE_RULE table:

allocation_limit
prerequisite_subtotal_range
prerequisite_quantity_range
prerequisite_shipping_price_range
quantity_ratio_prerequisite_quantity
quantity_ratio_ entitled_quantity

We have added a new table, CUSTOMER_TAX_EXEMPTION, which lists the tax exemptions associated with a customer.

November 2019

We have added a new table, APPLIED_GIFT_CARD, which is a replica of the existing GIFT_CARD table. APPLIED_GIFT_CARD is the correct name for this table. We will update both tables with data for the past three months, then remove the GIFT_CARD table. Be sure to update your queries with the new name before we remove the GIFT_CARD table.

We have added a new column, test, to the ORDER table.

October 2019

We have added the following columns to the TRANSACTION table to support currency exchange rate adjustments:

processed_at
currency_exchange_id
currency_exchange_adjustment
currency_exchange_original_amount
currency_exchange_final_amount
currency_exchange_currency

We have added a new table, PRODUCT_IMAGE, which contains the following fields:

id : A unique numeric identifier for the product image. (primary key)
product_id : The ID of the product associated with the image. (foreign key, references the PRODUCT table)
position : The order of the product image in the list. The first product image is at position 1 and is the "main" image for the product.
width : Width dimension of the image which is determined on upload.
height : Height dimension of the image which is determined on upload.
created_at: The date and time when the product image was created.
updated_at: The date and time when the product image was last modified.
src : Specifies the location of the product image.
alt : Alternative source if the main image does not exist.
variant_ids : IDs of the variations of the product associated with the image.

You can read more about product images in Shopify's API documentation.

September 2019

We have added the FULFILLMENT_ORDER_LINE table to support the relationship between FULFILLMENT and ORDER_LINE tables. You will now be able to get fulfillment information for each order line, which is necessary in cases where there is more than one fulfilment per order.

August 2019

Fivetran now deletes all the records in child tables when their parent table gets an update that indicates the parent table no longer has child records.

July 2019

We have added a new table, FULFILLMENT_EVENT which represents tracking events that belong to a fulfillment of one or more items in an order. It contains the following columns:

id
order_id
fulfillment_id
address1
city
country
created_at
estimated_delivery_at
happened_at
latitude
longitude
message
province
shop_id
status
updated_at
zip

We have a new column, quantity, to the ORDER_LINE_REFUND table.

April 2019

To integrate Shopify's multi location inventory support, we have added two new tables and added fields to four existing tables.

New tables added:

INVENTORY_LEVEL
INVENTORY_ITEM

New fields added:

Table	Fields Added
`PRODUCT_VARIANT`	`inventory_item_id`
`FULFILMENT`	`location_id`
`LOCATION`	`legacy`, `active`
`ORDER_LINE_ITEMS`	`restock_type`, `location_id`

March 2019

In order to ensure the accuracy of Order data, we now use Shopify webhooks to capture order updates.

February 2019

We have added the following new tables:

DRAFT_ORDER
DRAFT_ORDER_NOTE_ATTRIBUTE
DRAFT_ORDER_LINE
DRAFT_ORDER_LINE_TAX_LINE

January 2019

We have removed all note_attributes_* columns from the ORDER table. The new ORDER_NOTE_ATTRIBUTE table contains all note_attributes data.

The landing_site column no longer exists. The landing_site base URLs are now in the landing_site_base_url columns in the ORDER and CHECKOUT tables. Each base URL's query parameters can be found in the ORDER_URL_TAG and CHECKOUT_URL_TAG tables.

We have added four new tables:

CHECKOUT_URL_TAG
DISCOUNT_APPLICATION
ORDER_URL_TAG
DISCOUNT_ALLOCATION

We have added two new columns, total_discount and pre_tax_price, to the ORDER_LINE table.

December 2018

We have removed the ABANDONED_CHECKOUT table. All checkout data can now be found in the CHECKOUT table. Abandoned checkouts have null values in the completed_at field.

September 2018

Users now receive warnings about GDPR data deletion requests.

We have added a new column, note, to the ORDER table.

We have added two new columns, script_version_id and price_rule_id, to the APPLIED_DISCOUNT table.

August 2018

We have added two new fields, cart_token and checkout_token, to the ORDER table.

April 2018

We have added the following new tables:

APPLIED_DISCOUNT
CHECKOUT
CHECKOUT_DISCOUNT_CODE
CHECKOUT_LINE
CHECKOUT_SHIPPING_LINE
CHECKOUT_TAX_LINE
APPLIED_GIFT_CARD