Slow or Delayed Sync

Issue

The connector is experiencing a slow or delayed sync.

Environment

Connector: Shopify

Resolution

To optimize the sync speed during historical syncs, exclude the following tables from your connector's schema:

• DISCOUNT_CODE
• FULFILLMENT_EVENT
• ORDER_RISK
• *_METAFIELD
• TRANSACTION

To optimize the sync speed during incremental syncs, exclude the following tables from your connector's schema:

• DISCOUNT_CODE
• FULFILLMENT_EVENT
• ORDER_RISK
• *_METADATA

In particular, we recommend excluding the FULFILLMENT_EVENT table. To check if the FULFILLMENT_EVENT table is impacting your sync, do the following:

1. Review your logs using our Fivetran Platform connector or external logging services.
2. Select the latest log to see all relevant information.
3. Look for a URI parameter that includes the word fulfillment. For example, https://<shopify_url>.myshopify.com/admin/api/2021-07/orders/<order_id>/fulfillments/<fulfillments_id>/events.json?limit=250.

Cause

We make nested calls to the endpoints we use to get data for the above tables. As a result, you may experience slow or delayed syncs if you include them in your connector's schema.

The FULFILLMENT_EVENT table is particularly likely to increase your sync time. We display the following warning when you attempt to include it in your connector's schema:

Not recommended: Syncing FULFILLMENT_EVENT table might slow down your sync.