How to Calculate Sync Speed

Use Case

You want to know the estimated time it takes to sync data from your source to your destination. This requires the use of our free Fivetran Platform Connector and the sample query we provide.

Fivetran Recommendation

We recommend using the results of the following calculation method as an estimate, because sync speed depends on a variety of factors:

• Volume of data in the data source
• Connector type (for example, application, database, function)
• Subscription tier (for application connectors)

Use our Check Daily Modified Records sample query to determine the amount of records modified in a certain amount of time.

NOTE: You can change the time period used for the calculation from days to hours to minutes, depending on the volume of data.

Do the following to roughly estimate the sync speed:

1. Make sure that the Fivetran Platform Connector is configured.

2. Run the initial or historical sync for the connector whose sync speed you want to know.

   i. (Optional) Start with a few select tables. If your data source contains a large volume of data, we recommend starting with a small sample base.

3. Use the Fivetran Platform Connector and the sample query to measure the average number of rows updated ('records_modified') per 24 hours.

4. Estimate the total source volume.

5. Project how long your Fivetran syncs will take.

Considerations

Database connectors have throughput limits that can be found in our documentation for the respective database type.

If you are concerned about MAR, create a designated test connector and use it to run these speed calculation tests before creating a production connector that will sync all of your data.