Release Notes

September 2024

We now restrict API users from triggering File connectors to sync if:

the append_file_option field has its value set to upsert_file_with_primary_keys
and the primary keys are not defined in the schema configuration

We also restrict the following actions for such connectors:

Creating a new connector in an un-paused state via API;
Updating the connector's paused field to false via API request;
Forcing the connector sync or re-sync via API request.

July 2024

We have added a new configuration option, Primary Key used for file process and load, in the connector setup form to support syncing files with custom primary keys. You can now select the custom primary keys during the connector configuration and use them to update or insert new rows in your destination. We process the most recently modified files to your destination. For more information, see our setup instructions.

May 2024

Our Dropbox connector now supports syncing Microsoft Excel spreadsheets in Merge Mode. For more information, see our setup instructions.

August 2023

We have updated our sync strategy regarding the Excel files containing formula cells. We now sync the date values of the formula cell results as TIMESTAMP. Previously, we synced them as DOUBLE in our destination.

July 2023

We have changed the default value of the JSON Delivery Mode feature to Packed in the connector setup form. Previously, we used Unpacked as the default value for this feature.

We now support syncing XML files to your destination in Merge Mode. We have added a new option, xml, to the File Type drop-down menu of the connector setup form. We load your XML data into the _data column without flattening it. For more information, see our setup instructions.

We now support custom line separators for CSV files in Merge Mode. You can specify a custom line separator in the Line Separator field of the connector setup form. For more information, see our setup instructions.

We now support multi-character delimiters for CSV files in Merge Mode. You can specify a multi-character delimiter in the Delimiter field of the connector setup form. For more information, see our setup instructions.

June 2023

Our Dropbox connector can now sync packed JSON files in Merge Mode. We have added a new drop-down menu, JSON Delivery Mode, to the connector setup form. The drop-down menu provides you the option to choose how Fivetran should handle your JSON data. For more information, see our setup instructions.

We have removed the Root Folder in Team Spaces toggle from the Merge Mode sync strategy, in the connector setup form. We now infer the values of this field automatically.

June 2022

We have added the Merge Mode functionality to our Dropbox connector. For connectors created after June 2, 2022, you can now opt to sync multiple files into a single table in your destination. In the connector setup form, select your sync strategy as Merge Mode or Magic Folder. For more information, see our setup instructions.

We have redesigned the Skip Header Lines and Skip Footer Lines setup form fields for our Amazon S3, Azure Blob Storage, Dropbox, FTP, Google Cloud Storage, and SFTP file connectors. To set these advanced options, enable them using the toggles and specify the number of skipped lines in the input fields.

Compare how the setup form looked before the change:

setup_wizard_before

and how it looks now:

setup_wizard_after

February 2022

The Dropbox connector now supports syncing Microsoft Excel spreadsheets to your destination. We sync each worksheet in the spreadsheet as a unique table in your destination. We are gradually rolling out this improvement to all our existing connectors.

September 2021

We have added support for short-lived access token authorization. To switch to short-lived access token authorization, you must re-authorize your connector. On your connector's dashboard, go to the Setup tab, click Edit connection details, and then click Re-authorize connection. After successful re-authorization, click Save and Test.

We have added the Magic Folder functionality to our Dropbox connector. You can now sync any supported file from your Dropbox folder as a table within a schema in your destination. New Dropbox connectors created after October 7, 2021, will function as a Magic Folder connector. We will continue supporting existing Dropbox file connectors.

June 2021

We have added support for syncing files/folders in root folder for Dropbox team spaces.

August 2020

We now support syncing headerless delimited format files (CSV, TSV, log) for Dropbox connectors. We will create generic column names for CSV files without a header line. This feature is in beta and available to all connectors. See the configuration options in our files documentation for details.

July 2020

We have improved the way we track which files we have already synced to make sure we only pull new or changed data from the source containers. Previously, we re-synced files that were created at the same time as the last observed cursor position. That ensured that we never missed any files that were created while we were syncing your data. That also meant that we sometimes synced the same files twice. Now, in addition to tracking the timestamp, we also track the names of the files we have already synced. We store up to 1,000 file names. We sync files created at the time of the last observed cursor position only if we don’t have the file in our list of synced files for that timestamp.

May 2020

You can now configure your Dropbox connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.

March 2020

Our Dropbox connector can now sync Parquet files. We support Parquet format 2.4.0. This feature is in Beta.