Release Notes

December 2024

We have added a new configuration option, Primary Key used for file process and load, in the connector setup form to support syncing files with custom primary keys. You can now select the custom primary keys during the connector configuration and use them to update or insert new rows in your destination. We process the most recently modified files to your destination. For more information, see our setup instructions.

September 2024

We have made the following changes to the Lines to Skip and Skip Footer Lines fields in the setup form:

• Renamed the Lines to Skip field to Skip Header Lines
• Added toggles to the Skip Header Lines and Skip Footer Lines fields, which allow you to specify the number of lines you want the connector to skip

For more information, see our setup instructions.

March 2024

While syncing your email attachments, we now store the date and time when the email was sent in the _modified column. Previously, this column contained the date and time when the connector uploaded the attachments to our internal S3 bucket.

NOTE: This change is not applicable to the syncs already completed before March 16, 2024.

July 2023

We have changed the default value of the JSON Delivery Mode feature to Packed in the connector setup form. Previously, we used Unpacked as the default value for this feature.

We now support syncing XML files to your destination. We have added a new option, xml, to the File Type drop-down menu of the connector setup form. We load your XML data into the _data column without flattening it. For more information, see our setup instructions.

We now support custom line separators for CSV files. You can specify a custom line separator in the Line Separator field of the connector setup form. For more information, see our setup instructions.

June 2023

We now support multi-character delimiters for CSV files. You can specify a multi-character delimiter in the Delimiter field of the connector setup form. For more information, see our setup instructions.

May 2023

We now automatically skip files containing poorly formatted lines. We have removed the Error Handling option from the connector setup form. We no longer support the on_error config parameter in our REST API connector setup configuration.

Our Email connector can now sync packed JSON files. We have added a new drop-down menu, JSON Delivery Mode, to the connector setup form. The drop-down menu provides you the option to choose how Fivetran should handle your JSON data. For more information, see our setup instructions.

April 2023

We have changed the composite primary key of all tables. The new composite key is a combination of the _directory, _file, _line, and _modified columns.

August 2020

We now support syncing headerless delimited format files (CSV, TSV, log) for Email connectors. We will create generic column names for CSV files without a header line. This feature is in beta and available to all connectors. See the configuration options in our files documentation for details.

May 2018

When we encounter malformed files during our syncs, we now skip them and send you a warning so that you can fix the files in question. Previously, our entire sync would fail if malformed files were present.