Release Noteslink

November 2023link

We have removed the Select tables for packed mode option from the Pack mode field in the connector setup form. We now support Packed mode and Unpacked mode at the connector level for DynamoDB connectors created on or after November 21, 2023. We have also changed the default value of the Pack mode feature to Packed mode in the connector setup form. Previously, we used unpacked mode as the default value for this feature. When you select a pack mode, all the tables enabled for the sync follow the behavior.

We will continue to support both the Pack modes at the table level for DynamoDB connectors created before November 21, 2023. For more information, see our DynamoDB pack mode documentation.

We have introduced a new pack mode option to deliver all key/value pairs as JSON strings for all tables. Learn more in our Switching pack modes documentation.

October 2023link

We have significantly improved the performance of our DynamoDB connector during incremental syncs and re-syncs. The connector now extracts your data up to 5 times faster and completes your syncs in almost half the time it took previously.

September 2023link

We have upgraded the DynamoDB connectors from AWS SDK 1.12 to AWS SDK 2.17. We are gradually rolling out this change to all existing connectors.

June 2023link

We have renamed our Sync mode feature to Pack mode.

May 2023link

We now infer the data type of the partition and sort keys. Previously, we synced the keys as STRING. We use automatic data type assignment to find the optimal data type that we can use before writing the data to your destination.

December 2022link

We have changed the sync strategy of our DynamoDB connectors. We now schedule:

• Automatic full source re-syncs if we detect expired change streams cursor.
• Automatic full table re-syncs if we detect:
  • Change in pack mode
  • Expired change streams cursor

Previously, we never automatically re-synced DynamoDB connectors.

September 2022link

We have extended packed mode support to our REST API. You can now select the sync mode for your database tables and also specify the tables you want to sync using packed mode.

August 2022link

Fivetran history mode is now in beta for the following connectors:

• DynamoDB
• MariaDB
• MongoDB
• Oracle

Learn more in our history mode documentation.

January 2022link

We have added support for AWS PrivateLink connections to DynamoDB databases. If you're on a Business Critical plan, you can now opt to always connect through a VPC endpoint if your database and fivetran are in the same AWS Region. In the connector setup form, set the Require PrivateLink toggle to ON. For more information, see our setup instructions.

We currently support private connection for the following AWS regions:

• ap-southeast-2
• eu-central-1
• eu-west-1
• eu-west-2
• us-east-1
• us-west-2

March 2020link

We now support syncing BINARY and BINARYSET data types from your source. In your destination, they will appear as BINARY and JSON data types respectively.

January 2020link

We have introduced packed mode, a new sync mode for DynamoDB tables with more than 1000 first-level fields. Previously, we only supported unpacked mode and used it regardless of the number of columns in a table. We have chosen 1000 columns as the reasonable upper limit for unpacked mode. This limit is compatible with all of our supported data warehouses, which vary in the upper limit of columns they accept. For more details, see our DynamoDB documentation.

September 2019link

If you have a logging service connected to your Fivetran account, the import progress of your tables in the event logs will be visible in your logs as an import_progress event. Table names will be in either the COMPLETE or IN_PROGRESS state, depending on their sync status. Tables that are not reported in the event have not started their import.

August 2019link

We have made DynamoDB alerts more informative. Alerts now show the names of the table that fell behind the schedule. You can select only those tables to perform re-sync instead of re-syncing all the tables.

February 2019link

You are now able to resync individual tables from the dashboard.

November 2018link

You can now trigger re-syncs of individual tables from your Fivetran dashboard:

The re-sync button appears when you hover your cursor over the row that contains the table name.

This feature is available for the following connectors:

• DynamoDB
• MongoDB
• MySQL
• NetSuite SuiteAnalytics
• Oracle
• PostgreSQL
• Salesforce
• SQL Server
• Zuora