We have removed the Select tables for packed mode option from the Pack mode field in the connector setup form. We now support Packed mode and Unpacked mode at the connector level for DynamoDB connectors created on or after November 21, 2023. We have also changed the default value of the Pack mode feature to Packed mode in the connector setup form. Previously, we used unpacked mode as the default value for this feature. When you select a pack mode, all the tables enabled for the sync follow the behavior.
We will continue to support both the Pack modes at the table level for DynamoDB connectors created before November 21, 2023. For more information, see our DynamoDB pack mode documentation.
We have significantly improved the performance of our DynamoDB connector during incremental syncs and re-syncs. The connector now extracts your data up to 5 times faster and completes your syncs in almost half the time it took previously.
We have upgraded the DynamoDB connectors from AWS SDK 1.12 to AWS SDK 2.17. We are gradually rolling out this change to all existing connectors.
We have renamed our Sync mode feature to Pack mode.
We now infer the data type of the partition and sort keys. Previously, we synced the keys as STRING. We use automatic data type assignment to find the optimal data type that we can use before writing the data to your destination.
We have changed the sync strategy of our DynamoDB connectors. We now schedule:
- Automatic full source re-syncs if we detect expired change streams cursor.
- Automatic full table re-syncs if we detect:
- Change in pack mode
- Expired change streams cursor
Previously, we never automatically re-synced DynamoDB connectors.
Fivetran history mode is now in beta for the following connectors:
Learn more in our history mode documentation.
We have added support for AWS PrivateLink connections to DynamoDB databases. If you're on a Business Critical plan, you can now opt to always connect through a VPC endpoint if your database and fivetran are in the same AWS Region. In the connector setup form, set the Require PrivateLink toggle to ON. For more information, see our setup instructions.
We currently support private connection for the following AWS regions:
We now support syncing BINARY and BINARYSET data types from your source. In your destination, they will appear as BINARY and JSON data types respectively.
We have introduced packed mode, a new sync mode for DynamoDB tables with more than 1000 first-level fields. Previously, we only supported unpacked mode and used it regardless of the number of columns in a table. We have chosen 1000 columns as the reasonable upper limit for unpacked mode. This limit is compatible with all of our supported data warehouses, which vary in the upper limit of columns they accept. For more details, see our DynamoDB documentation.
If you have a logging service connected to your Fivetran account, the import progress of your tables in the event logs will be visible in your logs as an
import_progress event. Table names will be in either the
IN_PROGRESS state, depending on their sync status. Tables that are not reported in the event have not started their import.
We have made DynamoDB alerts more informative. Alerts now show the names of the table that fell behind the schedule. You can select only those tables to perform re-sync instead of re-syncing all the tables.
You are now able to resync individual tables from the dashboard.
You can now trigger re-syncs of individual tables from your Fivetran dashboard:
The re-sync button appears when you hover your cursor over the row that contains the table name.
This feature is available for the following connectors:
- NetSuite SuiteAnalytics
- SQL Server