Release Notes
October 2024
The DynamoDB connector now supports the Hybrid Deployment model. For more information, see our setup instructions.
July 2024
We have limited the number of requests we issue for the permissions granted to Fivetran's IAM role. During a sync, if your connector's Schema Change Handling option is set to Allow columns or Block all, we no longer check the Fivetran role's access to tables you have excluded by revoking their permissions. If you have already granted access to these tables, trigger a schema reload to include them in your sync. Learn more in our DynamoDB excluding source data documentation.
November 2023
We have removed the Select tables for packed mode option from the Pack mode field in the connection setup form. For Amazon DynamoDB connections created on or after November 21, 2023, we now support both the Packed mode and Unpacked mode at the connection level. We have also changed the default value of the Pack mode feature to Packed mode in the connection setup form. Previously, we used unpacked mode as the default value for this feature. When you select a pack mode, all the tables enabled for the sync follow that behavior. We will continue to support both Pack modes at the table level for Amazon DynamoDB connections created before November 21, 2023. For more information, see our Amazon DynamoDB pack mode documentation.
We have introduced a new pack mode option to deliver all key-value pairs as JSON strings for all tables. Learn more in our Switching pack modes documentation.
October 2023
We have improved the performance of our Amazon DynamoDB connector during incremental syncs and re-syncs. We have observed that the connector now extracts your data 5 times faster improving the sync speed by 2 times.
September 2023
We have upgraded the Amazon DynamoDB connectors from AWS SDK 1.12 to AWS SDK 2.17. We are gradually rolling out this improvement to all existing connectors.
June 2023
We have renamed our Sync mode feature to Pack mode.
May 2023
We now infer the data type of the partition and sort keys. Previously, we synced the keys as STRING. We use automatic data type assignment to find the optimal data type that we can use before writing the data to your destination.
December 2022
We have changed the sync strategy of our Amazon DynamoDB connectors. We now schedule:
- Automatic full source re-syncs if we detect expired change streams cursor.
- Automatic full table re-syncs if we detect:
- Change in pack mode
- Expired change streams cursor
Previously, we never automatically re-synced Amazon DynamoDB connectors.
September 2022
We have extended packed mode support to our REST API. You can now select the sync mode for your database tables and also specify the tables you want to sync using packed mode.
August 2022
Fivetran history mode is now in beta for the following connectors:
Learn more in our history mode documentation.
January 2022
We have added support for AWS PrivateLink connections to Amazon DynamoDB databases. If you're on a Business Critical plan, you can now opt to always connect through a VPC endpoint if your database and fivetran are in the same AWS Region. In the connector setup form, set the Require PrivateLink toggle to ON. For more information, see our setup instructions.
We currently support private connection for the following AWS regions:
- ap-southeast-2
- eu-central-1
- eu-west-1
- eu-west-2
- us-east-1
- us-west-2
March 2020
We now support syncing BINARY and BINARYSET data types from your source. In your destination, they will appear as BINARY and JSON data types respectively.
January 2020
We have introduced packed mode, a new sync mode for Amazon DynamoDB tables with more than 1000 first-level fields. Previously, we only supported unpacked mode and used it regardless of the number of columns in a table. We have chosen 1000 columns as the reasonable upper limit for unpacked mode. This limit is compatible with all of our supported data warehouses, which vary in the upper limit of columns they accept. For more details, see our Amazon DynamoDB documentation.
September 2019
If you have a logging service connected to your Fivetran account, the import progress of your tables in the event logs will be visible in your logs as an import_progress event. Table names will be in either the COMPLETE or IN_PROGRESS state, depending on their sync status. Tables that are not reported in the event have not started their import.
August 2019
We have made Amazon DynamoDB alerts more informative. Alerts now show the names of the table that fell behind the schedule. You can select only those tables to perform re-sync instead of re-syncing all the tables.
February 2019
You can now re-sync individual tables from the dashboard.
November 2018
You can now trigger re-syncs of individual tables from your Fivetran dashboard:
The re-sync button appears when you hover your cursor over the row that contains the table name.
This feature is available for the following connectors:
- Amazon DynamoDB
- MongoDB
- MySQL
- NetSuite SuiteAnalytics
- Oracle
- PostgreSQL
- Salesforce
- SQL Server
- Zuora