September 2022
Fivetran AWS Canada Servers
We have added new servers in the AWS Canada (Montréal) region.
If you're on a Business Critical plan, you can now select this region in your destination setup form. Connectors configured in a destination run in their designated cloud and region, meaning that your data doesn't leave our region-specific servers during processing. For example, if you configure your connectors to use our servers in Canada, your data does not leave Canada during processing.
If you're on an Enterprise or Business Critical plan, this is the default region if you choose Canada as your data processing location and AWS as your cloud provider.
We now support AWS Private Link connections to sources and destinations in ca-central-1 region.
For more information, see our data residency documentation.
IP Addresses No Longer In Use
We previously asked users to safelist 52.0.2.4 and 34.82.204.23 for some cloud regions. You can now remove these IPs from your safelists. We no longer actively support these IPs, though we will retain them for the foreseeable future.
52.0.2.4is the IP of Fivetran’s retired port-forwarder instance, which most connector traffic was routed through for several years.34.82.204.23is the IP of Fivetran’s customer support instance, which some users would safelist so that Fivetran could more effectively debug an issue.
Lite Connectors
We now offer Fivetran Lite connectors. A Lite connector is a new tier of connectors built for specific use cases with an accelerated development cycle.
Lite connectors are now available for the following sources:
Transformations for dbt Core
dbt Core version 1.2.1 support
We now support dbt Core 1.2.1. You can use this version to run your projects.
New connectors
Google Analytics 4 Export
Google Analytics 4 Export is an analytics service to measure traffic and engagement across websites and mobile apps.
Read our Google Analytics 4 Export connector documentation.
Schema changes
Jira
Now we write information about the actual sprint start date stored in the activated_date field, to the start_date column of the SPRINT table in the destination.
NOTE: This feature is relevant for Jira Server (On-Premise) versions 8.8 and above.
Lightspeed Retail
We have added two new columns, secondary_email_address and secondary_email_useType, to the SHIP_TO table.
LinkedIn Ad Analytics
We now sync the CREATIVE_AND_CONVERSION two-dimensional report. We have added the following tables for the two-dimensional report data:
AD_ANALYTICS_BY_CREATIVE_AND_CONVERSIONCONVERSION_HISTORYCONVERSION_ASSOCIATED_CAMPAIGNS
Microsoft Advertising
We have added the following new columns to the tables below:
| TABLE | NEW COLUMNS |
|---|---|
ACCOUNT_PERFORMANCE_* | conversions_qualified, all_conversions_qualified, low_quality_conversions_qualified, view_through_conversions_qualified |
ACCOUNT_IMPRESSION_PERFORMANCE_* | conversions_qualified, all_conversions_qualified, low_quality_conversions_qualified, view_through_conversions_qualified |
AD_EXTENSION_DETAIL_* | conversions_qualified, all_conversions_qualified |
AD_GROUP_PERFORMANCE_* | conversions_qualified, all_conversions_qualified, view_through_conversions_qualified |
AD_GROUP_IMPRESSION_PERFORMANCE_* | conversions_qualified, all_conversions_qualified, view_through_conversions_qualified |
CAMPAIGN_PERFORMANCE_* | conversions_qualified, all_conversions_qualified, low_quality_conversions_qualified, view_through_conversions_qualified |
CAMPAIGN_IMPRESSION_PERFORMANCE_* | conversions_qualified, all_conversions_qualified, low_quality_conversions_qualified, view_through_conversions_qualified |
PRODUCT_DIMENSION_PERFORMANCE_* | conversions_qualified, all_conversions_qualified, view_through_conversions_qualified |
PRODUCT_DIMENSION_IMPRESSION_PERFORMANCE_* | conversions_qualified, all_conversions_qualified, view_through_conversions_qualified |
SHARE_OF_VOICE_DAILY_REPORT_* | conversions_qualified, all_conversions_qualified, view_through_conversions_qualified |
USER_LOCATION_PERFORMANCE_* | all_conversions_qualified, view_through_conversions_qualified |
Pipedrive
Pipedrive has changed the data type of the type.params.pipeline_id column in the GOAL table from INTEGER to ARRAY. We will continue to store the type.params.pipeline_id column as a STRING in the destination.
We added a new table, GOAL_PIPELINE, where goal_id and pipeline_id columns are the composite primary keys. The goal_id column refers to the GOAL table, and the pipeline_id column refers to the PIPELINE table. We made this change because in Pipedrive, a single goal can now be associated with multiple pipelines. You can now query all the associated pipelines of a goal from the GOAL_PIPELINE table. Previously, you had to query the pipeline_id column of the GOAL table.
We have moved the progress column from the GOAL_RESULT table to the GOAL table. We no longer populate the GOAL_RESULT table.
We are gradually rolling out these changes to all existing connectors. If you'd like to enable this feature on your connector, contact our support team.
Qualtrics
We no longer sync the DISTRIBUTION_LINK table. This change takes effect on September 16, 2022.
Stripe
We have added the following new tables:
CHECKOUT_SESSIONCHECKOUT_SESSION_PAYMENT_METHODCHECKOUT_SESSION_TAX_RATECHECKOUT_SESSION_SHIPPING_OPTIONCHECKOUT_SESSION_SHIPPING_ADDRESS_ALLOWED_COUNTRIESCHECKOUT_SESSION_LINE_ITEMCHECKOUT_SESSION_LINE_ITEM_TAX_RATESHIPPING_RATE
Typeform
We now sync incomplete form responses to the RESPONSE table. We are gradually rolling out this change to all existing connectors.
Zuora
We now sync the following Order Delta tables through the Data Query feature:
ORDER_DELTA_MRRORDER_DELTA_TCBORDER_DELTA_TCV
We are gradually rolling out this feature to all existing connectors.
Improvements
Apple Search Ads
We have released pre-built, dbt Core*-compatible data models for Apple Search Ads. Find the models in Fivetran's dbt hub. Learn more about our dbt Core integration in our Transformations for dbt Core documentation.
*dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
Asana
We now check the following columns of the following user-related tables during the sync to ensure data completeness in the USER table:
| TABLE | COLUMNS |
|---|---|
PORTFOLIO | owner_id and created_by_id |
PORTFOLIO_MEMBER | user_id |
STORY | created_by_id |
STORY_HEART | user_id |
TASK | assignee_id and completed_by_id |
TASK_FOLLOWER | user_id |
TAG_FOLLOWER | user_id |
Previously, some user records synced to the USER table might have been missed during syncs.
AWS Lambda
You can now Add secrets as key-pair values when you configure the Lambda connector. Previously, you had to enter your secrets in JSON format. For Lambda connectors created before October 4, 2022, we will continue to support Secrets in JSON format. For more information, see our AWS Lambda setup guide.
AWS PrivateLink for Redshift
AWS PrivateLink is now generally available for Redshift.
For more information, see our Redshift setup guide.
Azure Private Link for Snowflake
Azure Private Link is now generally available for Snowflake.
For more information, see our Snowflake setup guide.
Azure Service Bus
We now support XML messages.
Facebook Ads
We have upgraded our Facebook Ads connector to version 15.0 of the Facebook API. For more information, see Facebook's v15.0 changelog.
Microsoft Advertising
We updated the logic of the Rollback Window Size option. The minimum available window size is now 35 days instead of 30 days.
See the Rollback sync section of our Microsoft Advertising documentation for more details about this option.
MongoDB
Our MongoDB Sharded Cluster connector now supports the following:
- SRV hosts. For example,
mongodb+srv://server.example.com/?readPreference=secondary&readPreferenceTags=nodeType:ANALYTICS - Connection strings. For example,
mongodb://query-router-00.example.com:27016,query-router-01.example.com:27016,query-router-02.example.com:27016/?readPreference=secondary&readPreferenceTags=workloadType:OPERATIONAL&readConcernLevel=local - Multiple mongos query routers. For example,
query-router-00.example.com:27016,query-router-01.example.com:27016,query-router-02.example.com:27016
For more information, see our setup instructions. We are gradually rolling out this feature to all existing connectors. If you'd like to enable this feature on your connector, contact our support team.
PostgreSQL
In PostgreSQL destinations, we now drop the primary key constraints if the index row size exceeds the maximum index row size.
Redshift
We have added support for the VARBYTE data type. For connectors created on or after September 01, 2022, we convert BINARY data type to VARBYTE data type in your Redshift destination. For connectors created before September 01, 2022, we will continue to convert BINARY to VARCHAR type.
Salesforce Commerce Cloud
Our Salesforce Commerce Cloud connector is now generally available.
Read our Salesforce Commerce Cloud connector documentation.
Segment
We now skip events with unsupported data types. For example, in the IDENTIFIES table, events with age = false. Previously, we didn't skip these events, causing the connector to break.
Shopify
We have changed the new connector creation process for Shopify connectors. Shopify connectors created on or after October 7, 2022, require a Shopify custom app. For more information, see our setup instructions.
We will continue to support the existing Shopify connectors without a custom app.
Zendesk Support
We now sync the following Zendesk Talk tables if Zendesk Talk is integrated with your account:
ADDRESSCALL_LEGCALL_LEG_QUALITY_ISSUEGREETINGGREETING_CATEGORYGREETING_IVRIVRIVR_MENUIVR_MENU_ROUTEIVR_MENU_ROUTE_OPTIONLINELINE_CATEGORISED_GREETINGLINE_GREETINGLINE_GROUP
REST API Improvements
Amazon DynamoDB
We have extended packed mode support to our REST API. You can now select the sync mode for your database tables and also specify the tables you want to sync using packed mode.
MongoDB
We have extended packed mode support to our REST API. You can now select the sync mode for your database tables and also specify the tables you want to sync using packed mode.