January 2023

Dashboard Improvements

Improved navigation now generally available

The redesigned Fivetran dashboard is now generally available. It is now easier to manage your connectors, transformations, destinations, and account.

Fivetran AWS Singapore Servers

We have added new servers in the AWS Singapore region.

If you're on a Business Critical plan, you can now select this region in your destination setup form. Connectors configured in a destination run in their designated cloud and region, meaning that your data doesn't leave our region-specific servers during processing. For example, if you configure your connectors to use our servers in Singapore, your data does not leave Singapore during processing.

If you're on an Enterprise or Business Critical plan, this is the default region if you choose Singapore as your data processing location and AWS as your cloud provider.

We now support AWS Private Link connections to sources and destinations in the ap-southeast-1 region.

For more information, see our data residency documentation.

Lite Connectors

Lite connectors are now available for the following sources:

• GoCardless
• Split
• Statsig

Magic Folder

Fivetran Magic Folder connectors are now generally available. Learn more in our Magic Folder documentation.

Transformations for dbt Core

dbt Core versions 1.0.9, 1.1.3, 1.2.4, and 1.3.2 support

We now support dbt Core versions 1.0.9, 1.1.3, 1.2.4, and 1.3.2. You can use these versions to run your projects.

New connectors

Azure Cosmos DB

Azure Cosmos DB is Microsoft's fully-managed NoSQL database.

Read our Cosmos DB connector documentation.

Elasticsearch

Elasticsearch is a document-based NoSQL database. It stores JSON documents in a distributed, RESTful search and analytics engine built on Lucene. We support two Elasticsearch services:

• Elastic Cloud
• Self-Hosted Elasticsearch

Read our Elasticsearch connector documentation.

Freshservice

Freshservice is a cloud-based IT service management platform.

Read our Freshservice connector documentation.

OpenSearch

OpenSearch is a fork of Elasticsearch. It is a document-based NoSQL database. It stores JSON documents in a distributed, RESTful search and analytics engine built on Lucene. We support two OpenSearch services:

• OpenSearch
• Open Distro

Read our OpenSearch connector documentation.

Oracle Fusion Cloud Applications

Oracle Fusion Cloud Applications is a suite of SaaS applications for business functions:

• Oracle Fusion CRM
• Oracle Fusion FSCM (ERP) and Oracle Fusion FSCM (SCM)
• Oracle Fusion HCM

Read our Oracle Fusion Cloud Applications documentation.

RingCentral

RingCentral is a cloud-based business communications solutions platform.

Read our RingCentral connector documentation.

Salesloft

Salesloft is a sales engagement platform.

Read our Salesloft connector documentation.

Schema changes

LinkedIn Ad Analytics

We now use the LinkedIn Marketing APIs for our LinkedIn connectors and have made the following schema changes:

• We have added the following new columns to the CREATIVE_HISTORY table:

  • id 🔑
  • last_modified_at 🔑
  • account_id
  • call_to_action
  • campaign_id
  • click_uri
  • created_at
  • created_by
  • follower_description
  • follower_headline
  • follower_logo
  • follower_organization_name
  • follower_show_member_profile_photo
  • inline_content
  • intended_status
  • is_serving
  • jobs_button_label
  • jobs_headline
  • jobs_logo
  • jobs_organization_name
  • jobs_show_member_profile_photo
  • last_modified_by
  • reference
  • review_status
  • spotlight_description
  • spotlight_headline
  • spotlight_logo
  • spotlight_organization_name
  • spotlight_show_member_profile_photo
  • text_ad_description
  • text_ad_headline
  • text_ad_image
  We sync the call-to-action data into the call_to_action column and the click URI data for text and spotlight ads into the click_uri column.

• We have added the following new columns to the IN_MAIL_CONTENT_HISTORY table:

  • id 🔑
  • last_modified_at 🔑
  • account
  • created_at
  • created_by
  • creative_id
  • html_body
  • last_modified_by
  • name
  • sender
  • sub_content_regular_call_to_action_text
  • sub_content_regular_call_to_action_landing_page
  • sub_content_regular_call_to_action_right_rail_ad_picture
  • sub_content_form_call_to_action_text
  • sub_content_form_right_rail_ad_picture
  • sub_content_guided_replies_sponsored_conversation
  • sub_content_guided_replies_right_rail_ad_picture
  • subject

Medallia

We no longer capture deletes for the following tables:

• GROUP
• UNIT
• UNIT_GROUP

We now sync the following tables by default and you can't exclude them from your syncs:

• GROUP
• FEEDBACK
• FEEDBACK_ANSWER
• FIELD_META_DATA
• UNIT
• UNIT_GROUP

Okta

We have added the following new tables:

• APPLICATION_USER
• SYSTEM_LOG
• SYSTEM_LOG_REQUEST
• SYSTEM_LOG_TARGET

We now sync custom profile fields into the USER_CUSTOM_PROFILE table. If you want to sync historical data for these fields, contact our support team.

We have deprecated the custom profile fields in the USERS table. You can now drop these fields. You can drop any column that is not a standard profile field with the profile_ prefix from the USERS table. The following are the standard profile fields in the USERS table:

• profile_key_gr_person
• profile_key_guid
• profile_login
• profile_email
• profile_first_name
• profile_middle_name
• profile_last_name
• profile_nick_name
• profile_display_name
• profile_second_email
• profile_url
• profile_primary_phone
• profile_preferred_language
• profile_user_type
• profile_organization
• profile_title
• profile_division
• profile_department
• profile_manager
• profile_honorific_prefix
• profile_honorific_suffix
• profile_manager_id
• profile_mobile_phone
• profile_employee_number
• profile_street_address
• profile_city
• profile_state
• profile_zip_code
• profile_country_code
• profile_postal_address
• profile_local
• profile_timezone
• profile_cost_center

We no longer sync the following fields to the APPLICATION_USER table:

• profile_email
• profile_first_name
• profile_for_application_user
• profile_last_name
• profile_mobile_phone
• profile_salesforce_groups
• profile_second_email

Pipedrive

We have changed the datatype of the label column in the DEAL table from INT to STRING, to support Pipedrive changes. For more information, see Pipedrive's documentation.

We have changed the datatype of the category column in the PRODUCT table from INT to STRING, to support Pipedrive changes.

We have removed the product_id column from the primary keys of the PRODUCT_DEAL table as it can contain null values.

Sailthru

We have added the following new columns to the CAMPAIGN table:

• email_hour_range
• end_date
• is_public

We have added the following new columns to the LIST_STAT table:

• active_count
• disengaged_count
• email_count
• emailable_count
• engaged_count
• lists_count
• lists_signup_count
• optout_count
• passive_count
• valid_count

We now sync custom fields to the LIST_STAT table.

We have added three new columns, ip, ip_type, and user_agent, to the following tables:

• ES_CAMPAIGN_CLICKS
• ES_CAMPAIGN_OPENS
• ES_TRIGGERED_CLICKS
• ES_TRIGGERED_OPENS

Salesforce

We have renamed Legacy mode to Soft Delete mode in our Salesforce connectors and have made the following schema changes and improvements:

• In the Soft Delete mode, the tables now contain an additional column, _fivetran_deleted. Use the is_deleted or _fivetran_deleted columns to track deletes.
• Previously, in History mode, we updated the is_deleted column to TRUE when we detected updates. Now, we set the is_deleted column to FALSE to accurately represent the state of the record at a specific time between the _fivetran_start and _fivetran_end timestamps.
• You can now switch the sync mode of a table from History to Soft Delete mode. Previously, you couldn't change the sync mode of a table once you activated history mode.

We are gradually rolling out these changes to all the existing connections.

Snapchat Ads

We have added the following new columns to the AD_SQUAD_HISTORY table:

• bid_strategy
• delivery_constraint
• pacing_type
• target_bid

We have added two new columns, targetable_status and upload_status, to the AUDIENCE_SEGMENT_HISTORY table.

We have added the following new columns to the Campaign Reporting tables, Ad Reporting tables, and Ad Squad Reporting tables:

• conversion_add_cart_swipe_up
• conversion_add_cart_view
• conversion_page_views_swipe_up
• conversion_page_views_view
• conversion_subscribe_swipe_up
• conversion_subscribe_view
• conversion_login
• conversion_login_swipe_up
• conversion_login_view
• conversion_add_to_wishlist
• conversion_add_to_wishlist_swipe_up
• conversion_add_to_wishlist_value
• conversion_add_to_wishlist_view
• conversion_start_trial
• conversion_start_trial_value
• conversion_sign_ups_value
• conversion_sign_ups_swipe_up
• conversion_sign_ups_view
• custom_event_1
• custom_event_1_value
• custom_event_2
• custom_event_2_value
• custom_event_3
• custom_event_3_value
• custom_event_4
• custom_event_4_value
• custom_event_5
• custom_event_5_value

Learn more in our Snapchat Ads Report Tables documentation.

Stripe

We now sync data from the CUSTOMER endpoint to the PAYMENT_METHOD table. Previously, we synced data only from the PAYMENT_INTENT and SETUP_INTENT endpoints, to the PAYMENT_METHOD table. To sync records from the CUSTOMER endpoint, we recommend that you re-sync the CUSTOMER table.

Improvements

Amazon Ads

We have released pre-built, dbt Core-compatible data models for Amazon Ads. Find the models in Fivetran's dbt hub or our Fivetran Data Models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

We have added Amazon Ads to our ad reporting dbt model. Learn more in our ad reporting model documentation.

Azure Service Bus

Our Azure Service Bus connector is now generally available.

Read our Azure Service Bus connector documentation.

BigQuery destination

You no longer have to set the access control of your GCP bucket to Fine-grained. Previously, when configuring the destination, if you opted to configure a VPC service perimeter, we required you to set the access control for the bucket to Fine-grained.

Braintree

We have upgraded our Braintree connector from version 2.108.0 to 3.19.0 of the Braintree API. For more information about the changes and deprecations, see Braintree API's changelog.

Freshdesk

The TICKET_HISTORY table now supports history mode for connections created on or after January 10, 2023.

Gainsight Customer Success

Our Gainsight Customer Success connector is now generally available.

Read our Gainsight Customer Success connector documentation.

Google Cloud Storage

We no longer support using a custom service account to authenticate your Google Cloud Storage bucket. For more information, see our setup instructions.

High-Volume Agent Oracle

Our High-Volume Agent Oracle connector is now generally available.

Read our High-Volume Agent Oracle documentation.

LinkedIn API migration

We have migrated from the Industries API to the new Industry Taxonomy Versions API.

Microsoft Lists

Our Microsoft Lists connector is now generally available.

Read our Microsoft Lists connector documentation.

MongoDB

We now sync BSON_TIMESTAMP data type as INSTANT. For more details, see our documentation.

Okta

You can now configure your Okta connector using the Fivetran REST API. This feature is available only for Free, Standard, Enterprise, and Business Critical accounts.

OneDrive

Our OneDrive connector is now generally available.

Read our OneDrive connector documentation.

Outbrain

We have updated the endpoint we use to retrieve the PROMOTED_LINK_REPORT table. Learn more in Outbrain's API documentation.

Pardot

We now sync the permanently deleted records of the PROSPECT table. We set the is_permanently_deleted column for the permanently deleted records to true. To capture these deletes, we perform a full re-sync of the PROSPECT table on weekends.

You can now sync the custom properties of the LIST and MAP data types in the PROSPECT table.

PayPal

Our PayPal connector is now generally available.

Read our PayPal connector documentation.

Pendo

You can now exclude the VISITOR, VISITOR_APPLICATION, and VISITOR_ACCOUNT_ASSOCIATION tables from the syncs. On your connector details page, go to the Schema tab and deselect the tables. By default, we include these tables in the sync. If you exclude the tables and later want to sync the tables, perform a complete table re-sync to ensure data integrity.

PostgreSQL

We now support Amazon Aurora Serverless PostgreSQL. Read our PostgreSQL documentation for more information.

We can now sync tables with constrained NUMERIC primary keys using Fivetran Teleport Sync. Learn more in our Fivetran Teleport Sync for PostgreSQL documentation.

Qualtrics

We have deselected the following columns from the DISTRIBUTION table in the Schema tab:

• stats_blocked
• stats_bounced
• stats_complaints
• stats_failed
• stats_finished
• stats_opened
• stats_sent
• stats_skipped
• stats_started

By default, we exclude these columns from the sync. We do not recommend including them in the sync as we now support them in the DISTRIBUTION_CONTACT table. If you want to include them in your sync, go to the Schema tab and select them. Previously, these columns were selected in the table by default.

SAP Business ByDesign

We have changed the sync strategy of the PRODUCTION_BILL_OF_MATERIAL table. We now re-import the table. Previously, we incrementally synced the table.
You can now remove the ProductionBillOfMaterial Business Object from your webhook configuration.

SharePoint

Our SharePoint connector is now generally available. Read our SharePoint connector documentation.

We have added a new accessibility option, Access to Limited Sites, to our SharePoint connector. You can now provide access to a specific SharePoint site. For more information, see our setup instructions.

Snowflake destination

We have added a new destination setup test to verify if the default role assigned to the Fivetran user account has the required permissions on the storage integration. We perform this test only if your Snowflake destination is hosted on Google Cloud Platform (GCP).

REST API Improvements

Scoped API key

You can now generate scoped API keys to use with our REST API.