April 2024

Lite Connectors

Lite connectors are now available for the following sources:

• Column
• Genesys
• GitLab
• Liftoff
• ReferralHero
• Zoho Books

New Quickstart Data Models

New dbt Quickstart packages

We have added new Quickstart packages for the following connectors:

• Apple App Store
• LinkedIn Company Pages
• Pendo
• Pinterest Ads
• Recurly
• SAP ERP on HANA
• ServiceNow
• Twitter Ads

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

Proxy Agent

The Fivetran Proxy Agent connection method is now available for the AWS ap-southeast-2 (Sydney) region. The Proxy Agent allows you to connect Fivetran to your database securely. Installed behind your firewall, it initiates communication with Fivetran, eliminating the need for other complicated networking options.

The Fivetran Proxy Agent connection method is now generally available. Our Proxy Agent Management API resource is now generally available.

Transformations for dbt Core

Distributing the run time for dbt jobs with 24-hour schedule

We now offset run times within an hour for dbt jobs that run every 24 hours.

The offset is fixed for the entire group and calculated based on group_id.

We use the same offset for connectors in the same group.

New connectors

Oracle Business Intelligence Publisher

Oracle Business Intelligence Publisher (BIP) is Oracle's enterprise reporting product that provides the ability to create and manage highly formatted reports from a wide range of data sources. Oracle BIP connects directly to the underlying databases to extract data from Oracle Fusion Cloud Applications. Read our Oracle Business Intelligence Publisher connector documentation.

Spotify Ads

Spotify Ads is an online advertising platform. Read our Spotify Ads connector documentation.

Schema changes

Affinity

Aircall

Apple App Store

Effective January 1, 2024, Apple App Store no longer generates the Magazines & Newspapers report. For connections created on or before January 1, 2024, we will continue to sync data from the Magazines & Newspapers reports into the SALES_NEWSSTAND_DETAILED table. For more information, see Apple's documentation.

Auth0

We have added two new tables, ORGANIZATION_MEMBER and ORGANIZATION_MEMBER_ROLE.

Braze

We have added a new column, is_api_campaign, to the CAMPAIGN table.

Brightcove

dbt Cloud

We have added two new tables, RUN_STEP and RUN_TRIGGER.

We have removed the following columns from the RUN table:

• environment
• job
• run_steps
• trigger

EasyPost

Facebook Pages

We have restored the following metrics, since they will no longer be deprecated for API versions on March 14, 2024, according to Facebook's Out-Of-Cycle Changes documentation:

• page_actions_post_reactions_anger_total
• page_actions_post_reactions_haha_total
• page_actions_post_reactions_like_total
• page_actions_post_reactions_love_total
• page_actions_post_reactions_sorry_total
• page_actions_post_reactions_wow_total
• post_activity_by_action_type
• post_activity_by_action_type_unique

Google Ads

We now support asset_group and conversion_action as a custom reports.

We have added a new metadata table DEMAND_GEN_PRODUCT_AD_HISTORY and will gradually add it to all existing connections.

We have added the following fields related to Demand Gen product ad to the AD_GROUP_AD report:

• ad_group_ad.ad.demand_gen_product_ad.breadcrumb1
• ad_group_ad.ad.demand_gen_product_ad.breadcrumb2
• ad_group_ad.ad.demand_gen_product_ad.business_name
• ad_group_ad.ad.demand_gen_product_ad.call_to_action
• ad_group_ad.ad.demand_gen_product_ad.description
• ad_group_ad.ad.demand_gen_product_ad.headline
• ad_group_ad.ad.demand_gen_product_ad.logo_image

We have added the following fields to the AD_GROUP_AD report:

• ad_group_ad.primary_status
• ad_group_ad.primary_status_reasons

We have added a new field, campaign.shopping_setting.disable_product_feed, to the CAMPAIGN report.

We have added the following fields to the TRAVEL_ACTIVITY_PERFORMANCE_VIEW report:

• segments.activity_city
• segments.activity_country
• segments.activity_state

Google Analytics 4 Export

We have added a new column, collected_traffic_source, to the EVENT table. Be sure to re-sync the connector to backfill the historical data or contact Fivetran Support to re-sync it for you.

Google Display & Video 360

We have removed the following metrics as they were sunset in the Bid Manager API:

We no longer support the FULL_PATH and PATH_ATTRIBUTION reports, because they will be sunset in the Bid Manager API on May 1st, 2024.

We no longer support the AUDIENCE_COMPOSITION report, because it has been deprecated.

GRIN

We have added the column metadata in the CONVERSION table to store information about custom fields. Previously, these fields appeared with the prefix meta_data_, but now they are consolidated into a single column.

HiBob

iLevel

Impact Brand

Ironclad

Jira

We now support all Jira field types. This feature is available to all Jira connections set up after April 1, 2024. Learn more in our Jira documentation.

Additionally, we have added a new column, dimension_table, to the FIELD table.

JustCall

Kantata

We have added a new column, primary_workspace_group_id, to the WORKSPACE table.

LaunchDarkly

Linear

We have merged the following tables into a new table, ISSUE_HISTORY:

• ISSUE_HISTORY_1
• ISSUE_HISTORY_2
• ISSUE_HISTORY_3
• ISSUE_HISTORY_4

Loopio

Marketo

We have added a new table, TOKEN, to store the tokens associated with folders and programs.

MNTN

Pipedrive

We have changed the data type of the quantity column in the PRODUCT_DEAL table from LONG to DOUBLE.

Productboard

We have added two new tables, COMPANY and NOTE.

We have added a new column, owner_name, to the following tables:

• COMPONENT
• FEATURE
• OBJECTIVE
• PRODUCT

We removed the foreign-key relationships for the owner_email column from the COMPONENT, FEATURE, OBJECTIVE, and PRODUCT tables.

Salesforce

We have changed the primary key of the URI_EVENT table. We now use the event_identifier column as the new primary key. Previously, we used the id column as the primary key.

We now sync the exact currency field values from your Salesforce account without rounding them off. Previously, we only synced the rounded-off values for the currency fields. Additionally, we have changed the Fivetran data type of these fields to DOUBLE. Previously, the data type was NUMBER. As a result of this change, the destination data type of these fields now depends on how the DOUBLE data type is mapped in the destination.

We are gradually rolling out this change to all existing connections.

Statsig

Stripe

We have removed the ORDER_HISTORY table and its child tables, ORDER_ITEM and SHIPPING_METHOD because Stripe removed support for this endpoint. We are gradually rolling out this change to all existing connections.

Trello

We have added two new tables, BOARD_CUSTOM_FIELD and CARD_CUSTOM_FIELD_ITEM.

Typeform

We have added a new column, ranking, to the RESPONSE_ANSWER_CHOICE table. The new column stores the rank of the choices specified for your Ranking questions. We recommend that you re-sync your connector to backfill the historical data for this column.

Zendesk Support

We have added a new table, ARTICLE_COMMENT, to capture the comments in articles. We are gradually rolling out this change to all existing connections.

Zoho CRM

We now only sync the industry field to the LEAD and ACCOUNT tables. Previously, the industry field would sync to and create NULL values in every custom table as well as the following tables:

• ACCOUNT
• CALL
• CAMPAIGN
• CASE
• CONTACT
• DEAL
• EVENT
• INVOICE
• LEAD
• PRODUCT
• PURCHASEORDER
• QUOTE
• SALESORDER
• SOLUTION
• TASK
• VENDOR

Zoom

Improvements

Attentive

We have changed the way we calculate the value for the _fivetran_id column in the CUSTOM_ATTRIBUTE and SMS_INBOUND tables.

Auth0

We now incrementally sync the LOGS table and its child tables to capture new records.

BigQuery

We now support using quota project to account for quota and billing of Fivetran query workload. For more information, see our BigQuery setup guide.

Bitly

We now incrementally sync the BITLINK table and its child tables to capture new records

Brightcove

We have added support for the date dimension. For more information, see Brightcove's documentation.

commercetools

Our commercetools connector is now generally available. Read our commercetools connector documentation..

You can now configure your commercetools connector using the Fivetran REST API. This feature is available for Free, Standard, Enterprise, and Business Critical accounts.

Databricks

We now support the OAuth machine-to-machine (M2M) authentication type to connect to the Databricks destinations hosted on AWS and Azure. You can use this authentication type only for the destinations that are not connected to Fivetran using AWS PrivateLink and Azure Private Link.

To support this enhancement, we have made the following changes:

• Added a new drop-down menu, Authentication Type, to the setup form. The drop-down menu allows you to choose the authentication method you want Fivetran to use.
• Added two new fields, OAuth 2.0 Client ID and OAuth 2.0 Secret, to the destination setup form.
• Added two new parameters, oauth2_client_id and oauth2_secret, to the Fivetran REST API.

For more information, see our setup instructions and REST API documentation. We are gradually rolling these changes to all existing destinations.

We now sync data from the columns whose name start with a numeric character as Databricks has started supporting such column names. Previously, we did not sync any data from columns whose name started with a numeric character. To backfill the historical data for these columns, re-sync the associated tables. We are gradually rolling this change to all existing destinations.

dbt Cloud

We have changed the sync strategy for our dbt Cloud connector. We now incrementally sync the RUN table and its child tables to capture new records. However, we will continue to re-import the remaining tables.

Eloqua

We now support table-level re-syncs for Eloqua connections.

Facebook Pages

We have upgraded our Facebook Pages connector to version 18.0 of the Graph API. We are gradually rolling out this change to all existing connections. For more information, see Graph API's changelog.

As part of the upgrade, we have added a new column is_expired to the POST_HISTORY table.

FTP

We now support syncing PGP (Pretty Good Privacy) encrypted files. We have added a new advanced configuration, PGP Encryption Options, to the connector setup form. For more information, see our setup instructions.

Google Ad Manager

We have upgraded our Google Ad Manager connector from version 202311 to 202402 of the Google Ad Manager API. As part of the upgrade, we have added the following columns: - ad_server_cpm_and_cpc_revenue_gross - ad_server_all_revenue_gross

For more information, see Google Ad Manager API's changelog.

Google Ads

We now support Google Ads API v16.

Google Analytics 4

We have changed the maximum number of days for the rollback window from 30 to 90 days. For more information, see our Google Analytics 4 rollback sync documentation.

Google Cloud Storage

We now support syncing PGP (Pretty Good Privacy) encrypted files. We have added a new advanced configuration, PGP Encryption Options, to the connector setup form. For more information, see our setup instructions and the REST API config.

Google Drive

We have fixed the behavior of our Google Drive connectors which prevented syncing files with the same names across different folders. Therefore, we upsert the entire file path in the _file column. We now sync these files using the regular expression under the prefix (folder path) excluding the root folder name, in the File Pattern field. For more information, see our setup instructions.

Google Search Ads 360

We now support Google Search Ads 360 Reporting API.

HubSpot

We now support table-level re-syncs for HubSpot connections.

We now support HubSpot's Goals API to sync the goals data in your HubSpot account. To support this enhancement, we have added the following new tables:

• <CUSTOM_OBJECT>_GOAL
• ENGAGEMENT_GOAL
• GOAL
• GOAL_COMPANY
• GOAL_CONTACT
• GOAL_DEAL
• GOAL_PROPERTY_HISTORY
• GOAL_TICKET

We are gradually rolling out these changes to all existing connections.

We now support HubSpot's Event Analytics API to sync the event analytics data in your HubSpot account. To support this enhancement, we have added a new table, EVENT. We are gradually rolling out this change to all existing connections.

Marketo

We have changed the priority fetch period of priority-first syncs from 7 days to 1 day. For more information, see our priority-first sync documentation.

Mixpanel

We now fetch only the historical data for past events until March 1, 2019, for all connections. Connections created after January 2021 already follow this behavior. For connections created before January 2021, we recommend that you trigger a re-sync to backfill the historical data until March 2019.

NetSuite SuiteAnalytics

To improve the sync performance, we now use multiple concurrent sessions to sync your NetSuite data. We are gradually rolling out this improvement to all existing connections.

Oracle Fusion Cloud Applications

We no longer re-import the tables where the active primary key job schedule fails. The change in the sync strategy may improve the connector's overall sync performance. We are gradually rolling out this improvement to all existing connections.

Pardot

We have upgraded the following tables of our Pardot connector to version 5 of the Pardot API.

• CAMPAIGN
• LIST
• LIST_MEMBERHSIP
• VISIT
• VISITOR
• VISITOR_ACTIVITY
• VISITOR_PAGE_VIEW

As part of the upgrade, we have made the following schema changes:

• Added the following new columns to the CAMPAIGN table:

  • created_at
  • created_by_id
  • folder_id
  • parent_campaign_id
  • salesforce_id
  • updated_at
  • updated_by_id

• Added the following new columns to the LIST table:

  • campaign_id
  • created_by_id
  • folder_id
  • updated_by_id

• Added the following new columns to the LIST_MEMBERSHIP table:

  • created_by_id
  • updated_by_id

• Added the following new columns to the VISITOR table:

  • campaign_id
  • do_not_sell
  • is_identified

• Added the following new columns to the VISITOR_ACTIVITY table:

  • custom_redirected_id
  • updated_at

• Added the following new columns to the VISITOR_PAGE_VIEW table:

  • campaign_id
  • duration_in_seconds
  • salesforce_id
  • visitor_id

• Deprecated the is_crm_visible column from the LIST table.

We have added a new table CUSTOM_FIELD with the following columns:

• created_at
• created_by_id
• field_id
• id
• is_analytics_synced
• is_record_multiple_responses
• is_required
• is_use_values
• name
• salesforce_id
• type
• updated_at
• updated_by_id

We are gradually rolling out this improvement to all existing connections.

Rakuten Advertising

We now sync data using the process date instead of the transaction date in the REPORT table to prevent data integrity issues.

Salesforce

We now support the following functions for formula fields:

• For Date and Time functions

  • DAYOFYEAR
  • FORMATDURATION
  • FROMUNIXTIME
  • ISOWEEK
  • ISOYEAR
  • UNIXTIMESTAMP

• For Math functions

  • ASIN
  • ACOS
  • ATAN
  • ATAN2
  • COS
  • PI
  • TRUNC
  • SIN
  • TAN

• For Text functions

  • ASCII
  • CHR
  • INITCAP
  • PICKLISTCOUNT
  • REVERSE

Salesforce Marketing Cloud

We have added support for syncing Data Extensions from your Salesforce Marketing Account. We create a destination table for each data extension table. We are gradually rolling out this change to all our existing connections.

SAP ERP on HANA

You can now download a new version of the Fivetran NetWeaver API: v1900216. This API version enables the following two features:

• Handling deleted data during SAP archiving process
• Replication of CDS views and row-store transparent tables

For more information, see our SAP ERP on HANA documentation and setup guide.

We have changed the way we convert DATS values for primary key columns. When you set the Enable SAP date to LocalDate conversion toggle to ON, we now keep the original column as a STRING type and create a new column called <original_column_name>_DATE, with its values converted from DATS to LocalDate type. Previously, we only converted the original column to LocalDate when you enabled this toggle. Learn more in our SAP ERP on HANA documentation and setup guide.

Statsig

We have changed the way we calculate the value for the _fivetran_id column in the EVENT_CONFIG_CHANGE table.

Workday HCM

Our Workday HCM connector now supports Workday's Absence Management and Time Tracking modules. To support this enhancement, we have added the following new tables:

• To support the Absence Management module, we have added:

  • ABSENCE_INPUT
  • CARRYOVER_OVERRIDE
  • CARRYOVER_OVERRIDE_BALANCE
  • OVERRIDE_BALANCE
  • TIME_OFF_PLAN_BALANCE
  • TIME_OFF_PLAN_BALANCE_POSITION

• To support the Time Tracking module, we have added the CALCULATED_TIME_BLOCK table.

To sync these tables, enable the security domains necessary for these modules. We are gradually rolling out these changes to all existing connections.

Yahoo Search Ads on Yahoo Japan

We have changed the date from which we start syncing your data in historical syncs. During historical syncs, we now sync your data from January 1, 2019. However, if you want us to sync your historical data older than January 1, 2019, contact our support team.

Zendesk Support

We now support syncing anonymous votes in the USER_VOTE table. We sync the anonymous votes as null in the user_id column. Previously, we synced votes only from known users. We are gradually rolling out this improvement to all existing connections.

REST API Improvements

Hybrid Deployment Agent Management API

Our Hybrid Deployment Agent Management API resource is now Private Preview. You can now leverage the following features:

• Create a Hybrid Deployment Agent
• List Hybrid Deployment Agents
• Retrieve Hybrid Deployment Agent Details
• Delete a Hybrid Deployment Agent
• Regenerate authentication keys for a Hybrid Deployment Agent

Log events

Removed deprecated log events

We no longer generate the following log events:

• STATUS (deprecated)
• DISCONNECT_BI_TOOL
• CONNECT_BI_TOOL
• UPDATE_BI_TOOL
• CREATE_STAGING_TABLE
• APPLY_TIER_LIMITATION
• MIGRATE_SCHEMA_CONFIG
• SCHEMA_MIGRATION_FAILURE
• SCHEMA_MIGRATION_SUCCESS
• DISMISS_WARNING
• TRANSFORMATION_RUN_START
• TRANSFORMATION_RUN_SUCCEEDED
• TRANSFORMATION_RUN_FAILED

For more information, see our Logs documentation.