October 2022

Dashboard Improvements

MAR category filter

Now you can use the MAR category filter both for the Daily MAR chart on the Account Usage page in your Fivetran dashboard, and for the Connector Usage page chart.

usage_chart_free_mar

Fivetran GCP Japan Servers

We have added new servers in the Google Cloud Platform Japan (Tokyo) region.

You can now select Japan as your data processing location in your destination setup form. This means that your data doesn't leave our region-specific servers during processing. For example, if you configure your connectors to use our servers in Japan, your data does not leave Japan during processing.

For more information, see our data residency documentation.

Lite Connectors

Lite connectors are now available for the following sources:

New IP for fivetran.com

We have changed fivetran.com's underlying IP to 35.236.237.87 as part of infrastructure-level maintenance. If you used the previous IP to integrate HVR with Fivetran, enable outbound access to the new IP from the web browser that you use to manage HVR. Learn more in our Integrate HVR with Fivetran documentation.

Transformations for dbt Core

dbt Core versions 1.2.2 and 1.3.0 support

We now support dbt Core 1.2.2 and 1.3.0. You can use these versions to run your projects.

New connectors

BigCommerce

BigCommerce is an ecommerce platform that provides software as a service to retailers.

Read our BigCommerce connector documentation.

Gainsight Customer Success

Gainsight Customer Success is a customer success platform.

Read our Gainsight Customer Success connector documentation.

Reddit Ads

Reddit Ads is an online advertising platform where advertisers bid to display promoted posts sprinkled in with regular Reddit posts.

Read our Reddit Ads connector documentation.

Schema changes

ActiveCampaign

We have changed the primary key of the E-COM_ORDER_PRODUCT table. We now use the _fivetran_id system column. Previously, the primary key was a combination of the product_id and e-com_order_id columns.

Airtable

Airtable attachment URLs shared using the API expire after a couple of hours. Now, you can not access these expired attachment links in your destination. You can use an external storage service such as Dropbox or Google Drive to store the attachments and link the URLs. For more information, see Changes to Airtable attachments.

Amazon Ads

We migrated from version 2 to version 3 of the reporting Amazon Ads API. We have added the following report tables:

ADVERTISED_PRODUCT_REPORT
CAMPAIGN_AD_GROUP_REPORT
CAMPAIGN_LEVEL_REPORT
CAMPAIGN_PLACEMENT_REPORT
PURCHSED_PRODUCT_KEYWORD_REPORT
PURCHASED_PRODUCT_TARGETING_REPORT
SEARCH_TERM_AD_KEYWORD_REPORT
SEARCH_TERM_TARGETING_REPORT
TARGETING_KEYWORD_REPORT
TARGETING_REPORT

We have deprecated the following report tables:

AD_GROUP_REPORT
ASIN_KEYWORD_REPORT
ASIN_TARGET_REPORT
CAMPAIGN_REPORT
KEYWORD_REPORT
PLACEMENT_REPORT
PRODUCT_ADS_REPORT
SEARCH_TERM_KEYWORD_REPORT
SEARCH_TERM_TARGET_REPORT
TARGET_REPORT

Fivetran Platform Connector

For the accounts that have the Role-Based Access Control (RBAC) feature enabled, we have added the following new tables:

ROLE
ROLE_PERMISSION
RESOURCE_MEMBERSHIP
TEAM
TEAM_MEMBERSHIP

We have added a new table, INCREMENTAL_MAR, which stores the incremental daily active rows for every destination, connector, and table within your account. This is helpful in tracking and managing consumption in our new pricing model. This table contains both paid and free MAR. We have deprecated the ACTIVE_VOLUME table, which stores the cumulative monthly active rows.

Greenhouse

We have added a new column, active, to the JOB_STAGE table.

Iterable

We now sync the following events into the EVENT table:

emailSendSkip
inAppSend
inAppClose
inAppDelete
inAppDelivery
inAppSendSkip
pushSendSkip
pushUninstall
smsSendSkip
webPushClick
webPushSendSkip

If you want to sync historical data for these events, contact our support team.

Salesforce Commerce Cloud

We have added a new column, orderId, to the ORDER_SHIPPING_ITEM and ORDER_SHIPMENT_ADDRESS tables.

We have changed the primary key of the ORDER_SHIPMENT table. The new primary key is a combination of the shipmentNo and shipment_id columns. Previously, we used only the shipment_id column as the primary key.

Stripe

We have added a new column, collection_method, to the INVOICE and SUBSCRIPTION (SUBSCRIPTION_HISTORY for history mode connectors) tables. This column stores the same value as the billing column. Stripe has deprecated the billing column. We will continue to support both columns.

We have added the following new columns to the CARD table:

iin
description
issuer

NOTE: These columns are not available in standard Stripe API requests. Contact Stripe support to enable them on your account.

UserVoice

We have added a new table, MESSAGE, that stores the messages. We are gradually rolling out this feature to all existing connectors. Once it is available for your connector, you can manage this table from the Schema tab of your Fivetran dashboard.

Zendesk Support

We have added a new column, type, to the TICKET_CUSTOM_FIELD table.

We have added a new column, ticket_custom_field_id, to the TICKET_FIELD_OPTION table.

Improvements

Amplitude

We have released pre-built, dbt Core*-compatible data models for Amplitude. Find the models in Fivetran's dbt hub. Learn more in our Fivetran Data Models documentation.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

Apple Search Ads

Now, you can opt to return records without metrics by using the Show Records with no Metrics toggle in the setup form. See our Apple Search Ads setup guide for details.

Azure Blob Storage

You can now connect your Azure Blob Storage container to Fivetran using an SSH tunnel. For more information, see our setup guide.

Azure Private Link

Azure Private Link is now generally available. You can use Azure Private Link with your source, destination, or both your source and destination.

Learn more in our database connection and destination connection documentation.

BigQuery

We no longer support RECORD data type. We now convert the RECORD data type columns to STRING in your BigQuery destination.

Braintree

The Braintree connector now supports table blocking for all Braintree tables. You can now choose which tables to sync and which to block from syncing to your destination. On your Connector Details page, go to the Schema tab and select or deselect the tables. If you want to sync a child table, you must include the parent table in the sync.

Coupa

We have fixed a bug in our Coupa connectors that use OAuth2.0 authentication where we didn't sync a few tables.

To sync these tables, select the following read scopes for the Client ID when configuring the connector:

core.easy_form_response.read
core.item.read
core.sourcing.read
core.sourcing.response.read
core.supplier.read

For existing connectors using OAuth2.0, go to your Coupa Portal and add the above scopes to your Client ID.

Facebook Pages

We have upgraded our Facebook Pages connector from version 14.0 to 15.0 of the Facebook API. Learn more about the changes in the Facebook API v15.0 changelog.

Instagram Business

We have upgraded our Instagram Business connector from version 14.0 to 15.0 of the Graph API. Learn more about the changes in the Facebook API v15.0 changelog.

MongoDB

We now convert UUID data type to STRING (Base64-decoded) in the destination. Previously, we didn't convert UUID data type. This functionality is enabled by default for new connectors created after October 10, 2022. We are gradually rolling out the feature to all the existing connectors.

Oracle

Fivetran Teleport Sync is now available in beta for our Oracle and Oracle E-Business Suite connectors. Learn more in our Fivetran Teleport Sync for Oracle documentation.

Pendo

Our Pendo connector now supports projects in the US1 region. To fetch data from Pendo's US1 data center, you must change the integration key for the connector to one that is compatible with Pendo's US1 endpoint. Generate a compatible integration key from us1.app.pendo.io.

PostgreSQL

Fivetran Teleport Sync is now generally available. Learn more in our Fivetran Teleport Sync for PostgreSQL documentation.

Recharge

We have renamed our ReCharge connector to Recharge, following Recharge's name change. This name change applies to the Fivetran dashboard and our documentation.

Recurly

We have released pre-built, dbt Core*-compatible data models for Recurly. Find the models in Fivetran's dbt hub. Learn more in our Fivetran Data Models documentation.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

SAP Business ByDesign

We now incrementally sync the following tables:

BANK_STATEMENT
CAMPAIGN
DIRECT_DEBIT_MANDATE
GOODS_AND_SERVICE_ACK
JOURNAL_ENTRY
PRODUCT_DESIGN_VERSION
PRODUCT_REQUIREMENT_SPECIFICATION
PURCHASE_ORDER
PURCHASE_REQUEST
PURCHASING_CONTRACT
SERVICE_REQUEST
SUPPLIER_INVOICE

Previously, we re-imported these tables.

To capture deletes, you must select these tables in the SAP Portal. We recommend that you perform table re-syncs after you change the event notifications, to avoid data loss.

SharePoint

We have added the Merge Mode functionality to our SharePoint connector. For connectors created after October 5, 2022, you can now opt to sync multiple files into a single table in your destination. In the connector setup form, select your sync strategy as Merge Mode or Magic Folder. For more information, see our setup instructions.

REST API Improvements

Schema capturing

We have added the schema_status parameter to our Modify a Connector endpoint. You can use it to capture the connector schema before the initial sync. For more information, see our documentation.