May 2020

Custom Daily Sync Times

Fivetran now supports custom sync scheduling for connectors that sync once a day. Previously, all daily syncs started at midnight in the destination timezone, but now you can choose what time your daily syncs start. We are gradually rolling out this feature to all connectors.

Triggered Transformations

Previously, when a sync triggered multiple long-running transformations the sync history chart showed an "Unknown" status. To fix this issue, we have made the following changes to transformation scheduling:

• A transformation cannot be run or tested again while it is already running or being tested. If you attempt to do so, you will get the error, "Transformation is already running."

To learn more, read our documentation about triggered transformations .

New connectors

Azure SQL Managed Instance

Azure SQL Managed Instance is a cloud database service that combines the broadest SQL Server database engine compatibility with all the benefits of a fully managed and evergreen platform as a service.

See our Azure SQL Managed Instance setup instructions.

Facebook Pages

Facebook Pages allows you to sync your Facebook Page's content, posts, and related insights and metrics.

Read our Facebook Pages connector documentation.

Twilio

Twilio is a cloud communications platform that allows users to programmatically make and receive phone calls, send and receive text messages.

Read our Twilio connector documentation.

Schema changes

Anaplan

We have added a new column, _fivetran_deleted, to the export tables. The _fivetran_deleted column marks data that was deleted in Anaplan.

Braintree

We have added six new tables:

• PLAN
• TRANSACTION_LINE_ITEM
• SAMSUNG_CARD_DETAILS
• CREDIT_CARD_VERIFICATION
• PAYPAL_HERE_DETAILS
• US_BANK_ACCOUNT_DETAILS

We have added the following fields to the tables below:

• country_code_numeric to the CUSTOMER_ADDRESS table
• fax to the REGISTERED_CUSTOMER table
• network_tokenized to the ANDROID_PAY_DETAILS table
• expiration_date to the MASTERPASS_CARD_DETAILS table
• address_* and funding_details_* to the MERCHANT_ACCOUNT table
• customer_id, expiration_date, and address_* to the CREDIT_CARD table
• plan_id, description, next_billing_amount, and descriptor_* to the SUBSCRIPTION table
• plan_id, authorization_expires_at, escrow_status, gateway_rejection_reason, retrieval_reference_number, shipping_amount, shipping_from_postal_code, billing_adress_*, descriptor_*, network_response_*, processor_response_*, risk_data_*, shipping_address_*, and three_d_secure_info_* to the TRANSACTION table
• merchant_account_id, amount_won, case_number, created_date, currency_iso_code, dispute_amount, original_dispute_id, processor_comments, reason_code, reason_description, reference_number, and updated_date to the DISPUTE table
• plan_id to the TRANSACTION_DISCOUNT, SUBSCRIPTION_DISCOUNT, TRANSACTION_ADD_ON, and SUBSCRIPTION_ADD_ON tables

Eloqua

We now store custom timestamp fields in the TIMESTAMP WITHOUT TIME ZONE format (for example, 2020-02-28T16:02:25). These custom fields use the Eastern Time Zone (ET). Previously, we used the Epoch timestamp format to store custom timestamp fields. We will re-sync existing custom tables so that they use the new TIMESTAMP WITHOUT TIME ZONE format.

NOTE: We will continue to store Eloqua system-level timestamp fields, such as created_at and updated_at, in the TIMESTAMP WITH TIME ZONE format (for example, 2020-02-28T16:02:25.987Z).

Mandrill

We have added the following new tables, which store information about emails and their related events:

Recharge

We have added a new column, _fivetran_deleted, to the SUBSCRIPTION table.

We have added a new column, _next_charge_scheduled_at, to the SUBSCRIPTION ATTRIBUTE table.

Shopify

We have added a new column, index, to the ORDER_LINE table. index gives the order of items in a Shopify order.

Snowplow

We have changed the data type of the user_fingerprint field from LONG to STRING.

We have added a new field, data, in the _EVENT table.

Stripe

We have added the following columns to the CUSTOMER table:

• address_*
• balance
• name
• phone

Xero

We have added a new column, _fivetran_deleted, to the SUBSCRIPTION table.

Zendesk Support

We have renamed the attribute_value_name column to value in the TICKET_ATTRIBUTE and AGENT_ATTRIBUTE tables.

We have added a new table AUDIT_LOG, which stores the logs of an audit. We exclude the AUDIT_LOG table from your syncs by default. To sync the table, go to the Schema tab on your connector details page and select AUDIT_LOG table.

Improvements

Asana

You can now configure your Asana connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

Braintree

We have improved the sync speed for our Braintree connector. We have modified our connector settings to minimize READ_TIMEOUT exceptions from Braintree, which will help prevent timeout errors during our syncs.

Braze

You can now configure your Braze connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

Dropbox

You can now configure your Dropbox connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.

Eloqua

You can now configure your Eloqua connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

Facebook Pages

You can now configure your Facebook Pages connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

Front

We have added support for REMINDER and MESSAGE_BOUNCE_ERROR event types.

GitHub

You can now configure your GitHub connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.

Google Ads

You can now set the conversion window size for your Google Ads connector from your Fivetran dashboard and via the REST API. You can either set it manually or let Fivetran detect it automatically. Read more about setting your conversion window size from the dashboard and via the API.

Google Cloud Functions

We have released a new authentication mechanism for the connector. You need to provide Cloud Functions Invoker role to the service account email that is displayed in the connector setup form. You no longer need to grant the allUsers permission for your Google Cloud Function.

We are deprecating the old authentication mechanism that needed Google Cloud Storage (GCS) bucket configuration. Existing users using GCS bucket configuration for authentication will be notified to migrate and use the new authentication mechanism.

We will continue to support the old authentication mechanism for existing connectors for the next two months, so be sure to transition to the new authentication mechanism by July 15, 2020.

Google Search Console

You can now configure your Google Search Console connector schema to select which tables you'd like to sync to your destination.

To learn more, see our data blocking documentation.

HubSpot

You can now configure your HubSpot connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

Jira

You can now configure your Jira connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.

Kantata

You can now configure your Kantata connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.

LinkedIn Ad Analytics

You can now configure your LinkedIn Ad Analytics connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

Mailchimp

We have released pre-built, dbt Core-compatible data models for Mailchimp. Find the model in Fivetran's dbt hub. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

We now support the archived value in the status field of the MEMBER table.

Mandrill

We now support webhooks, which allows us to capture information about email events ("send", "hard_bounce", "soft_bounce", "open", "click", "spam", "unsub", and "reject") as they occur.

For existing Mandrill connectors, we will continue to fetch data using the API in addition to using webhooks. For all new Mandrill connectors, we will only fetch email information using webhooks.

Microsoft Advertising

You can now configure your Microsoft Advertising connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

Oracle

We have a new method for counting the rows in a table that is much faster than our old method. Previously, the query we used to count rows would sometimes time out after 30 minutes, causing the sync to fail. The new method's speed makes your syncs much more reliable. If the new method fails, we will fall back to the old method.

Pinterest Ads

You can now configure your Pinterest Ads connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

PostgreSQL

We now support syncing the BYTEA data type from your source. In your destination, the BYTEA data type will appear as BINARY data type.

Shopify

We have fixed the Product Records are not sorted! API exception by adding a check to avoid cursor overflows.

We now save the state of the CUSTOMER table at regular intervals during the historical sync to ensure data integrity. Saving the state also ensures that the sync progress is not lost in case of a sync failure.

Snapchat Ads

You can now configure your Snapchat Ads connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.

Splunk

You can now configure your Splunk connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.

Taboola

We now support table level re-syncs for Taboola connectors.

Xero

When setting up your connector, you can now select the organizations you'd like to sync.

We have fixed an issue where the connector setup test was failing because of timeout errors.

REST API Improvements

Anaplan

We have modified one of our REST API configuration parameters for Anaplan. We have replaced the exports field with the selected_exports field to sync specific exports. Each export in selected_exports field must be in the <workspace_id>_<model_id>_<export_id> format.

Mailchimp

You can now configure your Mailchimp connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.

Oracle

You can now configure your Generic Oracle, RDS Oracle, and Oracle E-Business Suite connectors using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.