December 2020
Renaming destination
You can now rename your destinations using the account management page.
To learn more about destination management, read our account management documentation.
Single Sign-on Using Google Workspace
We have added Google Workspace as an officially supported SAML identity provider. This feature is in beta.
Read our setup guide to learn how to set up SSO with Google Workspace.
Transformations for dbt Core
Databricks support
dbt Transformations now support the Databricks destination. If you use Databricks as a destination, you can just set up your dbt Transformations using our guide; no additional steps are required.
dbt versions
You can now choose the version of dbt that will run your projects. You can specify it in the deployment.yml file.
We support 3 versions of dbt:
- 0.17.2
- 0.18.0
- 0.18.1
If you don't specify a dbt version in the deployment.yml file, we'll use the version 0.18.0 to run your projects.
Log services
Fivetran now supports flushing dbt transformations event data to supported log services.
Each log service has a unique path for this data:
| Log Service | Path Pattern |
|---|---|
| AWS CloudWatch | {ACCOUNT_NAME}/{GROUP_NAME}/dbt/{DBT_JOB_NAME} |
| Azure Monitor | {ACCOUNT_NAME}_{GROUP_NAME}_dbt_{DBT_JOB_NAME}_CL |
| Google Cloud Logging | {ACCOUNT_NAME}-{GROUP_NAME}-dbt-{DBT_JOB_NAME} |
| Splunk Logging | channel.account="{ACCOUNT_NAME}"channel.group="{GROUP_NAME}"channel.service="dbt"channel.schema="{DBT_JOB_NAME}" |
Learn more in our Logs documentation.
Schema changes
Braze
We have added a new column, event_type, to the following tables:
ATTRIBUTION_EVENTCAMPAIGN_CONVERSION_EVENTCAMPAIGN_ENROLLMENT_EVENTCANVAS_CONVERSION_EVENTCANVAS_ENTRY_EVENTCUSTOM_EVENTLOCATION_EVENTNEWSFEED_IMPRESSION_EVENTPURCHASE_EVENTSMS_EVENTSUBSCRIPTION_EVENTUNINSTALL_EVENTWEBHOOK_EVENT
GitHub
We have added a new field, draft, to the PULL_REQUEST table. The draft field indicates whether the pull request is a draft.
Greenhouse
We have added a new column, veteran_status_description, to replace the veteran_status_message column in the EEOC table. We have made this change because the Greenhouse API does not send veteran_status_message data. If you have previously synced the EEOC table, trigger a table re-sync to ensure data integrity.
HubSpot
We have added a new child table, CALENDAR_TOPIC, to the CALENDAR_EVENT table.
We have added the following new columns to the OWNER table:
is_activeactive_user_iduser_id_including_inactive
Microsoft Advertising
We now support the GOALS_AND_FUNNELS_HOURLY_REPORT and GOALS_AND_FUNNELS_DAILY_REPORT tables.
PostgreSQL
We have now made the GEOMETRY and GEOGRAPHY data types GeoJSON compliant.
Stripe
We have added a new table, CREDIT_NOTE_LINE_ITEM. See Stripe's documentation on the credit note line item object for more information.
We have added a new table, PRICE. See Stripe's documentation on prices for more information.
We have added the following new fields to the CREDIT_NOTE table:
customer_balance_transactiondiscount_amountsubtotaltotalvoided_at
We now sync the metadata as JSON objects. We have added a new column, metadata, to the following tables:
ACCOUNTAPPLICATIOIN_FEE_REFUNDAUTHORIZATIONBANK_ACCOUNTCARDCARDHOLDERCHARGECOUPONCREDIT_NOTECUSTOMERCUSTOMER_BALANCE_TRANSACTIONDISPUTEFILE_LINKINVOICEINVOICE_ITEMINVOICE_LINE_ITEMISSUING_CARDISSUING_DISPUTEORDERPAYMENT_INTENTPAYMENT_METHODPAYOUTPLANPRODUCTREFUNDSETUP_INTENTSKUSOURCESUBSCRIPTIONSUBSCRIPTION_ITEMTAX_RATETOPUPTRANSACTIONTRANSFERTRANSFER_REVERSAL
Zendesk Support
We have added two new columns, followup_ids and via_followup_source_id, to the TICKET table.
Zuora
We have upgraded our Zuora connector from Zuora API WSDL version 96.0 to 106.0 and have added two new columns, tax_message and tax_status, to the INVOICE table. We are gradually rolling out this new feature to all existing connections. If you'd like to enable this feature on your connector, contact our support team.
Improvements
Amplitude
You can now exclude the EVENT_AMPLITUDE_ATTRIBUTION_ID table from the sync. On your connector details page, go to the Schema tab and deselect the table. By default, we include the EVENT_AMPLITUDE_ATTRIBUTION_ID table in the sync. If you exclude the table and later want to sync the table, perform a complete table re-sync to ensure data integrity.
Azure Synapse
We now support the PRIMARY KEY table constraint.
BigQuery
We no longer encode STRING data types that are primary keys and have emojis. Previously, we used Base64 encoding to transform STRING types if they were primary keys and had values in the Unicode range D800-DFFF. New connections created after December 5, 2020, will support this new functionality by default.
Databricks
We have reduced the sync duration of append-only tables that have primary key columns of INT, SMALLINT, or BIGINT data type. During internal performance testing, we observed a reduction in sync time for destinations with large table sizes.
Fivetran Platform Connector
The Fivetran Platform Connector now supports the creation of account-level connectors. A Fivetran Account Administrator can now sync the connector logs for all destinations in the account. See our setup instructions for more information.
Google Ad Manager
We have added a new connector setup test to validate if we can sync the report you selected in the setup form. This test fails if you select Columns, Dimensions, or Dimension Attributes that are incompatible with the report type.
Greenhouse
We now sync Greenhouse data created on January 1, 2012 and later. Previously, we synced data created on January 1, 1970 and later. Only syncing data back to 2012 makes your historical syncs faster. Any historical syncs that you've already run will not be affected by this change.
Jira
We now automatically capture deletes for Jira connections. We have removed the "Capture deletes" toggle from the connector setup form. To be able to capture deletes, you must have the Jira Administrators global permission. We cannot capture deleted issues that were deleted before sync deletes was enabled. To get all deleted issues, re-sync your connector.
We have released pre-built, dbt Core-compatible data models for Jira. Find the models in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
We have fixed capturing of array fields such as components and fixVersions in the ISSUE_MULTISELECT_HISTORY table. Now we write null instead of "0" for empty values. The value and _fivetran_id column values for the relevant records will be updated during the next sync.
LinkedIn Ad Analytics
We have added support for Share Content in the SponsoredUpdateCreativeVariables, SponsoredVideoCreativeVariables, and SponsoredUpdateCarouselCreativeVariables creatives of the CREATIVE table.
We have added support for Ad InMail Contents. We have added a new child table, IN_MAIL_CONTENT, to the CREATIVE table.
Pendo
We now sync the following tables on a priority-first basis:
EVENTFEATURE_EVENTGUIDE_EVENTPAGE_EVENTPOLL_EVENTTRACK_TYPE_EVENT
Pinterest Ads
The Pinterest Ads connector now supports the 0-day conversion attribution window. You can sync your data based on your custom Pinterest click, engagement, or view attribution windows, such as 1-day click/0-day engagement/0-day view, or 7-day click/0-day engagement/0-day view.
PostgreSQL
We now enforce stricter checks on the replication slot's configuration during the setup tests. Ensure that a replication slot exists within the database you specify and turn on the "test_decoding" plugin.
We now support logical replication on Azure Database for PostgreSQL version 10 and later.
ServiceNow
We now sync the reference links from the reference fields. A reference field stores a reference to a field on another table. We store the reference field link and value in the reference_field_name_link and reference_field_name_value columns of your tables.
Splunk Logging
Our Splunk Logging service is now generally available.
Read our Splunk Logging documentation.
Stripe
We now create empty tables in the destination even if the source tables are empty (contain only Null values).
Xero
We now support values with six decimal places in the following columns of the tables below:
amountcolumn of theALLOCATIONtablesub_total,total_tax,total, andcurrency_ratecolumns of theBANK_TRANSACTIONtableunit_amount,tax_amount, andline_amountcolumns of theBANK_TRANSACTION_LINE_ITEMtableamount,unit_amount,tax_amount,line_amount, andcurrency_ratecolumns of theBANK_TRANSFERtableoutstandingandoverduecolumns of theCONTACTtablecurrency_rate,remaining_credit,applied_amount,sub_total,total_tax, andtotalcolumns of theCREDIT_NOTEtableamount_due,amount_paid, andtotalcolumns of theEXPENSE_CLAIMtablecurrency_rate,amount_due,amount_paid,amount_credited,cis_deduction,sub_total,total_tax, andtotalcolumns of theINVOICEtabletotal_cost_pool,purchase_details_unit_price, andsales_details_unit_pricecolumns of theITEMtablenet_amount,gross_amount, andtax_amountcolumns of theJOURNAL_LINEtabletax_amountandline_amountcolumns of theMANUAL_JOURNAL_LINEtablesub_total,total_tax,total,applied_amount,currency_rate, andremaining_creditcolumns of theOVERPAYMENTtablebank_ammount,amount, andcurrency_ratecolumns of thePAYMENTtablesub_total,total_tax,total,applied_amount,currency_rate, andremaining_creditcolumns of thePREPAYMENTtableunit_amount,line_amount,tax_amount, anddiscount_ratecolumns of thePURCHASE_ORDER_LINE_ITEMtablesub_total,total_tax, andtotalcolumns of theRECEIPTtableunit_amount,line_amount,tax_amount, anddiscount_ratecolumns of theRECEIPT_LINE_ITEMtablesub_total,total_tax,total_discount, andtotalcolumns of theREPEATING_INVOICEtablediscount_ratecolumn of theREPEATING_INVOICE_LINE_ITEMtabledisplay_tax_rateandeffective_ratecolumns of theTAX_RATEtableratecolumn of theTAX_RATE_COMPONENETtable
Previously, we used to round the column values to two decimal places.
Zuora
The Zuora Sandbox connector now supports the Production copy environment. See our setup instructions for more information.
The Zuora Sandbox connector now supports US Cloud Data Center's REST API Production (https://rest.na.zuora.com) and Sandbox (https://rest.sandbox.na.zuora.com/) environments.
REST API Improvements
New REST API Endpoints
We have implemented new Connector and Destination Management API endpoints for our REST API. You can now leverage the following new features:
Support external OAuth credentials to authorize connectors in Public API
We have expanded the public API endpoints Create a connection and Update a connection. Now you can authorize the following connectors by adding the auth section to payloads: