December 2020
Renaming destination
You can now rename your destinations using the account management page.
To learn more about destination management, read our account management documentation.
Single Sign-on Using Google Workspace
We have added Google Workspace as an officially supported SAML identity provider. This feature is in beta.
Read our setup guide to learn how to set up SSO with Google Workspace.
Transformations for dbt Core
Databricks support
Now dbt Transformations support the Databricks destination. If you use Databricks as a destination, you can just set up your dbt Transformations using our guide; no additional steps are required.
dbt versions
You can now choose the version of dbt that will run your projects. You can specify it in the deployment.yml file.
We support 3 versions of dbt:
- 0.17.2
- 0.18.0
- 0.18.1
If you don't specify dbt version in deployment.yml
file, we'll use the version 0.18.0 to run your projects.
Log services
Fivetran now supports flushing dbt transformations event data to supported log services.
Each log service has a unique path for this data:
Log Service | Path Pattern |
---|---|
AWS CloudWatch | {ACCOUNT_NAME}/{GROUP_NAME}/dbt/{DBT_JOB_NAME} |
Azure Monitor | {ACCOUNT_NAME}_{GROUP_NAME}_dbt_{DBT_JOB_NAME}_CL |
Google Cloud Logging | {ACCOUNT_NAME}-{GROUP_NAME}-dbt-{DBT_JOB_NAME} |
Splunk Logging | channel.account="{ACCOUNT_NAME}" channel.group="{GROUP_NAME}" channel.service="dbt" channel.schema="{DBT_JOB_NAME}" |
Learn more in our Logs documentation.
Schema changes
Braze
We have added a new column, event_type
, to the following tables:
ATTRIBUTION_EVENT
CAMPAIGN_CONVERSION_EVENT
CAMPAIGN_ENROLLMENT_EVENT
CANVAS_CONVERSION_EVENT
CANVAS_ENTRY_EVENT
CUSTOM_EVENT
LOCATION_EVENT
NEWSFEED_IMPRESSION_EVENT
PURCHASE_EVENT
SMS_EVENT
SUBSCRIPTION_EVENT
UNINSTALL_EVENT
WEBHOOK_EVENT
GitHub
We have added a new field, draft
, to the PULL_REQUEST
table. The draft
field indicates whether the pull request is a draft.
Greenhouse
We have added a new column, veteran_status_description
, to replace the veteran_status_message
column in the EEOC
table. We have made this change because the Greenhouse API does not send veteran_status_message
data. If you have previously synced the EEOC table, trigger a table re-sync to ensure data integrity.
HubSpot
We have added a new child table, CALENDAR_TOPIC
, to the CALENDAR_EVENT
table.
We have added the following new columns to the OWNER
table:
is_active
active_user_id
user_id_including_inactive
Microsoft Advertising
We now support the GOALS_AND_FUNNELS_HOURLY_REPORT
and GOALS_AND_FUNNELS_DAILY_REPORT
tables.
PostgreSQL
We have now made the GEOMETRY and GEOGRAPHY data types GeoJSON compliant.
Stripe
We have added a new table, CREDIT_NOTE_LINE_ITEM
. See Stripe's documentation on the credit note line item object for more information.
We have added a new table, PRICE
. See Stripe's documentation on prices for more information.
We have added the following new fields to the CREDIT_NOTE
table:
customer_balance_transaction
discount_amount
subtotal
total
voided_at
We now sync the metadata as JSON objects. We have added a new column, metadata
, to the following tables:
ACCOUNT
APPLICATIOIN_FEE_REFUND
AUTHORIZATION
BANK_ACCOUNT
CARD
CARDHOLDER
CHARGE
COUPON
CREDIT_NOTE
CUSTOMER
CUSTOMER_BALANCE_TRANSACTION
DISPUTE
FILE_LINK
INVOICE
INVOICE_ITEM
INVOICE_LINE_ITEM
ISSUING_CARD
ISSUING_DISPUTE
ORDER
PAYMENT_INTENT
PAYMENT_METHOD
PAYOUT
PLAN
PRODUCT
REFUND
SETUP_INTENT
SKU
SOURCE
SUBSCRIPTION
SUBSCRIPTION_ITEM
TAX_RATE
TOPUP
TRANSACTION
TRANSFER
TRANSFER_REVERSAL
Zendesk Support
We have added two new columns, followup_ids
and via_followup_source_id
, to the TICKET
table.
Zuora
We have upgraded our Zuora connector from Zuora API WSDL version 96.0 to 106.0 and have added two new columns, tax_message
and tax_status
, to the INVOICE
table. We are gradually rolling out this new feature to all existing connectors. If you'd like to enable this feature on your connector, contact our support team.
Improvements
Amplitude
You can now exclude the EVENT_AMPLITUDE_ATTRIBUTION_ID
table from the sync. On your connector details page, go to the Schema tab and deselect the table. By default, we include the EVENT_AMPLITUDE_ATTRIBUTION_ID
table in the sync. If you exclude the table and later want to sync the table, perform a complete table re-sync to ensure data integrity.
Azure Synapse
We now support the PRIMARY KEY table constraint.
BigQuery
We no longer encode STRING data types that are primary keys and have emojis. Previously, we used Base64 encoding to transform STRING types if they were primary keys and had values in the Unicode range D800-DFFF
. New connectors created after December 5, 2020, will support this new functionality by default.
Databricks
We have reduced the sync duration of append-only tables that have primary key columns of INT
, SMALLINT
, or BIGINT
data type. During internal performance testing, we observed a reduction in sync time for destinations with large table sizes.
Fivetran Platform Connector
The Fivetran Platform Connector now supports the creation of account-level connectors. A Fivetran Account Administrator can now sync the connector logs for all destinations in the account. See our setup instructions for more information.
Google Ad Manager
We have added a new connector setup test to validate if we can sync the report you selected in the setup form. This test fails if you select Columns, Dimensions, or Dimension Attributes that are incompatible with the report type.
Greenhouse
We now sync Greenhouse data created on January 1, 2012 and later. Previously, we synced data created on January 1, 1970 and later. Only syncing data back to 2012 makes your historical syncs faster. Any historical syncs that you've already run will not be affected by this change.
Jira
We now automatically capture deletes for Jira connectors. We have removed the "Capture deletes" toggle from the connector setup form. To be able to capture deletes, you must have the Jira Administrators global permission. We cannot capture deleted issues that were deleted before sync deletes was enabled. To get all deleted issues, re-sync your connector.
We have released pre-built, dbt Core-compatible data models for Jira. Find the models in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
We have fixed capturing of array fields such as components
and fixVersions
in the ISSUE_MULTISELECT_HISTORY
table. Now we write null
instead of "0"
for empty values. The value
and _fivetran_id
column values for the relevant records will be updated during the next sync.
LinkedIn Ad Analytics
We have added support for Share Content in the SponsoredUpdateCreativeVariables
, SponsoredVideoCreativeVariables
, and SponsoredUpdateCarouselCreativeVariables
creatives of the CREATIVE
table.
We have added support for Ad InMail Contents. We have added a new child table, IN_MAIL_CONTENT
, to the CREATIVE
table.
Pendo
We now sync the following tables on a priority-first basis:
EVENT
FEATURE_EVENT
GUIDE_EVENT
PAGE_EVENT
POLL_EVENT
TRACK_TYPE_EVENT
Pinterest Ads
The Pinterest Ads connector now supports the 0-day conversion attribution window. You can sync your data based on your custom Pinterest click, engagement, or view attribution windows, such as 1-day click/0-day engagement/0-day view, or 7-day click/0-day engagement/0-day view.
PostgreSQL
We now enforce stricter checks on the replication slot's configuration during the setup tests. Ensure that a replication slot exists within the database you specify and turn on the "test_decoding" plugin.
We now support logical replication on Azure Database for PostgreSQL version 10 and later.
ServiceNow
We now sync the reference links from the reference fields. A reference field stores a reference to a field on another table. We store the reference field link and value in the reference_field_name_link
and reference_field_name_value
columns of your tables.
Splunk Logging
Our Splunk Logging service is now generally available.
Read our Splunk Logging documentation.
Stripe
We now create empty tables in the destination even if the source tables are empty (contain only Null
values).
Xero
We now support values with six decimal places in the following columns of the tables below:
amount
column of theALLOCATION
tablesub_total
,total_tax
,total
, andcurrency_rate
columns of theBANK_TRANSACTION
tableunit_amount
,tax_amount
, andline_amount
columns of theBANK_TRANSACTION_LINE_ITEM
tableamount
,unit_amount
,tax_amount
,line_amount
, andcurrency_rate
columns of theBANK_TRANSFER
tableoutstanding
andoverdue
columns of theCONTACT
tablecurrency_rate
,remaining_credit
,applied_amount
,sub_total
,total_tax
, andtotal
columns of theCREDIT_NOTE
tableamount_due
,amount_paid
, andtotal
columns of theEXPENSE_CLAIM
tablecurrency_rate
,amount_due
,amount_paid
,amount_credited
,cis_deduction
,sub_total
,total_tax
, andtotal
columns of theINVOICE
tabletotal_cost_pool
,purchase_details_unit_price
, andsales_details_unit_price
columns of theITEM
tablenet_amount
,gross_amount
, andtax_amount
columns of theJOURNAL_LINE
tabletax_amount
andline_amount
columns of theMANUAL_JOURNAL_LINE
tablesub_total
,total_tax
,total
,applied_amount
,currency_rate
, andremaining_credit
columns of theOVERPAYMENT
tablebank_ammount
,amount
, andcurrency_rate
columns of thePAYMENT
tablesub_total
,total_tax
,total
,applied_amount
,currency_rate
, andremaining_credit
columns of thePREPAYMENT
tableunit_amount
,line_amount
,tax_amount
, anddiscount_rate
columns of thePURCHASE_ORDER_LINE_ITEM
tablesub_total
,total_tax
, andtotal
columns of theRECEIPT
tableunit_amount
,line_amount
,tax_amount
, anddiscount_rate
columns of theRECEIPT_LINE_ITEM
tablesub_total
,total_tax
,total_discount
, andtotal
columns of theREPEATING_INVOICE
tablediscount_rate
column of theREPEATING_INVOICE_LINE_ITEM
tabledisplay_tax_rate
andeffective_rate
columns of theTAX_RATE
tablerate
column of theTAX_RATE_COMPONENET
table
Previously, we used to round the column values to two decimal places.
Zuora
The Zuora Sandbox connector now supports the Production copy environment. See our setup instructions for more information.
The Zuora Sandbox connector now supports US Cloud Data Center's REST API Production (https://rest.na.zuora.com
) and Sandbox (https://rest.sandbox.na.zuora.com/
) environments.
REST API Improvements
New REST API Endpoints
We have implemented new Connector and Destination Management API endpoints for our REST API. You can now leverage the following new features:
Support external OAuth credentials to authorize connectors in Public API
We have expanded the public API endpoints Create a Connector and Modify a Connector. Now you can authorize the following connectors by adding the auth
section to payloads: