March 2020link
TLS on SSH connectionslink
As an extra layer of security, Fivetran now enables TLS on your SSH connections by default. We recommend that you keep TLS enabled unless you know it is safe to forgo it, but you can disable it by setting the Require TLS through tunnel toggle to OFF.
This change applies to all database connectors. For more information, see our database connection options documentation.
Schema changeslink
Braintreelink
We have added a new field, processor_authorization_code
, to the TRANSACTION
table.
Facebook Ad Accountlink
We have added a new child table, CREATIVE_HISTORY_ASSET_FEED_SPEC_LINK_URLS
, to the CREATIVE_HISTORY
table. This table stores the link URLs for Placement Asset Customization, Dynamic Creative, and Segment Asset Customization features.
Facebook Ad Insightslink
We have made the account_id
field mandatory for all levels.
We have removed support for the following fields because Facebook has deprecated them:
relevance_score
video_10_sec_watched_actions
cost_per_10_sec_video_view
We have replaced the video_10_sec_watched_actions
field with video_thruplay_watched_actions
in the ACTION_VIDEO_SOUND
and ACTION_VIDEO_VIEW_TYPE
tables per Facebook's replacement guidelines.
For more information, see the Facebook Changelog.
Fivetran PlatformConnectorlink
We have added a new table, ACTIVE_VOLUME
, which stores the cumulative monthly active rows for every destination, connector, and table within your account. This will be helpful in tracking and managing consumption in our new pricing model.
HubSpotlink
We have added three new fields to the CONTACT
table:
canonical_vid
merged_vids
profile_url
We have added three new tables:
CONTACT_MERGE_AUDIT
CONTACT_IDENTITY_PROFILE
IDENTITY_PROFILE_IDENTITY
Iterablelink
We have added a new field, additional_properties
, to the EVENT
table. This field stores the custom data (fields and objects) as a JSON object.
Quickbookslink
We have added a new field, description
, to the VENDOR_CREDIT_LINE
table.
Segmentlink
We have stopped syncing the id
column from the USERS
and IDENTIFIES
tables. The change will not impact existing customers because we haven't removed the column from the destination tables.
Snowplowlink
We have changed the data type of the following fields in the _EVENT
table:
Field Name | Old Data Type | New Data Type |
---|---|---|
ti_quantity | INTEGER | DOUBLE |
domain_sessionidx | INTEGER | STRING |
tr_total | DECIMAL | STRING |
tr_tax | DECIMAL | STRING |
tr_shipping | DECIMAL | STRING |
ti_price | DECIMAL | STRING |
se_value | DECIMAL | STRING |
Stripelink
We have added a new field, tax_exempt
, to the CUSTOMER
table.
We have added a new table, PAYMENT_METHOD
, which stores customer payment method details. We have also added the following child tables to support the various payment types:
AU_BECS_DEBIT
stores details about the AU_BECS_DEBIT payment method.FPX
stores details about the FPX payment method.IDEAL
stores details about the IDEAL payment method.PAYMENT_METHOD_CARD
stores details about the CARD payment method.SEPA_DEBIT
stores details about the SEPA_DEBIT payment method.
We have updated the ACCOUNT
table to support the latest Stripe API version. We have deprecated the following fields from the ACCOUNT
table:
business_name
business_url
debit_negative_balances
decline_charge_on_avs_failure
decline_charge_on_cvc_failure
display_name
legal_entity
payout_schedule_delay_days
payout_schedule_interval
payout_schedule_monthly_anchor
payout_schedule_weekly_anchor
payout_statement_descriptor
product_description
statement_descriptor
support_address
support_email
support_phone
timezone
verification
See the Stripe ERD to learn more about the fields we support in the ACCOUNT
table.
Verizon Medialink
We have added the following fields to the tables below:
external_site_group_name
to theSITE_PERFORMANCE_STATS
tablesection_id
to theCAMPAIGN_BID_PERFORMANCE_STATS
tablekeyword_value
to theCONVERSION_RULES_STATS
tablefact_conversion_counting
to thePERFORMANCE_STATS_WITH_HOUR_FIELD
,PERFORMANCE_STATS_WITHOUT_HOUR_FIELD
,SITE_PERFORMANCE_STATS
,CAMPAIGN_BID_PERFORMANCE_STATS
,PRODUCT_AD_PERFORMANCE_STATS_WITH_HOUR_FIELD
,PRODUCT_AD_PERFORMANCE_STATS_WITHOUT_HOUR_FIELD
,USER_STATS
, andCONVERSION_RULES_STATS
tables
We have removed the following fields from the tables below:
ad_id
from theUSER_STATS
tablead_slot_type
andtile_position
from theSLOT_PERFORMANCE_DAILY
andSLOT_PERFORMANCE_HOURLY
tables
Zendesk Supportlink
We have added a new table, POST
, which stores the content that you post or share with the community.
We have added a new table, POST_COMMENT
, which stores the comments made on your posts.
We have added a new table, SKIP_TICKET_HISTORY
, which stores skip records. When an agent skips over a ticket without responding to the end user, it is recorded as a skip.
We have added a new field, merged_ticket_ids
, to the TICKET
table. This field stores the ticket IDs of the merged tickets.
Improvementslink
Amazon S3link
Our Amazon S3 connector can now sync Parquet files. We support Parquet format 2.4.0. This feature is in Beta.
Apple App Storelink
You can now configure your Apple App Store connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.
Apple Search Adslink
When setting up your connector, you can now select which organizations you'd like to sync. Previously, Fivetran synced all organizations by default.
Azure Blob Storagelink
Our Azure Blob Storage connector can now sync Parquet files. We support Parquet format 2.4.0. This feature is in Beta.
Azure Synapselink
We now convert INSTANT data type to DATETIMEOFFSET data type in the destination. Previously, we converted INSTANT data type to DATETIME2 data type.
We are making this change because the DATETIMEOFFSET datatype contains time zone information, which allows you to view the time zone in the destination if the source data type is INSTANT.
This functionality is enabled by default for new connectors created after March 25, 2020. Contact our Support Team to upgrade the INSTANT data type mapping to DATETIMEOFFSET for your existing connector.
BigQuerylink
We are continuing to migrate BigQuery warehouses to unique service accounts.
Starting on March 3, 2020, we are restricting the usage of the fixed service accounts fivetran-client-writer@digital-arbor-400.iam.gserviceaccount.com
and managedcustomerwriter@digital-arbor-400.iam.gserviceaccount.com
.
The warehouses that still use these service accounts will be broken, and the syncs and setup tests will fail.
To repair your warehouse, you must migrate it to a unique service account. Go to the Destination section of your dashboard, click Save & Test, and follow the instructions that appear in the pop-up window.
We have added support for the DATE data type.
We now convert LocalDate data type to DATE data type in the warehouse. Previously, we converted LocalDate data type to TIMESTAMP data type.
As of March 5, 2020, this functionality is enabled by default for new connectors.
This functionality change will not impact connectors configured before March 5, 2020. We will continue to convert LocalDate type to TIMESTAMP type.
Chartiolink
We have changed the service key file format from P12 to JSON to support Chartio's BigQuery setup configuration change.
Dropboxlink
Our Dropbox connector can now sync Parquet files. We support Parquet format 2.4.0. This feature is in Beta.
DynamoDBlink
We now support syncing BINARY and BINARYSET data types from your source. In your destination, they will appear as BINARY and JSON data types respectively.
Facebook Ad Accountlink
We have upgraded our connector to support Facebook Graph API v6.0 and Marketing API v6.0.
Facebook Ad Insightslink
We have upgraded our connector to support Facebook Graph API v6.0 and Marketing API v6.0.
File Connectorslink
The following file connectors can now sync Parquet files:
We support Parquet format 2.4.0. This feature is in BETA.
FTPlink
Our FTP connector can now sync Parquet files. We support Parquet format 2.4.0. This feature is in Beta.
Google Adslink
You can now configure your Google Ads connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.
Google Campaign Manager 360link
You can now configure your Google Campaign Manager 360 connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.
Google Cloud Storagelink
Our Google Cloud Storage connector can now sync Parquet files. We support Parquet format 2.4.0. This feature is in Beta.
Google Search Consolelink
You can now configure your Google Search Console connector using the Fivetran REST API. This feature is in BETA and available only for Standard and Enterprise accounts.
Iterablelink
We now sync custom fields and objects received from the Iterable API and webhooks.
Jiralink
Previously, when there were multiple changes in the source during the sync, our connector sometimes missed some data. We have fixed this problem by changing our pagination strategy. To ensure that all your data is synced, re-sync your connector.
Microsoft Dynamics 365 CRM Connectorlink
We have simplified setup for our Microsoft Dynamics 365 CRM connector. We now only require the schema name, domain name and resource URL. You no longer need to register an app with Azure, nor do we need your application ID or client secret.
MySQLlink
We have fixed a problem where unsigned BIGINT values larger than 9223372036854775807 were sometimes parsed incorrectly during incremental updates. If any values were incorrectly synced prior to this change, you will need to initiate a re-sync to correct them.
We now replicate empty tables in a MySQL source database as empty tables in the destination.
To correct data integrity issues, we will now trigger a re-sync for a table when we detect a reduction in the size of one of its ENUM columns. Before the re-sync begins, you may notice FIVETRAN_ERROR_ENUM_DELETED
values in these columns.
Pardotlink
We now sync custom fields to the PROSPECT_ACCOUNT
table in JSON format.
Salesforcelink
We can now re-import tables that can't be incrementally updated. We automatically detect tables with replicateable = false
and updateable = false
values and re-import them in full. We mark the re-imported tables as notRecommended
in the dashboard and exclude them from incremental syncs by default. However, you can choose to include them.
Salesforce Marketing Cloudlink
We have implemented a new sync schedule to fetch data from the SUBSCRIBERS
table. Every Saturday, the connector performs a historical sync. The additional Saturday sync improves the connector's overall sync speed.
ServiceNowlink
You can now configure your ServiceNow connector using the Fivetran REST API. This feature is in BETA and is available only for Standard and Enterprise accounts.
SFTPlink
Our SFTP connector can now sync Parquet files. We support Parquet format 2.4.0. This feature is in Beta.
SQL Serverlink
Fivetran has released an updated version of our SQL Server connector, which offers improved sync reliability. We will add a number of upgrades to this version in the coming weeks:
We will support Change Data Capture as an incremental update mechanism for all customers.
We will support the following data types:
- BINARY
- VARBINARY
- IMAGE
- ROWVERSION
- TIMESTAMP
- GEOMETRY
- GEOGRAPHY
For more information, see our SQL Server documentation.
SQL Server Warehouselink
We now convert INSTANT data type to DATETIMEOFFSET data type in the destination. Previously, we converted INSTANT data type to DATETIME2 data type.
We are making this change because the DATETIMEOFFSET datatype contains time zone information, which allows you to view the time zone in the destination if the source data type is INSTANT.
This functionality is enabled by default for new connectors created after March 25, 2020. Contact our Support Team to upgrade the INSTANT data type mapping to DATETIMEOFFSET for your existing connector.
Webhookslink
We have changed the HTTP status response code for successful requests from 201 to 200.
We have added an HTTP header,
Access-Control-Allow-Headers
, to our response to support Cross-Origin Resource Sharing (CORS). The supported header types are Content-Type and Cache-Control.
REST API Improvementslink
Create a Connector Public API Endpoint Extensionlink
We have expanded the current public API endpoints Create a Connector and Modify a Connector. Now, you can control whether setup test are executed automatically by specifying the run_setup_tests
parameter. Read our REST API docs to learn how enable or disable automatic setup tests execution.
New Public API Endpointslink
We have implemented new Connector Management API endpoints for our REST API. You can now leverage the following new features: