December 2023
Lite Connectors
Lite connectors are now available for the following sources:
- Amazon Attribution
- Castor EDC
- crowd.dev
- EZOfficeInventory
- Freshdesk Contact Center
- Helpshift
- iLevel
- Incident.io
- ironSource
- Jotform
- KeyPay
- Maxio Chargify
- Persona
- Personio
- Pinpoint
- Prive
- Reply.io
- Vitally
- WordPress
- WorkRamp
- Zoho Desk
Transformations for dbt Core
dbt Core versions 1.1.5, 1.2.6, 1.5.9, 1.6.9 and 1.7.3 support
We now support the following dbt Core versions:
- 1.1.5
- 1.2.6
- 1.5.9
- 1.6.9
- 1.7.3.
You can use these versions to run your projects.
NOTE: For dbt Core versions later than 1.1.5, we don't support MySQL destinations. For dbt Core versions later than 1.4.9, we don't support SQL Server and Azure Synapse destinations. These destinations are not currently supported by custom dbt Core adapters.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
Real-time dbt logs
We now log running transformations in real time.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
Schedule selector options changed
We made the following UI changes to Transformations for dbt Core* scheduling:
- removed the Independent scheduling type for transformations for dbt Core*.
- renamed the Partially-Integrated scheduling type to Custom.
- renamed the Fully-Integrated scheduling type to Integrated.
By default, we are migrating connectors using Independent schedule to Partially-Integrated.
When you select the Custom, if you have upstream connectors, we wait for the upstream connectors to complete the sync before we run the transformation by your schedule. If you don't have upstream connectors, the transformation runs by the schedule.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
Updated dbt Quickstart package
We have updated the Quickstart package for the Iterable connector to version 0.11.0.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
Schema changes
Ada
We have added the following new columns to the CONVERSATION
table:
automated_resolution_classification
automated_resolution_classification_reason
inquiry_summary
CircleCI
We have removed the JOB_METADATA
table.
Coupa
We have added two new tables, APPROVER
and APPROVER_GROUP_USER_MAPPING
, to store information about the users involved in the approval. Be sure to re-sync the connector to backfill the historical data or contact Fivetran Support to re-sync it for you.
dbt Cloud
We have added the following new columns to the CONNECTION
table:
client_session_keep_alive
created_at
is_configured_for_oauth
private_link_endpoint_id
updated_at
We have added the following new columns to the REPOSITORY
table:
gitlab_id
git_provider_state
gitlab_project_access_token_id
gitlab_state
github_webhook_id
private_link_endpoint_id
Front
We have added a new table, ACCOUNT
.
We have added a new column, account_id
, to the CONTACT
table to identify the account to which a contact belongs. Be sure to re-sync the table to backfill the historical data or contact Fivetran Support to re-sync it for you.
HiBob
We have added three new metadata tables:
COMPANY_LIST
CUSTOM_TABLE
POSITION_FIELD
ironSource
We have added the following new columns to the CAMPAIGN_REPORT
table:
ad_unit_name
application_name
creative_name
os
title_name
Kustomer
We have added two new columns, brand_id
and first_response_created_by
, to the CONVERSATION
and CONVERSATION_HISTORY
tables.
We have added a new table, BRAND
. We are gradually rolling out this change to all existing connectors.
Marketo
We have added a new table, FILE
, to store details about all the files in your Marketo account.
Rootly
We have added the following new tables:
AUDIT
CAUSE
DASHBOARD_PANEL
DASHBOARD
FORM_FIELD_OPTION
FORM_FIELD_POSITION
FORM_FIELD_SELECTION
FORM_FIELD
PLAYBOOK_TASK
PLAYBOOK
POST_MORTEM_TEMPLATE
RETROSPECTIVE
ROLE
SECRET
WORKFLOW_GROUP
WORKFLOW
We have renamed the following tables:
GROUPS
table toTEAM
OWNER_GROUP
table toOWNER_TEAM
INCIDENT_GROUP
table toINCIDENT_TEAM
ACTION_ITEM_GROUP
table toACTION_ITEM_TEAM
ACTION_ITEM_ADMINISTRATING_GROUP
table toACTION_ITEM_ADMINISTRATING_TEAM
We have renamed the group_id
column to team_id
in all tables.
We have removed the following tables:
CUSTOM_FIELD_OPTION
CUSTOM_FIELD_SELECTION
INCIDENT_CUSTOM_FIELD_SELECTION
Stripe
We have added a new table, DISCOUNT
, to store data for all Stripe discounts and discount categories.
We have now deprecated the following tables that previously stored values for Stripe discounts and discount categories:
CHECKOUT_SESSION_LINE_ITEM_DISCOUNT
CUSTOMER_DISCOUNT
INVOICE_DISCOUNT
SUBSCRIPTION_DISCOUNT
Tableau
We have added two new columns, schedule_frequency
and schedule_next_run_at
, to the EXTRACT_REFRESH_TASK
table.
We have changed the primary key of the FAVORITE
table. The new composite primary key is a combination of the label
and user_id
columns.
Talkdesk
We have removed the list type columns from the following parent tables and added new child tables to replace the columns in the corresponding parent table:
PARENT TABLE | REMOVED COLUMN(S) | NEW CHILD TABLE(S) |
---|---|---|
CALL | tags | CALL_TAG |
CONTACT_CALL | ring_groups , handling_ring_groups | CONTACT_CALL_RING_GROUP , CONTACT_CALL_HANDLING_RING_GROUP |
MESSAGING_CONTACT | handling_queues , queues | MESSAGING_CONTACT_QUEUE , MESSAGING_CONTACT_HANDLING_QUEUE |
QM_EVALUATIONS_ANALYSIS | ring_group_names | QM_EVALUATION_ANALYSIS_RING_GROUP |
QM_EVALUATION_SCORE | ring_group_ids | QM_EVALUATION_SCORE_RING_GROUP |
RING_ATTEMPT | dial_attempts_queues | RING_ATTEMPT_QUEUE |
USER_STATUS | ring_groups | USER_STATUS_RING_GROUP |
We have changed the primary key of the QM_EVALUATION_ANALYSIS
table to ensure data integrity. The new composite primary key is a combination of the evaluation_id
and question_id
columns. Be sure to update your queries. We are gradually rolling out these changes to all existing connectors.
Workday HCM
We have restored the position_time_type
column in the WORKER_POSITION
table to track employee time type changes (for example, full-time to part-time). The position_time_type_code
column in the POSITION
table does not capture the employee time type changes. Be sure to re-sync the WORKER
table to backfill the historical data for this column or contact our support team to re-sync it for you.
Zendesk Chat
We have added the following new columns to the CHAT_HISTORY
table:
agent_id
department_id
msg_id
prev_department_id
sender_type
Improvements
Ada
We have upgraded our Ada connector from version 1.2 to 1.3 of the Ada REST API. Learn more about the changes in Ada's Data Export API changelog. We are gradually rolling out this improvement to all existing connectors.
dbt Cloud
We have upgraded the REPOSITORY
table of our dbt Cloud connector from version 2 to 3 of the dbt Cloud API. We are gradually rolling out this improvement to all existing connectors.
Eloqua
The Eloqua connector now supports priority-first sync for custom objects. Priority-first syncs fetch your most recent data first so that it's quickly ready for you to use. Eloqua's priority-first syncs fetch the most recent 7 days' worth of data from the custom object tables. To learn more, see our priority-first sync documentation.
Float
We now incrementally sync the PHASE
and PROJECT
tables and their child tables to capture new records.
Front
We now support table level re-syncs for the CONTACT
table.
Google Ad Manager
We have upgraded our Google Ad Manager connector from version 202305 to 202311 of the Google Ad Manager API. As a part of the upgrade, we have made the following changes:
- Removed the
adsense_active_view_revenue
andad_exchange_active_view_revenue
columns - Added a new dimension attributes,
LINE_ITEM_COMPUTED_STATUS
For more information about the changes, see Google Ad Manager's API changelog.
Klaviyo
We have upgraded our Klaviyo connector to Klaviyo API v2023-10-15. Klaviyo connectors created on or after December 19, 2023, will use the new API version.
As a part of the upgrade, we have added the following new columns to the PERSON
table:
ip
subscriptions_email_marketing_can_receive_email_marketing
subscriptions_email_marketing_can_receive_sms_marketing
subscriptions_email_marketing_last_updated
subscriptions_sms_marketing_last_updated
NetSuite SuiteAnalytics
We have fixed a bug where we were facing delays in updating the records of the TASK
table. We have updated our sync strategy and now perform an additional incremental sync of the TASK
table daily to capture updates. This change applies to the NetSuite2.com data source.
Recharge
We have modified our incremental sync strategy to ensure data consistency. Now, our incremental syncs have a 30-minute gap duration to minimize data inconsistencies. For example, a sync starting at 9:00 a.m. fetches data only up to 8.30 a.m. from the Recharge API.
Rithum
The Rithum connector now supports priority-first sync for the ORDERS
and PRODUCT
tables. Priority-first syncs fetch your most recent data first so that it's quickly ready for you to use. Rithum's priority-first syncs fetch the most recent 15 days' worth of data from these tables. To learn more, see our priority-first sync documentation.
SAP ERP on HANA
Now, we can automatically detect truncations for each partition of your column-store transparent table. Such cases will result in a re-sync during the next sync cycle.
Stripe
We now capture the price and product data in the CHECKOUT_SESSION_LINE_ITEM
table and upsert it in the PRICE
and PRODUCT
tables respectively. Previously, we ignored the price and product data present in the CHECKOUT_SESSION_LINE_ITEM
.
Workday HCM
We have added a new field, Workday Tenant, to the connector setup form to allow you to specify your Workday tenant. Previously, you had to specify it together with your Workday username in the {Workday_Username}@{Tenant}
format.
REST API Improvements
New Connector Management Delete Columns API Endpoints
We have implemented new Connector Management API endpoints for our REST API. You can now leverage the following new features:
New fields added in Teams API Response
We now display the created_at
field for each user in the response for the following endpoints:
We now return group_id
, role
, and created_at
for the Update group membership endpoint.
We now return connector_id
, role
, and created_at
for the Update connector membership endpoint.
Log events
Removed dashboard activity log events
We have removed the following dashboard activity log events:
create_file_upload_table
merge_rows
remove_file_upload_table
signin_warehouse
signout_warehouse
upload_file