Recently, Databricks expanded the Fivetran Partner Connect experience to all Databricks users (in public preview) — including non-admin users. Now, in just a few clicks and without having to manually configure platform integrations, users can automatically move data into the Databricks Lakehouse from over 177 different sources.

“With Fivetran in Databricks Partner Connect, end users will now be able to quickly and automatically connect data from popular apps such as Salesforce to the lakehouse so that they can leverage that data for whatever their use case — analytics, BI, data science or machine learning — all on the Databricks platform,“ 

Pankaj Dugar, Vice President of Data and Product Partnerships at Databricks.

“Databricks Partner Connect provides a seamless, integrated experience that makes it easier for Databricks customers to connect data from all of their sources to their lakehouse by way of Fivetran data pipelines, allowing the focus to remain on unlocking insights instead of ETL.”

Logan Welley, Vice President of Alliances at Fivetran, added, 

Databricks Partner Connect: Get to value faster

Fivetran on Databricks Partner Connect simplifies data management for the lakehouse, allowing joint customers like Condé Nast and Paul Hewitt to focus on data insights, not data engineering. 

Companies often struggle to move data into a data lake. Doing so requires building and maintaining complex data pipelines for multiple data sources — a massive drain on data engineering resources.

For example, data engineers need to integrate data from disparate sources such as big data applications, streaming sources, databases and business applications into their data lake to meet the needs of downstream analytics and machine learning applications. This requires configuring each data source separately, harmonizing different file formats, and developing and maintaining complex data pipelines with multiple jobs, tools and infrastructure across data sources. Organizations also struggle to find solutions that connect their lakehouse to the existing tools they rely on. 

Sound complex? It is, but now more than ever, removing that initial complexity is integral as enterprises embark on a journey towards leveraging AI in all variations of innovative ways. 

Through Partner Connect, they can find and connect to Fivetran, which allows them to connect to a multitude of data sources in minutes. This dramatically reduces the time it takes to ingest data into the Databricks Lakehouse Platform, and it comes with zero maintenance burden. 

Why is this recent release important? 

Before this feature, only admins were allowed to establish a workspace-level connection to Fivetran via Partner Connect. If a non-admin user wanted to use the connection they would have to figure out who established the connection and request access to the Fivetran trial or use Databricks core integration documentation which took hours. With this improvement, all users can now establish a connection to Fivetran via the native Partner Connect experience:

Users can also navigate to a similar experience by selecting a Fivetran data source in the ‘Add data’ experience:

Solving the challenge of SaaS APIs

Moving data from seperateSaaS apps (Salesforce, Google Analytics, Facebook, etc.) comes with unique challenges. SaaS APIs change regularly, and analysts may have to wait on data engineers to generate data for analysis. Fivetran on Partner Connect tackles these issues head on, automatically adapting to API changes and making it easy for analysts to connect data from 180+ popular apps to their lakehouse and familiar BI tools. Fivetran also provides automated schema migration, a diverse range of connectors and change data capture capabilities.

Previously only available to some Databricks users, this recent release removes reliance on admin access and empowers all Databricks users to act independent and agile in their data ingestion without sacrificing governance or security. Truly democratizing the movement of data!

[CTA_MODULE]