Confluent Cloud Setup Guide
Follow our setup guide to connect Confluent Cloud to Fivetran.
Prerequisites
To connect Confluent Cloud to Fivetran, you need:
- A Confluent Cloud account with Kafka Server running
- (For API Key authentication) A Kafka API key and secret with the Kafka cluster resource scope
- (For API Key authentication with Avro or Protobuf message types) A Schema Registry API key and secret with the Schema Registry resource scope. This key is separate from your Kafka API key.
- (For OAuth 2.0 authentication) The client ID, client secret, and token endpoint URL from your OAuth 2.0 identity provider. If your Kafka cluster and Schema Registry use different applications, you need these values for each.
- (Optional, for OAuth 2.0 authentication) The ID of your identity pool, if your identity provider uses multiple identity pools
Setup instructions
Find server name
Open the Confluent Cloud Clusters.
Select your cluster.

On the CLIENT CONFIG tab, select the Java configuration.

Copy the server name from the
bootstrap.serversconfiguration. You will need it to configure Fivetran.
Finish Fivetran configuration
In the connection setup form, enter the Destination schema name of your choice.
In the Destination names field, choose the naming convention you want Fivetran to use for the schemas, tables, and columns in your destination:
- Fivetran naming: Standardizes the schema, table, and column names in your destination according to the Fivetran naming conventions.
- Source naming: Preserves the original schema, table, and column names from the source system in your destination.
If you want to modify your selection, make sure you do it before you start the initial sync.
Enter a Consumer Group name. The consumer group name should be unique to a connection to keep data integrity.
In the Servers section, click + Add. Enter the server name that you found in Step 1 in
<host>:<port>format.(Optional) Select a security protocol: PLAINTEXT or SASL.
We do not recommend selecting PLAINTEXT unless you operate in a trusted and isolated network. This protocol transmits all data unencrypted, which can expose sensitive information to interception.
(SASL only) Select your Authentication Method.
Provide the details required for your selected authentication method.
API Key
- In the API Key field, enter your Kafka API key.
- In the API Secret field, enter the secret for that API key.
OAuth 2.0
Configure your OAuth 2.0 identity provider in Confluent Cloud, and then enter the following credentials:
- Client ID: The client ID of your OAuth 2.0 application.
- Client Secret: The client secret of your OAuth 2.0 application.
- Token Endpoint URL: The URL of your identity provider's token endpoint.
- Scope: (Optional) The OAuth 2.0 scope to request. Leave it blank to use the Identity Provider's (IdP) default scope.
- Logical Cluster ID: The Confluent Cloud cluster ID (format:
lkc-xxxxxxx). Find it under Cluster settings in the Confluent Cloud Console. - Identity Pool ID: (Optional) The identity pool ID if your IdP uses multiple identity pools.
Select your message type: Json, Avro, Protobuf, or Text.
If you choose Json, select a sync type: Packed or Unpacked.
If you choose Avro or Protobuf, in the Schema Registry Urls section, click + Add and enter your Schema Registry URL.
(Avro and Protobuf only) Select your Schema Registry Authentication Method.
(Avro and Protobuf only) Provide the details required for your selected Schema Registry authentication method.
API Key
- In the Schema Registry Key field, enter your Schema Registry API key.
- In the Schema Registry Secret field, enter the secret for that API key.
OAuth 2.0
Configure an external OAuth identity provider in Confluent Cloud for your Schema Registry cluster, and then enter the following credentials:
Your token endpoint must issue v2.0 tokens. For Azure Entra ID, ensure the target application's manifest has
"requestedAccessTokenVersion": 2.- Schema Registry Client ID: The client ID of your OAuth 2.0 application.
- Schema Registry Client Secret: The client secret of your OAuth 2.0 application.
- Schema Registry Token Endpoint URL: The token endpoint URL of your identity provider (for example,
https://login.microsoftonline.com/<tenant>/oauth2/v2.0/tokenfor Azure Entra ID). - Schema Registry Scope: (Optional) The OAuth 2.0 scope to request. Leave it blank to use the identity provider's default scope.
- Schema Registry Logical Cluster ID: The Schema Registry cluster ID (format:
lsrc-xxxxxxxorlscc-xxxxxxx). Find it under Stream Governance in the Confluent Cloud Console. Do not use the Kafka cluster ID (lkc-xxxxxxx). - Schema Registry Identity Pool ID: (Optional) The identity pool ID. Required only if your identity provider uses workload identity federation with multiple identity pools.
(Hybrid Deployment only) If your destination is configured for Hybrid Deployment, the Hybrid Deployment Agent associated with your destination is pre-selected for the connection. To assign a different agent, click Replace agent, select the agent you want to use, and click Use Agent.
Click Save & Test. Fivetran will take it from here and sync your Confluent Cloud data.
Fivetran tests and validates the Confluent Cloud connection. On successful completion of the setup tests, you can sync your Confluent Cloud data to your destination.
Setup tests
Fivetran performs the following Confluent Cloud connection tests:
- The Connecting to Kafka test validates the connection and checks the accessibility of your Kafka topics.
- The Unpacking JSON Messages test checks whether the connection can successfully fetch and unpack messages from your Kafka topics. We perform this test only if you select Json as the Message Type and Unpacked as the Sync Type.
- The Validate Schema Registry Protocol test checks if the Schema Registry URLs that you specified start with
http. We perform this test only if you select Avro or Protobuf as the Message Type.