Confluent Cloud Setup Guide

Follow our setup guide to connect Confluent Cloud to Fivetran.

Prerequisites

To connect Confluent Cloud to Fivetran, you need a Confluent Cloud account with Kafka Server running.

Setup instructions

Find server name

1. Open the Confluent Cloud Clusters.

2. Select your cluster.

   

3. On the CLIENT CONFIG tab, select the Java configuration.

   

4. Copy the server name from the bootstrap.servers configuration. You will need it to configure Fivetran.

Finish Fivetran configuration

1. In the connector setup form, enter the Destination schema name of your choice.

2. Enter a Consumer Group name. The consumer group should be unique to a connector to keep data integrity.

3. In the Servers section, click + Add. Enter the server name that you found in Step 1 in <host>:<port> format.

4. Select your message type: Json, Avro, Protobuf, or Text.

   • If you choose Json, select a sync type: Packed or Unpacked.

   • If you choose Avro or Protobuf, in the Schema Registry Urls section, click + Add and then enter the following schema registry credentials:

     • Schema Registry Urls
     • Schema Registry Key
     • Schema Registry Secret

5. (Optional) Select a security protocol: PLAINTEXT or SASL. If you choose SASL, enter your API Key and API Secret.

6. (Hybrid Deployment only) If your destination is configured for Hybrid Deployment, the Hybrid Deployment Agent associated with your destination is pre-selected in the Select an existing agent drop-down menu. To use a different agent, select the agent of your choice, and then select the same agent for your destination.

7. Click Save & Test. Fivetran will take it from here and sync your Confluent Cloud data.

Fivetran tests and validates the Confluent Cloud connection. On successful completion of the setup tests, you can sync your Confluent Cloud data to your destination.

Setup tests

Fivetran performs the following Confluent Cloud connection tests:

• The Connecting to Kafka test validates the connection and checks the accessibility of your Kafka topics.
• The Unpacking JSON Messages test checks whether the connector can successfully fetch and unpack messages from your Kafka topics. We perform this test only if you select Json as the Message Type and Unpacked as the Sync Type.
• The Validate Schema Registry Protocol test checks if the Schema Registry URLs that you specified start with http. We perform this test only if you select Avro or Protobuf as the Message Type.

Related articles

description Connector Overview

assignment Release Notes

settings API Connector Configuration

home Documentation Home