AMQP Setup Guide Private Preview
Follow our setup guide to connect your AMQP 1.0-compatible message broker (such as Solace PubSub+, RabbitMQ, or Azure Service Bus) to Fivetran.
Prerequisites
To connect an AMQP 1.0-compatible broker to Fivetran, you must:
have a broker set up with a queue inside your namespace
ensure that events are properly routed to the queue within the broker so that Fivetran can sync the events
ensure that if you are using mutual TLS (mTLS), the required certificates are configured correctly
Setup instructions
Configure AMQP 1.0-compatible broker
Create a queue in your broker namespace that will be used to send messages to Fivetran.
Configure message routing to ensure events are properly routed to the required queue.
Non-exclusive queues that have more than zero partitions are not supported.
Set up authentication credentials using one of the following methods:
- If you want to use username/password authentication, create or identify a user account with permissions to read from the queue.
- If you want to use mutual TLS (mTLS) authentication, generate and configure the required client certificates and private keys.
Configure network access. To do this, ensure:
- access to Fivetran's IPs if your broker is behind a firewall
- the broker port (typically 5671 for AMQPS) is accessible
For more information on configuring your specific broker, refer to your broker's documentation:
Finish Fivetran configuration
In the connection setup form, enter the Destination schema name of your choice.
In the Host field, enter the hostname or IP address of your AMQP 1.0-compatible broker.
In the Port field, enter the port number for your AMQP 1.0-compatible broker (default: 5671).
(Optional) Enter the Namespace that allows us to identify the broker scope of your queue: RabbitMQ vhost, Solace VPN, or Azure Service Bus namespace.
Enter the Queue name to consume from without prefixes.
Select your Authentication method:
If your broker uses basic authentication, select Username and Password and perform the following steps:
i. Enter your broker Username.
ii. Enter your broker Password.
If your broker requires client certificate authentication, select Mutual TLS authentication and perform the following steps:
i. Upload the Client certificate (.pem file).
ii. Upload the Client private key (.key file).
Ensure your certificates are valid and properly configured in your AMQP 1.0-compatible broker before uploading them to Fivetran. See our Mutual Authentication documentation for detailed instructions to enable this option.
Select your Message Type: Json or Text.
If you select JSON, choose a JSON delivery mode:
- Packed - if you the entire JSON message into the
datacolumn - Unpacked - if you create separate columns for each first-level JSON element with the
value_<element_name>name format
- Packed - if you the entire JSON message into the
(Hybrid Deployment only) If your destination is configured for Hybrid Deployment, the Hybrid Deployment Agent associated with your destination is pre-selected for the connection. To assign a different agent, click Replace agent, select the agent you want to use, and click Use Agent.
Click Save & Test. Fivetran will take it from here and sync your AMQP data.
Fivetran tests and validates the AMQP connection. On successful completion of the setup tests, you can sync your data to your destination.
Setup tests
The Connectivity test validates your AMQP 1.0-compatible broker credentials and checks if Fivetran can successfully connect to your AMQP 1.0-compatible broker and access the specified queue.
Related articles
description Connector Overview
account_tree Schema Information