Redshift Connector SDK

Amazon Redshift is a cloud-based data warehouse service designed for large-scale data storage and analysis.

Fivetran provides a code template for building a Redshift connector using Connector SDK. Once you modify the template code and deploy the connector to Fivetran, your Redshift connections run, sync data, and can be managed in your dashboard just like with any other native Fivetran connector. This connector is optimized for handling large data volumes with parallel processing and incremental synchronization capabilities.

Ready to start?

The Python code examples for Redshift that we provide as part of our Connector SDK offering simplify the process of building a custom Redshift connector with optimized data extraction.

What is Connector SDK?

Connector SDK is a Python-based toolkit with which you can build custom data source connectors and run them natively on Fivetran. Fivetran’s infrastructure hosts and executes your connector code on a schedule. Just like with any other connector, Fivetran handles syncing data from your source and loading it into your destination.

The Connector SDK leverages Fivetran's existing data pipeline technology, so your Redshift connector benefits from many of the same capabilities as fully native Fivetran connectors. The added benefit is that you can customize an SDK connector for your specific use case. You deploy and maintain your SDK connector. This gives you flexibility, but also the responsibility to maintain the connector.

Your SDK connectors remain private to your account – they are not distributed to other Fivetran customers.

Need help finalizing your Redshift custom connector?

Our team of Professional Services experts is available to provide free advisory services to help you build your Redshift custom connector using the Connector SDK. This includes guidance on setup, troubleshooting, and best practices.

To get started, simply file a support ticket.

Resources for building a Redshift connector

To help you build a Redshift connector, we provide the following resources:

There are two Redshift connector code examples available in our Connector SDK GitHub repository:
- Redshift example for handling large data volumes with parallel processing capabilities.
- Redshift example for basic Redshift data extraction and understanding of Connector SDK functionality.
Step-by-step Redshift setup guide to help you build, deploy, and connect Redshift with your destination using a Connector SDK connector.
General Connector SDK documentation
Working with Connector SDK to help you build and customize your connector.
Connector SDK best practices to help you optimize the performance of your Redshift connector.
Technical reference guide
Troubleshooting common Connector SDK issues
SDK Connector GitHub repository with other examples and helpful guides.