Milvus Setup Guide Private Preview

Follow the setup guide to connect Milvus to Fivetran.

NOTE: This destination is partner-built. For any questions related to the Milvus destination and its documentation, raise a GitHub issue.

Prerequisites

To connect Milvus to Fivetran, you need the following:

• A Milvus cluster - self-deployed or on Zilliz Cloud (fully-managed Milvus). If you don't have one, sign up for an account for free.
• An OpenAI API account for embedding service. If you don't have one, sign up for an account.
• A Fivetran account with permission to add destinations.

Setup instructions

Get Milvus credentials

1. Get the URI and Token for your Milvus Cluster.
   • For self-deployed Milvus, this is from your deployment setup in Docker Compose or K8s config.
   • For Zilliz Cloud:
     1. Log into your Zilliz account or sign up for free.
     2. Select a cluster where you want Fivetran to create a new collection and ingest vector data to. On the Cluster Details tab, copy the Public Endpoint (this will be used as URI when setting up the connection) and Token (this is typically the API Key, but you can also use "User:Password" for legacy clusters).
     3. If you don't want Fivetran to use the shared API Key, you can set up a separate API Key of access to your cluster following Zilliz's instructions.
2. Make a note of the URI and Token of self-deployed Milvus or Zilliz Cloud. You will need it to Finish Fivetran configuration.

Get OpenAI credentials

1. Log in to your OpenAI account.
2. Follow OpenaAI's guide to create an API key if you don't have one already.
3. Make a note of the OpenAI API Token before the pop-up closes. You will need it to Finish Fivetran configuration.

Finish Fivetran configuration

1. Log in to your Fivetran account.
2. Go to the Destinations page and then click Add destination.
3. Enter a Destination name of your choice.
4. Click Add.
5. Select Milvus as the destination type.
6. Enter the Milvus Cluster URI, Milvus Cluster Authentication Token, and OpenAI Token you obtained.
7. Choose the Data processing location.
8. Choose your Time zone.
9. Click Save & Test.

Fivetran will test and validate that we can connect to your Milvus and OpenAI accounts with the credentials you provided in the setup form. On successful completion of the setup test, you can sync your data using Fivetran connectors to the Milvus destination.