Fivetran Iceberg REST Catalog Integration Guide

Follow the instructions in this topic to integrate Snowflake with your Fivetran Iceberg REST Catalog. The integration will allow you to query the data from your data lake through the Fivetran Iceberg REST Catalog using Snowflake.

Integration instructions

Copy pre-configured SQL queries from Fivetran

1. Log in to your Fivetran account.

2. Go to the Destinations page.

3. Select the destination for which you want to integrate Snowflake with Fivetran Iceberg REST Catalog.

4. Go to the Catalog integration tab.

   

5. Copy the SQL queries together. The queries are configured for creating an external volume and catalog integration in Snowflake.

   NOTE:

   • Fivetran provides a unique set of queries for each data lake.
   • Copy both queries together when you first access the Catalog Integration tab for your data lake. The OAUTH_CLIENT_SECRET is visible only during your initial visit and will be masked afterward. If you do not save it or copy both queries in your first visit, you must regenerate it by clicking Refresh DDL SQL.

6. Log in to your Snowflake account.

7. On the navigation menu, go to Projects > Worksheets.

8. In the top right corner, click the Create SQL worksheet (+) icon.

9. Paste the SQL queries in the worksheet.

Create external volume in Snowflake

In your Snowflake worksheet, select and run the query that is configured to create an external volume in Snowflake and run the query.

NOTE: For more information about creating the external volume, see Snowflake documentation.

Grant Snowflake access to S3 bucket or ADLS container

1. Verify whether your Snowflake user account already has access to your S3 bucket (for AWS data lakes) or ADLS container (for Azure data lakes).

2. Depending on whether the user account has the necessary access, do one of the following:

   • If the user already has access, skip to the next step.
   • If the user does not have access, grant the necessary access by following the instructions in Snowflake documentation for AWS and ADLS.

Create catalog integration in Snowflake

1. In your Snowflake account, go the worksheet with the SQL queries you copied from the Fivetran dashboard.

2. Replace the default value of CATALOG_NAMESPACE with your connection schema name.

3. Select and run the query that is configured to create a catalog integration in Snowflake.

   

   NOTE: For more information about creating the catalog integration, see Snowflake documentation.

Create Iceberg tables

Create the external Iceberg tables for your connection schema using the following:

• Names of the external volume and catalog integration you created in the previous steps
• Names of the tables you want to query through the catalog

Additionally, to ensure that Snowflake refreshes the tables automatically, set the value of AUTO_RFERESH to TRUE while creating the tables. The SQL query that Fivetran provides for creating the catalog integration is configured by default to refresh the tables in every 300 seconds.

NOTE: For more information about creating the tables, see Snowflake documentation.