How Can I Get the External ID for a Managed Data Lake Service (AWS) Destination Using Terraform or API?

Question

I manage Fivetran only through Terraform or the REST API and want to set up a Managed Data Lake Service (AWS) destination.

To create the AWS IAM role for Fivetran, I need the external_id. The setup guide explains how to find the external ID in the Fivetran dashboard, but I do not want to start the destination setup manually. How can I get the external_id without using the Fivetran dashboard?

Environment

Managed Data Lake Service (AWS)

Answer

Fivetran automatically generates the external_id for each destination group. The value becomes available after you create the group. You do not need to create the destination manually in the Fivetran dashboard. You can complete the setup with Terraform or the REST API.

To get the external_id and configure the destination:

1. Create a Fivetran group using Terraform or the REST API.
2. Copy the group id returned in the create group response.
3. Use the group id as the AWS IAM role external_id when creating the AWS IAM role for Fivetran.
4. Create the Managed Data Lake Service (AWS) destination using Terraform or the REST API.
5. Use the same group id when creating the destination.

For more information, see the following resources:

• Create a Group Using the REST API
• Terraform: Group Resource
• Create IAM Role
• Create a Destination Using the Fivetran REST API
• Terraform: Destination Resource