How Do I Change the EC2 Instance for My Hybrid Deployment Agent?

Question

I'm migrating to a new AWS account and my current EC2 instances running the Fivetran Hybrid Deployment (HD) agents are on the old account. What steps should I take to change the EC2 instance, ensuring everything works correctly?

Environment

Installation environment: AWS EC2 Container: Docker, Kubernetes and Podman

Answer

To migrate your Fivetran HD agent to a new EC2 instance, follow these steps:

1. Ensure all syncs have completed running on the EC2 instance.
2. Stop and remove the container on the old EC2 instance before proceeding, as running two instances with the same agent token can cause conflicts.
3. Create a new EC2 instance in your new AWS account and ensure it meets the requirements outlined in the Prerequisites for the container set up.
4. Before installing the agent on the new EC2 instance, copy the entire $HOME/fivetran/data directory from your old instance to the new one. This directory contains pricing sample data in data/_samples that you must preserve. Use scp, rsync, or S3 to transfer the full directory structure. For more information, see Is It Safe to Delete Files From the data/_samples Directory?.
5. On the new EC2 instance, use the same token from the existing agent to run the installation command so that Fivetran recognizes the agent correctly.
6. Confirm that the agent shows as Online in your Fivetran dashboard under Account Settings > Hybrid Deployment Agents.
7. Verify that the $HOME/fivetran/data/_samples directory is present on the new instance.
8. Ensure your network and IAM roles are configured correctly:
   • Ensure outbound access to Fivetran service endpoints on port 443.
   • If your connectors use an IAM role for authentication, recreate and attach this role to your new EC2 instance. For more information, see How to Use an IAM Role Assigned to an EC2 Instance in AWS With Hybrid Deployment.
9. Once your new instance is online and syncing properly, shut down the old EC2 instance.