AWS Glue Catalog Tables Are Not Removed After Deselection
Issue
When you deselect tables in the Fivetran Schema tab, the table entries remain in the AWS Glue catalog. The tables stay present and queryable even after the snapshot retention period has passed.
Environment
Destination: Managed Data Lake Service (AWS)
Resolution
To resolve this issue, contact our support team to request removal of the internal catalog references for the affected tables.
Do not delete the associated files from S3, as doing so before the catalog references are removed may cause table corruption and require a full re-sync.
After Support confirms that the references have been removed, manually drop the corresponding table entries from the AWS Glue catalog using the AWS Console or AWS CLI. Fivetran cleans up the associated data files in S3 during the next maintenance cycle after they are no longer referenced.
For more information about AWS Glue catalog integration, see Metadata Catalogs.
Cause
This issue occurs because we stop syncing deselected tables but don't automatically remove the corresponding entries from the AWS Glue catalog. Removing them requires our support team to clear the internal catalog references before you manually remove the AWS Glue catalog entries.