Alert: Duplicate Columns
Issue
The source doesn't contain duplicate column names. However, the following alert appears in Fivetran:
Duplicate Columns: We have omitted the following duplicate columns which normalize to the same destination column names.
In addition, a duplicate columns log appears in the Fivetran Platform Connector destination schema.
Environment
All connectors
Resolution
We apply naming conventions when creating tables and columns in your destination. To resolve this issue, ensure your source column names remain unique after we add, remove, or convert characters according to these conventions.
If you don't want to sync the affected columns, you can exclude them from your connection schema:
- In Fivetran, go to your connection page.
- Select the Schema tab.
- Deselect the checkbox next to each column or table that you want to exclude.
- Click Save changes.
Cause
Even if all column names in your source are unique, we may modify them when creating corresponding columns in your destination. These modifications may result in duplicates. For example, the following unique column names:
systemIDsystem__IDsystem_ID
All normalize to system_id.