Newly Enabled Columns Don't Appear in the Destination
Issue
Columns enabled after the initial sync don't appear in the destination. Subsequent syncs complete successfully without errors.
Environment
- Connector: Amazon RDS for MariaDB
- Incremental sync method: Binary log
Resolution
To troubleshoot this issue:
In Fivetran, confirm that the affected columns are included in the connection schema:
i. Go to your Amazon RDS for MariaDB connection page.
ii. Select the Setup tab.
iii. Select the checkbox next to the affected tables and columns.
iv. If you made changes, click Save changes.
Check whether any inserts or updates occurred on the affected table after you enabled the columns.
If no inserts or updates occurred, re-sync the table. For instructions, see How to Trigger Historical Re-Syncs.
Cause
This issue occurs when you include a previously excluded column in your connection schema, but no updates occur on the affected table and you don't re-sync it.
When your connection uses the binary log incremental sync method, we add newly enabled columns to the destination during an incremental sync only when inserts or updates occur on the table. Without this activity, syncs complete successfully, but the columns don't appear.