Why Isn't the valid_through Column Updating in Some History Tables?

Question

Why is the valid_through column of the PAGE_HISTORY, FEATURE_HISTORY, and TRACK_TYPE_HISTORY tables not updating in the destination?

Environment

Connector: Pendo

Answer

Fivetran uses the group.lastUpdatedAt or lastUpdatedAt values returned by the relevant Pendo API objects to detect changes during incremental syncs.

However, when valid_through is updated in Pendo, the corresponding group.lastUpdatedAt or lastUpdatedAt value does not change. As a result, we cannot detect valid_through updates during an incremental sync until another change updates the same record's group.lastUpdatedAt or lastUpdatedAt value.