Error: Replica Cancelled Query

Why Is My Connector Failing with the Replica Canceled Query or Failed to Pipe Output from Query Error?

Issue

Why is my connector failing with the Replica Canceled Query or Failed to Pipe Output from Query error?

The connector failes with one of the following errors:

• Replica Canceled Query
• Failed to Pipe Output

Environment

Connector: PostgreSQL

Resolution

When the connector's source is a replica, in many cases, our import query or incremental XMIN query may fail with the Replica Canceled Query or Failed to Pipe Output from Query error. When the replica server needs to sync with the primary server, the replica server cancels our import/incremental query execution after a certain time defined by the max_standby_streaming_delay parameter. Increasing the value of the max_standby_streaming_delay parameter to 15-30 min makes the replica wait the defined amount of time before canceling our queries.