Error: Agent Could Not Start a Pipeline Processing Job

Issue

The Hybrid Deployment Agent could not start a pipeline processing job for a connection due to the following error:

Pod creation failed :0/3 nodes are available: 1 Insufficient cpu, 2 node(s) had untolerated taint {node.kubernetes.io/unreachable: }. preemption: 0/3 nodes are available: 1 No preemption victims found for incoming pod, 2 Preemption is not helpful for scheduling.

Environment

Container platform: Kubernetes

Resolution

To resolve this issue, do the following:

1. Verify that your Kubernetes cluster has worker nodes with enough CPU and memory resources to run Hybrid Deployment jobs.
2. Adjust your cluster resources or scheduling rules as needed.

Fivetran will automatically reschedule the sync for the affected connection and retry after one hour.

Cause

The agent could not start a pipeline processing job for your connection because the Kubernetes cluster did not assign worker nodes with sufficient CPU and memory resources to run Hybrid Deployment jobs.