How Is the Fivetran State Handled?
Question
When the Fivetran state is empty and AWS Lambda returns hasMore = true
, will Fivetran call the Lambda function and continue to call it indefinitely?
Environment
Connector: AWS Lambda
Answer
- If
hasMore = true
, Fivetran will call the Lambda Function immediately and will continue to call untilhasMore = false
is received. - If
hasMore = false
, Fivetran will not call the Lambda Function until the next sync.
Notes
hasMore
is an indicator for Fivetran to make a follow-up call for fetching the next set of data. Fivetran makes repeated calls until it receives hasMore = false
. If the connector continuously runs for six hours, it will reschedule and save intermediate progress.