Error: Response Too Large To Return
Issue
The following error appears:
Response too large to return. Consider specifying a destination table in your job configuration
Environment
Connector: BigQuery
Resolution
To resolve this issue, do the following:
- In Fivetran, go to your BigQuery connection page.
- Select the Settings tab.
- Click Edit connection.
- Set the Use working dataset for queries toggle to ON.
- Click Save & Test.
For more information, see Configure query results table.
Cause
This issue occurs when Fivetran runs a SQL import query that returns more than 10 GB of compressed data and no query results table is configured. Without a configured working dataset, BigQuery can't stage the large query results, so the query fails when the response exceeds the API payload limit.