Error: Exceeded Rate Limits: Too Many Concurrent Queries for This Project and Region

Issue

Connectors running on a BigQuery destination fail with either of the following errors:

• Exceeded rate limits: too many concurrent queries for this project_and_region. For more information, see https://cloud.google.com/bigquery/troubleshooting-errors</a>

• Quota exceeded: Your project_and_region exceeded quota for max number of jobs that can be queued per project

Environment

BigQuery destination

Resolution

This error appears as a result of an API quota limitation from BigQuery. Contact Google support to increase the API quota.

You may also want to consider increasing the sync frequency of non-important connectors to reduce failures. Having all the connectors run at the same frequency may exhaust the API quota.

Cause

• Google allows 300 concurrent API requests per user.
• More connectors with high sync frequency may exhaust the API quota.