Error: Exceeded Rate Limits: Too Many Concurrent Queries for This Project and Region

Issue

Connectors running on a BigQuery destination fail with either of the following errors:

• Exceeded rate limits: too many concurrent queries for this project_and_region. For more information, see https://cloud.google.com/bigquery/troubleshooting-errors</a>

• Quota exceeded: Your project_and_region exceeded quota for max number of jobs that can be queued per project

Environment

BigQuery destination

Resolution

This error appears as a result of an API quota limitation from BigQuery. Contact Google support to increase the API quota.

You may also want to consider increasing the sync frequency of less important connectors to reduce failures. Having all the connectors run at the same frequency may exhaust the API quota.

Cause

• Google allows 300 concurrent API requests per user.
• More connectors with high sync frequency may exhaust the API quota.