Edit on GitHub
Exceeded Rate Limits: Too Many Concurrent Queries for This Project and Regionlink
Issuelink
Connectors running on a BigQuery destination fail with the following error:
java.lang.RuntimeException:
Exceeded rate limits:
too many concurrent queries for this project_and_region.
For more information, see <a class="c-link" href="https://cloud.google.com/bigquery/troubleshooting-errors" target="_blank" rel="noopener noreferrer" data-stringify-link="https://cloud.google.com/bigquery/troubleshooting-errors" data-sk="tooltip_parent">https://cloud.google.com/bigquery/troubleshooting-errors</a>
Environmentlink
Resolutionlink
This error appears as a result of an API quota limitation from BigQuery. Contact Google support to increase the API quota.
You may also want to consider increasing the sync frequency of non-important connectors to reduce failures. Having all the connectors run at the same frequency may exhaust the API quota.
Causelink
- Google allows 300 concurrent API requests per user.
- More connectors with high sync frequency may exhaust the API quota.