When Should I Increase Bulk API Quota?

Use Case

You are setting up the Marketo connector and want to ensure you have enough Marketo API resources available to ensure a timely historical sync and successful incremental syncs.

Environment

Marketo connectors created after November 2019

Recommendation

We recommend you purchasing a sufficient Bulk API quota from Marketo to allow our connector to sync successfully in a reasonable time. The majority of data from Marketo is generated from fetching activity data, so we use the Bulk API to extract all activity data as efficiently as possible.

When your connector exceeds your Marketo Bulk API quota, we automatically reschedule the connector's sync to wait for the quota to be reset that night. When we find the connector exceeds the API quota often, we generate the Increase Bulk API limit Task.

See our Marketo Sync Overview documentation for more details.

Marketo customers have a default Bulk API quota of 500MB per day. Marketo allows customers to purchase a higher daily extract limit by choosing one of the following options:

• Bulk Extract Additional 1 GB

• Bulk Extract Additional 3 GB

• Bulk Extract Additional 5 GB

• Bulk Extract Additional 10 GB

See Marketo's Bulk API and REST API Limits or reach out to your Marketo Customer Success Manager for more details.

Considerations

Fivetran rarely runs into REST API quota limits, so we do not suggest increasing this unless you are receiving Fivetran errors explicitly about the REST API quota. For more information on this, see Marketo's REST API documentation.

We obtain the REST API daily usage details using a GET request to the Usage endpoint: /rest/v1/stats/usage.json.

Marketo does not support any API endpoints that return the Bulk API daily usage. We need to calculate the usage by adding the file sizes of the completed jobs.