Error: Increase Oplog Retention Period

Issue

The following error appears on the Fivetran dashboard:

Increase Oplog Retention Period

Environment

Connector: MongoDB

Resolution

To resolve this issue, adjust your oplog size to support the required volume of data sufficiently. We recommend increasing the size to retain seven days' worth of data. See step 4 of our MongoDB setup guide for more information.

If the issue persists, you can limit the volume of data processed during each sync by increasing the connector's sync frequency. See our sync frequency documentation for more information. To adjust an existing connector's sync frequency, do the following:

1. In Fivetran, go to your MongoDB connector page.
2. Select the Setup tab.
3. Update the value in the Sync Frequency drop-down menu.

Cause

This issue occurs when the oplog and stream cursors expire between two syncs. This may happen because the oplog size isn't sufficient to support the required volume of data.