MongoDB MAR Management
Connector sync strategy and options
- Fivetran replicates MongoDB data using the system-generated
_idprimary key field and change streams. - We replicate the selected collections to your destination during the initial sync. This initial historical sync doesn't contribute to MAR and is free for new connections.
- If you add collections later, their initial historical sync doesn't contribute to MAR.
What contributes towards MAR?
There are 5 primary actions that will contribute to MAR:
- A new document is added to an existing collection.
- A document is removed from an existing collection.
- A field is updated in an existing document.
- A field is removed in an existing document.
- A field is added to an existing document.
Managing MAR for your MongoDB connection
- Initial syncs do not contribute to your Monthly Active Row count.
- Historical re-syncs and incremental syncs do contribute to MAR. A full re-sync completely overwrites the data in your destination with new data from your source.
- Historical re-syncs can be triggered by BOTH the customer or Fivetran under explicit guidance from the customer.
- Monitoring data integrity issues and performing re-syncs to fix them when needed is part of the Fivetran managed service. We only perform, or ask you to perform, re-syncs when it’s absolutely necessary.
- If a collection was imported initially, then unchecked and left for a period of time that exceeds the change stream retention window, the collection will need to be re-synced. This re-sync will generate MAR.
- Ensure that your Oplog retention period/size is set appropriately to support the change stream retention window in the event of a service outage or transient network connectivity error. We will need to initiate a re-sync, which will increase MAR, if the connection fails to connect to your instance for a period longer than the change stream retention window, or if the Oplog has been rolled over and the resume point has been lost.
- We recommend that you do not pause your MongoDB connection for a period longer than the change stream retention window. Doing so may require a re-sync, which will increase MAR.