How Can I Recover Data and Resume Syncing After Losing Access to a BigQuery Destination?
Question
If my BigQuery destination becomes inaccessible, how can I recover my SAP ERP on HANA data and resume syncing in a new BigQuery project? Can I use BigQuery backups during recovery?
Environment
- Connector: SAP ERP on HANA
- Destination: Google Cloud BigQuery
- Connection method: Netweaver
Answer
To resume syncing, create a new BigQuery destination, recreate the required connections, and trigger historical syncs to rebuild the destination data.
The data recovered depends on the sync mode:
- Live mode: The historical sync rebuilds the current state of your source data.
- Soft delete mode: The historical sync restores active records and begins tracking future deletions. To recover previously deleted records, you must restore them separately from a backup.
- History mode: The historical sync begins rebuilding the source data history but doesn't restore SCD Type 2 history from before the sync.
You can restore BigQuery snapshots or Google Cloud Storage exports in the new environment. However, Fivetran can't use these backups to resume syncing from previous checkpoints. You must run a historical sync for each recreated connection.