Staging for SAP HANA
While running Burst Integrate and Bulk Refresh, Fivetran HVR can put data into a temporary directory (‘staging file') before loading data into a target database.
For best performance, HVR performs Burst Integrate and Bulk Refresh into SAP HANA using staging files. HVR implements the file staging in SAP HANA as follows:
- HVR first writes data into the local staging directory on the machine from where HVR connects to SAP HANA.
- HVR then uses the SAP HANA SQL command
import
to ingest the data into the SAP HANA target tables from the staging directory.
Configuring Staging
HVR must be configured to stage data on the local directory before loading it into SAP HANA. For staging the data on local directory and perform Burst Integrate and Bulk Refresh into SAP HANA, the following are required:
Define the following location properties (while creating a location or by editing the existing location's source and target properties) for the SAP HANA location:
The Location Property equivalent to the UI field is shown inside (bracket) below.
Staging Directory Is Local (Staging_Directory_Is_Local): Indicates that staging files are created in the local directory. This field is automatically selected by default and it cannot be unselected.
STAGING DIRECTORY (Staging_Directory): local directory path where HVR will create the temporary staging files (e.g. /my_staging_dir).
STAGING DIRECTORY AS VISIBLE FROM THE DATABASE (Staging_Directory_Database): directory path from where SAP HANA will access the temporary staging files (e.g. /my_staging_dir). This path must be configured in SAP HANA for importing data,
alter system alter configuration ('indexserver.ini', 'system') set ('import_export', 'csv_import_path_filter') = 'Staging_Path' with reconfigure
Sample screenshot