PostgreSQL as Target
Fivetran HVR supports integrating changes into PostgreSQL, including managed PostgreSQL services. This section describes the configuration requirements for integrating changes (using Integrate and Refresh) into PostgreSQL location. For the list of supported PostgreSQL versions, into which HVR can integrate changes, see Integrate changes into location in Capabilities.
HVR uses the following interfaces to write data to PostgreSQL during Integrate and Refresh:
PostgreSQL native client library "libpq" is used during Continuous Integrate and Row-wise Refresh.
PostgreSQL
COPY FROM STDIN
command via "libpq" is used for Burst Integrate and Bulk Refresh.
Table and Column Names Forced Case
Since v6.1.0/34
This option allows you to manage the case sensitivity of object names created in the target PostgreSQL tables. This applies to Activating Replication, Refresh, and Compare.
Available options are:
- No
default
: Create table and column names in the same case as received from the source, which can be either lowercase or uppercase. - Upper: Create table and column names in uppercase.
- Lower: Create table and column names in lowercase.
This option is equivalent to the location property ForceCase.
Grants for Integrate and Refresh
This section lists the grants required for integrating changes into PostgreSQL location.
The HVR database User must be granted the following privileges to read and change the replicated tables:
GRANT SELECT, INSERT, UPDATE, DELETE ON tablename TO username;
The HVR database User must be granted the permission to create and drop HVR state tables.
Intermediate Directory
This option in the HVR UI allows you to specify a directory path for storing intermediate (temporary) files generated during Compare. These files are created during both "direct file compare" and "online compare" operations.
Using an intermediate directory can enhance performance by ensuring that temporary files are stored in a location optimized for the system's data processing needs.
This setting is particularly relevant for target file locations, as it determines where the intermediate files are placed during the Compare operation. If this option is not enabled, the intermediate files are stored by default in the integratedir/_hvr_intermediate directory, where integratedir is the replication DIRECTORY (File_Path) defined for the target file location.
This option is equivalent to the location property Intermediate_Directory.
Intermediate Directory is Local
This option in HVR UI specifies that the Intermediate Directory will be created on the local drive of the file location's server.
This setting is crucial for optimizing performance, as it reduces network latency and avoids potential permission issues associated with remote storage. By storing intermediate files locally, HVR can process data more efficiently, taking advantage of the speed and reliability of local storage.
This option is particularly beneficial when the HVR Agent has access to ample local storage, enabling it to handle large data volumes without relying on networked storage solutions.
This option is equivalent to the location property Intermediate_Directory_Is_Local.