Pricing for HVR
Learn how Fivetran's pricing works with Fivetran HVR, how usage data is stored and sent to Fivetran, and how you can integrate HVR with Fivetran.
Fivetran's pricing model is supported for HVR since version 6.1.0/3. We calculate your usage based on the number of monthly active rows (MAR) across all connectors (sources) and destinations (targets) in your account. Once you register your hub system with a Fivetran account, HVR securely sends back metadata to Fivetran regarding your usage.
Fivetran calculates MAR for your HVR Hub System(s) based on this metadata. You can register multiple hub systems to your Fivetran account. If you are syncing data from one source to multiple destinations, we count MAR for each destination.
We calculate MAR the same way across all cloud and on-premise connectors. You can share a single budget for both Fivetran and HVR.
Understand HVR data storage
HVR uses a special data structure called HyperLogLog (HLL) to track MAR. These data structures are stored on disk, in the hub system, in hour granularity buckets, per table. HVR uses a hash value from the primary keys to update the data structure.
Each data structure is around 2 KB. HVR stores an hour of data per table in a single 2 KB data structure. So for each active table, 24 data structures is stored every day. Each active table needs 48 KB of disk space per day. We recommend a week of storage allocation on the hub system to store the data that it uses to track MAR. HVR stores these data structures for a maximum of 1 month.
The original primary keys can't be retrieved from the HLL data structure. In addition, HVR doesn't store the primary keys directly but uses their hashes to update this structure. The hashes are irreversible and can’t be retrieved.
Understand HVR usage data
HVR establishes a connection with Fivetran servers and transfers the MAR usage data over the network hourly. HVR sends two data files to Fivetran:
- MAR data
- HVR hub snapshot
MAR data
The MAR data that HVR sends to Fivetran comprises the following:
- Hub name, hub ID, description, and hub server URL
- Channel name
- Location names, description, and type
- Table names and base names
- Refresh events, including the timestamps and metadata
- HLL records for Integrate and Refresh jobs
The MAR and usage data that HVR sends to Fivetran is stored on AWS S3, encrypted at rest. The data does not contain any personally identifiable information of the user. HVR uploads this file hourly, and Fivetran sends back a 7-day license key daily as part of this data exchange. HVR purges the MAR data after 24 hours.
To view the MAR data sent from HVR to Fivetran:
- Execute the following command in the HVR CLI:
hvrlicense -m <filename>
. - Use a text editor to open the file and view the data.
HVR automatically uploads hourly files. To view the hourly data:
- Execute the following command in the HVR CLI:
hvrlicense -m<filename> -B now-1h
. - Use a text editor to open the file and view the data.
Connectors
HVR connectors are defined by a unique combination of the following:
- Registration id
- Hub ID
- Source location name
- Target location name
- Channel name
Fivetran offers a 14-day free trial for new HVR connectors. We start a free trial for every HVR connector with the same hub id, source location name, and target location name.
Troubleshooting window
Fivetran offers a troubleshooting window for free table refreshes. The troubleshooting window lasts five days, beginning on the day that you first refresh a table in a given month. All subsequent refreshes outside of this troubleshooting window count towards paid MAR.
Snapshot
On receiving a request from the Fivetran server, HVR uploads a usage snapshot per hub every 30 days. The snapshot contains the following details:
- a week of events
- a week of statistics
- channel definitions
- job state
NOTE: The snapshot doesn’t contain log files, history, or transaction files.
To save the snapshot data into a zip file, execute the following command in the HVR CLI:
hvrsnapshotsave -r "metering-usage-snapshot account_id={account_id}" -e now-1w -l none -s now-1w -t none -V redact {hub} {filename}.zip
Integrate HVR with Fivetran
Follow these instructions to integrate your HVR Hub System with Fivetran so that you can use Fivetran's pricing.
Prerequisites
To integrate each of your HVR Hub System with Fivetran, you must:
Enable outbound access from the HVR Hub System running the HVR Hub Server to the following IP addresses (on port
443
):34.110.137.135
34.120.211.189
Enable outbound access from the web browser that you will use to manage HVR to
35.236.237.87
.Register your HVR Hub System. You must create a Fivetran account or log in to Fivetran.com with an Account Administrator role.
NOTE: You must register each hub system individually.
Configure Pricing for HVR
The configuration process is different for existing and new HVR users.
Existing HVR users
To start using Fivetran's pricing on your HVR Hub System, do the following:
Log in to the HVR web UI.
On the left navigation pane, click System.
Click the ellipsis button and select Licensing.
Click Register with Fivetran account.
On the Fivetran account setup form, enter your details and click Sign up.
NOTE: If you already have a Fivetran account, click Sign in here.
Once you log in to your Fivetran account, click Continue to HVR.
The registration process is complete, and you are redirected to the HVR UI.
NOTE: Once you complete the registration, the HVR Licensing section displays the new Fivetran account with a VALID status. To view the HVR registration logs, click Registration ID.
New HVR users
If you are a new HVR user or a Fivetran user on the Business Critical plan, do the following:
Download HVR from the Fivetran dashboard, go to Account Settings > Downloads, then scroll down to the Fivetran (HVR) Downloads section and click on the required version to begin downloading the installation file.
To get started with HVR and learn more about installation and configuration, see Getting Started documentation.
Manage Fivetran license
Licenses are provided through the registration process, or a license key is provided directly through email. Manage your license from the Licensing page of your HVR deployment. You can delete the license or remove the Fivetran registration.
The Fivetran registration process provides you access to HVR in the form of a refreshing license key. If you are actively using HVR on our consumption model and if you remove your Fivetran registration before the contract ends, you won't have access to HVR after 7 days. Your access to HVR will end at the end of your subscription term.
For more information about licenses, see Licensing.