Azure Blob Storage API Configuration

Request

POST https://api.fivetran.com/v1/connections

{
  "group_id": "group_id",
  "service": "azure_blob_storage",
  "trust_certificates": true,
  "trust_fingerprints": true,
  "run_setup_tests": true,
  "paused": false,
  "pause_after_trial": false,
  "sync_frequency": 1440,
  "data_delay_sensitivity": "NORMAL",
  "data_delay_threshold": 0,
  "daily_sync_time": "14:00",
  "schedule_type": "auto",
  "connect_card_config": {
    "redirect_uri": "https://your.site/path",
    "hide_setup_guide": true
  },
  "proxy_agent_id": "proxy_agent_id",
  "private_link_id": "private_link_id",
  "networking_method": "Directly",
  "hybrid_deployment_agent_id": "hybrid_deployment_agent_id",
  "destination_configuration": {
    "virtual_warehouse": "virtual_warehouse"
  },
  "destination_schema_names": "SOURCE_NAMING",
  "config": {
    "quote_character_enabled": true,
    "prefix": "folder_path",
    "pattern": "file_pattern",
    "json_delivery_mode": "Packed | Unpacked",
    "skip_after": 0,
    "connection_string": "BlobEndpoint=https://abc123.blob.core.windows.net/;TableEndpoint=https://abc123.table.core.windows.net/;SharedAccessSignature=xxxxxxxxx",
    "quote_char": "string",
    "empty_header": true,
    "use_pgp_encryption_options": true,
    "skip_before": 0,
    "signer_public_key": "",
    "delimiter": "string",
    "file_type": "tsv | xml | csv | spreadsheet | json | jsonl | avro | parquet",
    "file_mapping_method": "DEFINE_PER_TABLE",
    "on_error": "fail | skip",
    "extraction_pattern": "(?\\w+)/.*",
    "archive_pattern": "regex_pattern",
    "pgp_secret_key": "",
    "host_ip": "192.168.0.2",
    "append_file_option": "upsert_file_with_primary_keys | upsert_file | append_file",
    "storage_account_name": "storage_account_name",
    "selected_range": "'Sheet1'!A1",
    "escape_char": "string",
    "container_address": "192.168.0.1",
    "connection_method": "SSH_TUNNEL | DIRECT | PRIVATE_LINK",
    "line_separator": ";",
    "auth_method": "CONNECTION_STRING | SERVICE_PRINCIPAL_SECRET",
    "null_sequence": "string",
    "container_name": "container_name",
    "files": [
      {
        "file_pattern": "string",
        "table_name": "string",
        "archive_pattern": "string"
      }
    ],
    "compression": "zip | gz | tar_gz | tar | infer | gzip | uncompressed | bz2 | tar_bz2",
    "host_user": "host_username",
    "pgp_pass_phrase": "",
    "schema": "schema_name",
    "table_group_name": "string"
  },
  "auth": {
    "tenant_id": "41db1ebd-41a6-4dda-8029-5dd8f227d843",
    "client_secret": "my_client_secret",
    "client_id": "my_client_id"
  }
}
Config parameters
Name Description
quote_character_enabled If you don’t want to use an enclosing character while processing the files, set the value to false. By default, the value is set to true and is considered " as a quote character.
prefix All files and folders under this folder path will be searched for files to sync.
pattern All files in your search path matching this regular expression will be synced.
json_delivery_mode Control how your JSON data is delivered into your destination
skip_after We will skip over the number of lines specified at the end so as to not introduce aberrant data into your destination.
connection_string The blob storage container connection string.
quote_char You can specify the enclosing character used in your CSVs here. Fivetran will consider " as the quote character if this field is empty and quote_character_enabled is set to true.
empty_header Optional. If your CSV generating software doesn't provide header line for the documents, Fivetran can generate the generic column names and sync data rows with them.
use_pgp_encryption_options Set to true if files present in the Azure Blob Storage container are encrypted using PGP. Default value: false.
skip_before We will skip over the number of lines specified before syncing data.
signer_public_key The contents of the signer's public key file. Must be populated if use_pgp_encryption_options is set to true and PGP encrypted files are signed.
delimiter You can specify your the delimiter that your CSVs use here. Fivetran generally tries to infer the delimiter, but in some cases this is impossible.
file_type If your files are saved with improper extensions, you can force them to by synced as the selected file type.
file_mapping_method The method used to map files to destination tables. Use DEFINE_PER_TABLE to manually configure each table with its own file pattern, or EXTRACT_TABLES to automatically discover tables based on a single extraction pattern.
on_error If you know that your files contain some errors, you can choose to have poorly formatted lines skipped. We recommend leaving the value as fail unless you are certain that you have undesirable, malformed data.
extraction_pattern A regular expression with a named capture group (?<table>...) to extract table names from file paths.
archive_pattern Files inside of compressed archives with filenames matching this regular expression will be synced.
pgp_secret_key The contents of your PGP secret key file. Must be populated if use_pgp_encryption_options is set to true.
host_ip IP address of host tunnel machine which is used to connect to the Storage container.
append_file_option If you know that the source completely over-writes the same file with new data, you can append the changes instead of upserting based on filename and line number.
storage_account_name The name of the Azure Storage account.
selected_range Cell reference that will be used to sync all contiguous data starting from the top-left cell in all the spreadsheets matching the name. Cell reference is in the '<sheetName>'!<startColumnName><startRowName> format.
escape_char If your CSV generator follows non-standard rules for escaping quotation marks, you can set the escape character here.
container_address IP address of the Azure Storage Container which is accessible from host machine.
connection_method Connection Method. Possible values:  DIRECT: Fivetran will connect directly to your storage container, SSH_TUNNEL: Fivetran will connect to your storage container using a host machine (commonly used for VPN connections), PRIVATE_LINK: Fivetran will connect to your storage container using PrivateLink.
line_separator You can specify the custom line separator for your CSV files. The line separator is used in files to separate one row from the next.
auth_method Authentication Method
null_sequence If your CSVs use a special value indicating null, you can specify it here.
container_name The name of the blob container.
files Mapped file name patterns to a destination table.
files[0].file_pattern All files in your search path matching this regular expression will be synced per table. We have discontinued this field, and will delete it by August 31, 2025.
files[0].table_name All files matching the above pattern will be synced to this table.
files[0].archive_pattern All Files inside of compressed archives with filenames matching this regular expression will be synced.
compression The secrets that should be passed to the function at runtime.
host_user Username in the host machine.
pgp_pass_phrase The PGP passphrase used to create the key. Must be populated if use_pgp_encryption_options is set to true.
schema (required) Destination schema name. Schema name is permanent and cannot be changed after connection creation
table_group_name (required) Combined with the schema to form the Fivetran connection name <schema>.<table_group_name>. Lets you create multiple Merge Mode connections per schema.

Name	Description
`quote_character_enabled`	If you don’t want to use an enclosing character while processing the files, set the value to false. By default, the value is set to true and is considered " as a quote character.
`prefix`	All files and folders under this folder path will be searched for files to sync.
`pattern`	All files in your search path matching this regular expression will be synced.
`json_delivery_mode`	Control how your JSON data is delivered into your destination
`skip_after`	We will skip over the number of lines specified at the end so as to not introduce aberrant data into your destination.
`connection_string`	The blob storage container connection string.
`quote_char`	You can specify the enclosing character used in your CSVs here. Fivetran will consider " as the quote character if this field is empty and quote_character_enabled is set to true.
`empty_header`	Optional. If your CSV generating software doesn't provide header line for the documents, Fivetran can generate the generic column names and sync data rows with them.
`use_pgp_encryption_options`	Set to `true` if files present in the Azure Blob Storage container are encrypted using PGP. Default value: `false`.
`skip_before`	We will skip over the number of lines specified before syncing data.
`signer_public_key`	The contents of the signer's public key file. Must be populated if `use_pgp_encryption_options` is set to `true` and PGP encrypted files are signed.
`delimiter`	You can specify your the delimiter that your CSVs use here. Fivetran generally tries to infer the delimiter, but in some cases this is impossible.
`file_type`	If your files are saved with improper extensions, you can force them to by synced as the selected file type.
`file_mapping_method`	The method used to map files to destination tables. Use `DEFINE_PER_TABLE` to manually configure each table with its own file pattern, or `EXTRACT_TABLES` to automatically discover tables based on a single extraction pattern.
`on_error`	If you know that your files contain some errors, you can choose to have poorly formatted lines skipped. We recommend leaving the value as fail unless you are certain that you have undesirable, malformed data.
`extraction_pattern`	A regular expression with a named capture group `(?<table>...)` to extract table names from file paths.
`archive_pattern`	Files inside of compressed archives with filenames matching this regular expression will be synced.
`pgp_secret_key`	The contents of your PGP secret key file. Must be populated if `use_pgp_encryption_options` is set to `true`.
`host_ip`	IP address of host tunnel machine which is used to connect to the Storage container.
`append_file_option`	If you know that the source completely over-writes the same file with new data, you can append the changes instead of upserting based on filename and line number.
`storage_account_name`	The name of the Azure Storage account.
`selected_range`	Cell reference that will be used to sync all contiguous data starting from the top-left cell in all the spreadsheets matching the name. Cell reference is in the `'<sheetName>'!<startColumnName><startRowName>` format.
`escape_char`	If your CSV generator follows non-standard rules for escaping quotation marks, you can set the escape character here.
`container_address`	IP address of the Azure Storage Container which is accessible from host machine.
`connection_method`	Connection Method. Possible values: `DIRECT`: Fivetran will connect directly to your storage container, `SSH_TUNNEL`: Fivetran will connect to your storage container using a host machine (commonly used for VPN connections), `PRIVATE_LINK`: Fivetran will connect to your storage container using PrivateLink.
`line_separator`	You can specify the custom line separator for your CSV files. The line separator is used in files to separate one row from the next.
`auth_method`	Authentication Method
`null_sequence`	If your CSVs use a special value indicating null, you can specify it here.
`container_name`	The name of the blob container.
`files`	Mapped file name patterns to a destination table.
`files[0].file_pattern`	All files in your search path matching this regular expression will be synced per table. We have discontinued this field, and will delete it by August 31, 2025.
`files[0].table_name`	All files matching the above pattern will be synced to this table.
`files[0].archive_pattern`	All Files inside of compressed archives with filenames matching this regular expression will be synced.
`compression`	The secrets that should be passed to the function at runtime.
`host_user`	Username in the host machine.
`pgp_pass_phrase`	The PGP passphrase used to create the key. Must be populated if `use_pgp_encryption_options` is set to `true`.
`schema` (required)	Destination schema name. Schema name is permanent and cannot be changed after connection creation
`table_group_name` (required)	Combined with the schema to form the Fivetran connection name `<schema>.<table_group_name>`. Lets you create multiple Merge Mode connections per schema.

`Authorization`

There are two ways to authorize this connector type:

 By specifying the values for the container_name and connection_string parameters in the request.POST https://api.fivetran.com/v1/connections
{
  "service": "azure_blob_storage",
  "group_id": "group_id",
  "config": {
    "container_name": "container_name",
    "connection_string": "BlobEndpoint=https://abc123.blob.core.windows.net/;TableEndpoint=https://abc123.table.core.windows.net/;SharedAccessSignature=xxxxxxxxx"
  }
}

By using the Connect Card or the Fivetran dashboard.