Databricks API Configuration
Request
POST https://api.fivetran.com/v1/destinations
{ "group_id": "group_id", "service": "databricks", "region": "GCP_US_WEST1", "time_zone_offset": "+3", "trust_certificates": true, "trust_fingerprints": true, "run_setup_tests": true, "daylight_saving_time_enabled": true, "hybrid_deployment_agent_id": "hybrid_deployment_agent_id", "private_link_id": "private_link_id", "networking_method": "Directly", "proxy_agent_id": "proxy_agent_id", "config": { "create_external_tables": true, "auth_type": "PERSONAL_ACCESS_TOKEN | OAUTH2", "connection_type": "Directly | PrivateLink", "storage_account_name": "string", "catalog": "string", "aws_secret_access_key": "string", "http_path": "sql/protocolv1/o/2873663545782684434-15262-272625-fives565", "cloud_provider": "AZURE | GCP | AWS", "storage_account_key": "string", "oauth2_secret": "your_oauth_secret", "s3_bucket_auth_type": "IAM_ROLE | IAM_USER", "server_host_name": "87a8z-3da23-3da8d-cloud.databricks.com", "bucket": "string", "external_storage_cloud_provider": "AZURE | GCP | AWS", "aws_access_key_id": "string", "bucket_region": "string", "port": 443, "disable_vacuum": true, "create_external_volumes": true, "azure_storage_account_auth_type": "Storage Account Key", "oauth2_client_id": "your_oauth_client_id", "external_volume_location": "s3://bucket/prefix_path", "external_location": "/some_external_location", "personal_access_token": "your_databricks_personal_access_token" } }
Config parameters
| Name | Description |
|---|---|
create_external_tables | Whether to create external tables |
auth_type | Authentication type |
connection_type | |
storage_account_name | Your storage account name |
catalog | Catalog name |
aws_secret_access_key | Your user's secret access key |
http_path | HTTP path |
cloud_provider | Databricks deployment cloud |
storage_account_key | Your storage account key |
oauth2_secret | OAuth 2.0 secret |
s3_bucket_auth_type | Authentication method for the S3 bucket you want to use as the external staging for Hybrid Deployment. |
server_host_name | Server name |
bucket | Your bucket |
external_storage_cloud_provider | |
aws_access_key_id | Your user's access key ID |
bucket_region | Your bucket's region |
port | Server port number |
disable_vacuum | Specifies whether you want Fivetran to disable Vacuum operations on Delta tables. |
create_external_volumes | Specifies whether you want Fivetran to create external volumes for unstructured data files. |
azure_storage_account_auth_type | Authentication method for the Azure container you want to use as the external staging for Hybrid Deployment. |
oauth2_client_id | OAuth 2.0 client ID |
external_volume_location | Specifies the external volume path where you want Fivetran to create the unstructured files. |
external_location | External location to store Delta tables. Default value: "" (null). By default, the external tables will reside in the /{schema}/{table} path, and if you specify an external location in the {externalLocation}/{schema}/{table} path. |
personal_access_token | Personal access token |