Local File System Private Preview
The Local File System connector enables you to sync files from file systems in your local environment to your destination. It reads files directly from locations that are accessible to the Hybrid Deployment Agent.
Features
| Feature Name | Supported | Notes |
|---|---|---|
| Capture deletes | ||
| History mode | ||
| Custom data | ||
| Data blocking | ||
| Column hashing | ||
| Re-sync | ||
| Row filtering | ||
| API configurable | API configuration | |
| Priority-first sync | ||
| Fivetran data models | ||
| Private networking | ||
| Authorization via API |
Setup guide
Follow our step-by-step Local File System connector setup guide to sync files accessible to the Hybrid Deployment Agent with your destination using Fivetran connectors.
Sync overview
The Local File System connector syncs multiple files into multiple destination tables from a file system accessible on your Hybrid Deployment agent. Fivetran supports the following methods for configuring file-to-table mappings:
- Define per table — Maps files to destination tables by matching file name patterns using regular expressions.
- Dynamically extract tables — Extracts destination table names directly from file paths using a regular expression with a named capture group.
Fivetran detects new and modified files using the last modified timestamp of each file. Once the initial sync is completed, we re-process only files modified after the last sync.
Define per table
It allows you to define one or more destination tables and associate each table with a file name pattern. We sync only the files that match a configured pattern and exclude those that do not match a pattern.
Dynamically extract tables
It allows you to specify a regular expression with a named capture group (?<table>...) to extract table names from file paths. If we find any new table names after the initial sync, we automatically add them to your destination, subject to your Schema change settings.
Schema information
Define per table
The Table name you specify when mapping a file pattern determines the destination table name.
Dynamically extract tables
We extract the destination table name from the file path using the table extraction pattern you configured. We follow Fivetran's naming conventions to convert the extracted names.