S3-Compatible Storage Private Preview
A storage system is considered S3-compatible if it supports the standard Amazon S3 REST API. Fivetran supports syncing files from your S3-Compatible Storage bucket to your destination.
To sync files from Amazon S3, see our Amazon S3 connector documentation.
We have tested the following services with S3-Compatible Storage connector:
- Cloudflare R2
- MinIO
- Oracle Cloud Infrastructure Object Storage
- Stackit Object Storage
- Wasabi Cloud Storage
Features
| Feature Name | Supported | Notes |
|---|---|---|
| Capture deletes | ||
| History mode | ||
| Custom data | check | |
| Data blocking | check | |
| Column hashing | check | |
| Re-sync | check | |
| API configurable | check | API configuration |
| Priority-first sync | ||
| Fivetran data models | ||
| Private networking | ||
| Authorization via API | check |
Supported deployment models
We support the SaaS and Hybrid deployment models for the connector.
You must have an Enterprise or Business Critical plan to use the Hybrid Deployment model.
Setup guide
Follow our step-by-step setup guide to connect S3-Compatible Storage with your destination using Fivetran connectors:
Sync overview
Syncing spreadsheets
To sync Excel files, you must select xls/xlsx/xlsm as the file type in the connection setup form and specify the cell reference during connection configuration. We use the cell reference to sync contiguous data to the right of the cell and below it in the Excel worksheet.
Example:
Let's assume there are 4 excel worksheets in a workbook:
- Data1
- Data2
- Data3
- Data4
You want to sync your data from cell C3 of the "Data2" worksheet, then your cell reference will be "Data2”!C3. So, the connection syncs data from the "Data2" worksheet starting at cell C3.
We do not support finding data ranges if the rows contain merged cells. We do not consider the rows with merged cells and skip them while finding data ranges.
Sync notes
We will search a small subset of your bucket, and, if no matches are found, will expand its search to the entire bucket. This can take up to several minutes.
Syncing empty columns
The S3-Compatible Storage connector doesn't support the creation of empty columns in your destination.
We create a column in the destination table only if the column in your source file is not empty.
Configuration options
Fivetran offers a number of configuration options in our setup form. Using these configuration options, you can select subsets of your folders, certain types of files, and more to sync only the files you need in your destination. Setting up multiple S3-Compatible Storage connectors targeted at the same bucket, but with different options, can allow you to slice and dice a bucket any way you'd like. For more on configuration options, see our setup guide.