Amazon S3

Amazon Simple Storage Service (Amazon S3), provides scalable cloud storage services. Fivetran supports syncing files from your S3 bucket to your destination.

Features

Supported deployment models

We support the SaaS and Hybrid deployment models for the connector.

NOTE: You must have an Enterprise or Business Critical plan to use the Hybrid Deployment model.

Setup guide

Follow our step-by-step Amazon S3 setup guide to connect Amazon S3 with your destination using Fivetran connectors.

Sync overview

Syncing spreadsheets

To sync Excel files only, you must select xls/xlsx/xlsm as the file type in the connector setup form and specify the cell reference during connector configuration. We use the cell reference to sync contiguous data to the right of the cell and below it in the Excel worksheet.

Example:

Let's assume there are 4 excel worksheets in a workbook:

• Data1
• Data2
• Data3
• Data4

You want to sync your data from cell C3 of the "Data2" worksheet, then your cell reference will be "Data2”!C3. So, the connector syncs data from the "Data2" worksheet starting at cell C3.

NOTE: We do not support finding data ranges if the rows contain merged cells. We do not consider the rows with merged cells and skip them while finding data ranges.

Sync notes

We will search a small subset of your bucket, and, if no matches are found, will expand its search to the entire bucket. This can take up to several minutes.

We do not sync data from S3 replication (destination) buckets.

Syncing empty columns

The Amazon S3 connector doesn't support the creation of empty columns in your destination.

We create a column in the destination table only if the column in your source file is not empty.

Configuration options

Fivetran offers a number of configuration options in our setup form. Using these configuration options, you can select subsets of your folders, certain types of files, and more to sync only the files you need in your destination. Setting up multiple S3 connectors targeted at the same bucket, but with different options, can allow you to slice and dice a bucket any way you'd like. For more on configuration options, see our setup guide.

You can use a custom external_id parameter for authentication when creating a new Amazon S3 connector with the Fivetran REST API. We use the connector's group_id if you don't specify the external_id parameter value. Use the List All Groups endpoint to find the connector's group_id.

NOTE: We don't support custom external_id values for connectors created in the Fivetran dashboard. By default, we use the connector's group_id.