Email files to your destination with the Email Connector.
Features
| Feature Name | Supported | Notes |
|---|---|---|
| Capture deletes | ||
| History mode | ||
| Custom data | check | |
| Data blocking | check | |
| Column hashing | check | |
| Re-sync | check | |
| API configurable | check | API configuration |
| Priority-first sync | ||
| Fivetran data models | ||
| Private networking | ||
| Authorization via API | check |
Setup guide
Follow our step-by-step Email connector setup guide set up a Fivetran Email connector to send files to your destination.
Schema information
Upsert with custom primary keys Beta
For upserting with primary keys, use the Primary Key used for file process and load field.
You can select the custom primary keys during the connector setup and use them to update or insert new rows to the destination. We process the files in order of their modified time.
If we detect that one of the selected primary keys has a null value in your files, we display a warning on the connector dashboard but insert the record with a null value in your destination.
If the destination does not support null values, we insert the row with the default value for the column.
You can choose the primary keys only before the initial sync. Once you perform the initial sync, you won't be able to modify the primary keys.
NOTE: You can modify the primary keys only if your initial sync fails. If your initial sync is successful, the option to modify the primary keys is not available.
Types of primary keys
The file connectors use the following types of primary keys:
- Primary key - a column that contains values that uniquely identify each row in your data.
- Composite primary key - a set of columns which, in combination, uniquely identifies a row in your data.
- Surrogate primary key - a column or columns that the system adds to provide a unique identifier for a row in your data.
(Applicable for append_file option) Primary keys
Fivetran adds the following columns as composite primary keys for a table:
| COLUMN | DATA TYPE | NOTES |
|---|---|---|
| _file 🔑 | TEXT | The file name received through the email |
| _line 🔑 | INT | The line number in the file that was read |
| _modified 🔑 | TIMESTAMP | The timestamp when we received an email containing files |
| _directory 🔑 | TEXT | The folder path where the file is stored in internal S3 bucket. It follows the pattern groupId/schema/table/attachment/folder_created_to_store_file |
Sync overview
The Email Connector is designed for scheduled email reports. It extracts one or more attachments from the email, parses the attachment data, and uploads it into your destination. Emails are deleted once attachments are extracted from them. Attachments are permanently backed up in an internal S3 bucket in case of a re-sync. You may delete these attachments by deleting the email connector, contacting privacy@fivetran.com, or by reaching out to our customer support team.