Why Does My Connector Skip Some CSV Files for Ingestion?

Question

Why does my connector skip data (records or entire CSV files) when ingesting, even if the data is correctly formatted?

Environment

File connectors

Answer

If you have checked that your connector is formatted correctly, you must verify that you are specifying the delimiter used in your CSV files.

In the connector setup form's Delimiter field, make sure to specify the delimiter, instead of choosing infer.

Cause

When inferring delimiters, Fivetran can have a false positive if your file uses other characters that are also commonly used as delimiters, such as ;, ,, or |.