Why Are Some Columns Missing When Syncing Veeva Vault Data to Snowflake?
Question
Why are some columns missing from my Snowflake destination when I sync my Veeva Vault data through Fivetran?
Environment
- Connector: Veeva Vault
- Destination: Snowflake
Answer
Fivetran creates columns in Snowflake based on the field metadata and data type returned by the Veeva Vault metadata API. When the API returns a supported data type, such as STRING, DATE, DATETIME, BOOLEAN, PICKLIST, or NUMBER, we create the column even if all values are null.
However, if we can't determine a field's type, we mark it as unknown. For fields with an unknown type, such as unsupported Lookup fields, unsupported custom types, or types Vault can't determine, we skip the column when all values are null. Additionally, we don't sync fields with queryable set to false in Veeva Vault because they can't be queried at the source.
To troubleshoot missing columns, check each field's data type and queryable status in the Veeva Vault schema browser or API.