Why Are Some Columns Missing From the Schema Tab During My Initial Sync?
Question
My connector's initial sync has yet to complete. I can see some columns in the Schema tab, but not all. Why are some missing?
Environment
The following file connectors:
- Amazon S3
- Azure Blob Storage
- Box
- Dropbox
- Google Cloud Storage
- Google Drive
- SSH File Transfer Protocol (SFTP)
- SharePoint
Answer
If you choose to upsert with custom primary keys while setting up your connector using the Primary Key used for file process and load field, the visibility of your tables in the Schema tab depends on the validity of your primary keys and the status of your initial sync.
Tables with valid primary keys appear in the Schema tab when the initial sync begins. However, tables with invalid or null
primary keys don't appear until the initial sync completes.