Fivetran Log Connector Sample Queries

Calculate monthly active rows (MAR) per connector

The Monthly Active Rows (MAR) count sent through the Fivetran Log Connector includes the active rows recorded up to the current date. The count resets at the beginning of each month. For example, if your MAR count for schema_A.table_A is 5500 on January 1st but is 5800 on January 31st, your January MAR for schema_A.table_A is 5800. Your MAR count then drops to 0 on February 1st. To learn more about MAR, see our consumption-based pricing documentation.

Note: If you use these queries during your free trial, we recommend that you add every data source that you plan to use with Fivetran and let each connector run for 7 days under a typical load. This will give you a more accurate idea of how well Fivetran meets your business needs.

In the queries below, replace <fivetran_load_database> and <fivetran_log_schema_name> with the values from your destination. Replace <fivetran_log_schema_name> with the name of your connector in the Fivetran dashboard.

Calculate MAR by schema (connector)

select 
    av.schema_name,
    MAX(date(av.measured_at)) as last_measurement_date,
    SUM(av.monthly_active_rows) as monthly_active_rows
from <fivetran_load_database>.<fivetran_log_schema_name>.active_volume av
Inner Join (
  select
    max(av.measured_at) max_measured_at,
    av.schema_name,
    av.table_name,
    av.destination_id,
    av.connector_id
  from <fivetran_load_database>.<fivetran_log_schema_name>.active_volume av
  group by 2,3,4,5) mav
On date(mav.max_measured_at) = date(av.measured_at)
and mav.schema_name = av.schema_name
and mav.table_name = av.table_name
and mav.connector_id = av.connector_id
and mav.destination_id = av.destination_id
and av.schema_name != <fivetran_log_schema_name>
group by av.schema_name;

Calculate MAR by table

select 
    av.schema_name,
    av.table_name,
    av.destination_id,
    av.connector_id,
    date(av.measured_at) as last_measurement_date,
    date(date_trunc(month,av.measured_at)) as utc_month,
    av.monthly_active_rows
from <fivetran_destination_database>.<fivetran_log_schema>.active_volume av
Inner Join (
  select
    max(av.measured_at) max_measured_at,
    av.schema_name,
    av.table_name,
    av.destination_id,
    av.connector_id
  from <fivetran_destination_database>.<fivetran_log_schema>.active_volume av
  group by 2,3,4,5) mav
On date(mav.max_measured_at) = date(av.measured_at)
and mav.schema_name = av.schema_name
and mav.table_name = av.table_name
and mav.connector_id = av.connector_id
and mav.destination_id = av.destination_id;

Check Connector Status

Check Sync start and end times

select connector_id, 
message_event,
time_stamp as process_start_time
from <fivetran_destination_database>.<fivetran_log_schema>.log
where message_event = 'sync_start' OR message_event = 'sync_end'
order by time_stamp desc;

Troubleshoot errors and warnings

select connector_id, time_stamp, event, message_data
from <fivetran_destination_database>.<fivetran_log_schema>.log
where event = 'WARNING' or event = 'SEVERE'
order by time_stamp desc;

Documentation