To be able to get an overview of historical jobs and the latest status you can also create an 'export summary' table from your BigQuery Share in Funnel. If you have multiple Shares targeting the summary table, these entries will be appended.
The use of a summary table is enabled by checking the following option that can be found under Advanced when creating/editing the Share in Funnel.
Funnel account ID
Unique Funnel Share configuration
Unique ID for a single sharing job
Files that failed to be shared
Files that were shared successfully
Status of the sharing job, 'Success' or 'Fail'
UTC timestamp of when the sharing job started
UTC timestamp of when the sharing job ended
Status message from failed sharing job
Files in a sharing job
Name of the shared file
Status of file sharing, 'Success' or 'Fail'
Status message from failed file sharing
If the file changed, true or false
The number if rows exported
The number of bytes exported. Multiply it by 1024 to get exported kB.
The export summary can be used to make you data pipe more efficient. If you look at the last run in the summary you can see which files has
updated=true these are the only partitions or tables (depending on if you use single table setup or not) that has changed and needs to be reloaded.
It can also be used to provide stats and setup your own alerts in your system.
List all files and statuses
UNNEST(files) AS file
Number of Failed/Successful sharing jobs per day
DATE(end_at) as date,
SUM(total_count) as total_total,
SUM(success_count) as success_total,
SUM(fail_count) as fail_total,