Google BigQuery summary table export

Background
Table Schema
Example Queries

Background

To be able to get an overview of historical jobs and latest status you can also export an export_summary table from your BigQuery export in Funnel. If you have multiple exports to the same data set they will be appended to the same summary table. The summary export is enabled by checking the following option that can be find under Advanced when creating/editing the export in Funnel.

Table Schema

Field name	Type	Mode	Description
account_id	STRING	NULLABLE	Funnel account ID
export_id	STRING	NULLABLE	Unique Funnel export configuration
run_id	STRING	NULLABLE	Unique ID for a single export job
total_count	INTEGER	NULLABLE	Files exported
fail_count	INTEGER	NULLABLE	Files that failed to export
success_count	INTEGER	NULLABLE	Files that exported successfully
status	STRING	NULLABLE	Status of job export, Success or Fail
start_at	TIMESTAMP	NULLABLE	UTC timestamp of when the export started
end_at	TIMESTAMP	NULLABLE	UTC timestamp of when the export ended
message	STRING	NULLABLE	Status message from failed export job
files	RECORD	REPEATED	Files in an export job
files. file_name	STRING	NULLABLE	Name of the exported file
files. status	STRING	NULLABLE	Status of file export, Success or Fail
files. message	STRING	NULLABLE	Status message from failed file export
files. updated	BOOLEAN	NULLABLE	If the file changed, true or false

Example Queries

List all files and statuses

SELECT
  file.file_name,
  file.status
FROM
  `export_summary`,
  UNNEST(files) AS file
ORDER BY
  end_at DESC

Number of Failed/Successful exports per day

SELECT
  DATE(end_at) as date,
  SUM(total_count) as total_total,
  SUM(success_count) as success_total,
  SUM(fail_count) as fail_total,
FROM
  `export_summary`
GROUP BY
  1
ORDER BY
  1 DESC