When setting up a BigQuery export you can choose between exporting to a Single table or Multiple tables.
With a single table export all data is exported to one table that is partitioned per month. This requires that the
date field is included in the export.
This is the recommended way to export your data to BigQuery.
Having a single partitioned table will reduce the schema and metadata overhead when using multiple tables export. This leads to improved query performance.
With a multiple tables export then a table will be created for each calender month exported.
Multiple tables is also called sharding in BigQuery and has some negative effects of schema and metadata overhead for each table exported. In most cases using a single partitioned table is the recommended way to setup your export.
Use date-partitioned tables
When using multiple tables we also support partitioning each individual table based on day. This requires that funnel
date is included in the export and is recommended to use when possible.
Create BigQuery View
Funnel can also create a view that combines the data in all the monthly tables. This view is called
all_funnel_data_view and can ease the use of querying the data in all tables from a single point.