Documentation / Product / Integrations / Google / Google BigQuery

Google BigQuery: Import Events

Many applications let you write to tables in Google BigQuery and you can easily import this custom data into Lytics. Once imported, you can leverage powerful insights on this custom data provided by Lytics data science to drive your marketing efforts.

Integration Details

This integration utilizes the Google BigQuery APIs to import user data. Once the import is started the workflow will:

  1. Start a query job for data in Google BigQuery.
  2. Export the result to Google Cloud Storage.
  3. Import file from Google Cloud Storage into the selected Lytics data stream.

Fields

Fields imported through Google BigQuery will require custom data mapping. For assistance mapping your custom data to Lytics user fields, please contact Lytics Support.

Configuration

Follow these steps to set up and configure an import of Google BigQuery events into the Lytics platform.

  1. Navigate to Google in the Integrations section of Lytics. google
  2. Select Workflows from the menu on the left.
  3. Select Import Events from the list of workflows.
  4. Select the authorization you would like to use.
  5. In the Stream text input, enter the stream where imported data will go.
  6. From the BigQuery Project input, select the Google BigQuery Project you want to import data from.
  7. From the BigQuery Dataset input, select the Google BigQuery Dataset you want to export data from.
  8. From the BigQuery Table input, select the Google BigQuery table you would like to import.
  9. From the Timestamp Field input, select the name of the field that contains the event timestamp. On continuous imports, the most recent time in this field will be saved. On the next import, only rows with a timestamp greater than that value will be imported.
  10. Select the Keep Updated checkbox to continuously run this import. If this option is selected, the Timestamp Field must be provided.
  11. Click Start Import.

gbq-import-events-config

The time necessary to import a table depends on the table size. It can take from 30 minutes to several hours to complete the import. NOTE: It's important to be aware that big imports can make your entire Lytics account slower as data is processed and audience memberships are updated.