Integration
      Back to home
      1. Knowledge Base
      2. Integration

      How to Enable Data via BigQuery to INCRMNTAL

      This article explains how to enable and onboard raw or aggregated data from Google Cloud BigQuery to INCRMNTAL

      Integration with BigQuery requires 4 steps:

      Create a Service Account

      1. Sign in to Google Cloud Platform Console
      2. Navigate to IAM & Admin > Service Account
        image11
      3. Click “ + Create Service Account”
        image8
      4. Name the new service account INCRMNTAL and click “Create”
        image2-1

        This will be used in a later stage to grant permission for the relevant data set.

      5. In the 2nd step, set the permission to the service account to “BigQuery Job User” and click “Continue” to finish the Service Account creation process
        image9
      6.  Click the   ➕   symbol at the raw and click “Create Key”
        image4
      7. Choose the JSON format and click “Create”
        image7

      Enable BigQuery API

      By default, BigQuery API is enabled. But in case you run into difficulties, you may need to enable this feature.

      1. Navigate to APIs & Services on the Google Cloud Console menu
      2. Click “+ Enable APIs and Services”
        image5
      3. Search for “BigQuery API” > Select and click “Enable”
        image6

         

      Choose BigQuery Table for the Service Account

      1. Navigate to BigQuery product page, and choose the relevant table you would like to share with INCRMNTAL

      Note: This step should be repeated for each table you would like to provide access to INCRMNTAL

         2.  Select the option to “Share Table”

      image10


         3.  Enable the INCRMNTAL Member you created in the earlier step (Create Service Account). Set the role as “BigQuery Data Viewer”. Click “Add”

      image3

         4.  Click “Done” 

      Choose BigQuery Table on INCRMTNAL's dashboard


      On your INCRMTNAL dashboard, go to Configuration > Integrations with either an existing user or the Config account you received from us.

      1. Click "Add Integration" on the right side.
      2. Search for BigQuery by using the search bar. Click "Add".
      3. Click the Authentication dropdown. Click "Add Authentication"

      4. Upload to the dashboard the JSON file you downloaded from BigQuery, that contains the key to the integrated project and tables.



      5. Click "Submit".

      Your Project ID should be automatically populated, as per the granted permissions to the service account.

       
      13. Choose the relevant datasets for the integration with INCRMTNAL by clicking on the dropdown "Dataset Name". You can also add a dataset name manually.

       
      14. Click "Load Tables". The relevant tables will appear under "Table Details". Then, enable the relevant tables for us to fetch data from.


       

      If the created job user doesn't have List permissions, the data will not be populated automatically for Dataset Name and Tables. You can add those manually by clicking "Add Tables", or, update the job user to have List permissions.

       
       

      Note: To preview the data from the integrated tables, click "Preview" on the right side of each table.

       

      Note: When integrating partitioned tables, we'll present the partition format in the table's name and in a separate column.

       
      15. Enable the relevant tables by clicking the toggle "Active" on the left side. You can also manually ad a table you'd like to integrate, by clicking +Add Table on the top right of the Table Details section and add its name.

      If your manually added table is partitioned, please be sure to add the partition format, under the respectful column and the table name
      e.g.  table name: funnel_data_{YYYY}_{MM}

       
      16. Click "Save".
       

      Done!
      For any question please contact onboarding@incrmntal.com , or open a support Ticket here