User Tools

Site Tools


google_bigquery

Getting your data into Google BigQuery

Frequently asked questions

How do I setup the transfer to Google Big Query?

  1. On destination page you select Google Big Query
  2. You fill in the fields
  3. As connector URL you can use any URL providing a JSON. Either from the connectors or for example a URL with cached and transformed data from charts.windsor.ai

Do I need to create a table or will Windsor.ai create a table?

Windsor.ai will create a new table in your BigQuery Data Set with the name specified in the BigQuery configuration on Windsor.ai

How do I find my data set ID?

Head to your BigQuery Console and click on the data set you would like to use. You can now see the data set ID.

What user rights do I need to grant Windsor.ai?

Please grant access to the user bq-upload@windsor-ai-bigquery.iam.gserviceaccount.com in your IAM & Admin Console and assign the roles BigQuery Admin and Storage Admin

How do I know if my data was processed successfully?

After you set up the configuration and click Save, it can take up to a few minutes for the data to load. A message will appear below Last processing status. If it is successful you can query your database with

 select * from [your table name] 

Why is access to the cloud storage required?

Windsor.ai creates a file in JSON format for the data it streams into your BigQuery table.

How do I set up the cloud storage bucket?

Head to Cloud Storage and create a new bucket (unless you want to reuse an existing one.

Then specify your region. Here is a sample configuration:

Once you click finish add the name (marketing-data-demo in this sample) in Google Cloud Storage Bucket on Windsor.ai

How do I set up a cloud storage folder?

In your Cloud Storage bucket, click on create new folder. Use this folder name on Windsor.ai

I'm having problems with my connector URL. How do I test if it is working correctly?

If you have a complex query it makes sense to test your connector URL in a tool like Postman or Insomnia to make sure that it is working as expected.

google_bigquery.txt · Last modified: 2023/10/24 11:39 by windsor_ai