User Tools

Site Tools


google_bigquery

This is an old revision of the document!


Getting your data into Google BigQuery

Frequently asked questions

  • Do I need to create a table or will Windsor.ai create a table?

Windsor.ai will create a new table in your BigQuery Data Set with the name specified in the BigQuery configuration on Windsor.ai

  • How do I find my data set ID?

Head to your BigQuery Console and click on the data set you would like to use. You can now see the data set ID.

  • What user rights do I need to grant Windsor.ai?

Please grant access to the user bq-upload@windsor-ai-bigquery.iam.gserviceaccount.com in your IAM & Admin Console and assign the roles BigQuery Admin and Storage Admin

  • How do I know if my data was processed successfully?

After you set up the configuration and click Save, it can take up to a few minutes for the data to load. A message will appear below Last processing status. If it is successful you can query your database with

 select * from [your table name] 
  • Why is access to the cloud storage required?

Windsor.ai creates a file in JSON format for the data it streams into your BigQuery table.

  • How do I set up the cloud storage bucket?

Head to Cloud Storage and create a new bucket (unless you want to reuse an existing one.

Then specify your region. Here is a sample configuration:

Once you click finish add the name (marketing-data-demo in this sample) in Google Cloud Storage Bucket on Windsor.ai

  • How do I set up a cloud storage folder?

In your Cloud Storage bucket, click on create new folder. Use this folder name on Windsor.ai

  • I'm having problems with my connector URL. How do I test if it is working correctly?

If you have a complex query it makes sense to test your connector URL in a tool like Postman or Insomnia to make sure that it is working as expected.

google_bigquery.1617334270.txt.gz · Last modified: 2021/04/02 04:31 by windsor_ai