Differences

This shows you the differences between two versions of the page.

--- google_bigquery [2021/04/02 04:12]
windsor_ai
+++ google_bigquery [2023/10/24 11:39]
windsor_ai
@@ Line 1: / Line 1: @@
 ====== Getting your data into Google BigQuery ======
 ==== Frequently asked questions ====
-  * How do I find my data set ID?
+=== How do I setup the transfer to Google Big Query? ===
+  - You go to https://onboard.windsor.ai/
+  - On destination page you select Google Big Query
+  - You fill in the fields
+  - As connector URL you can use any URL providing a JSON. Either from the connectors or for example a URL with cached and transformed data from charts.windsor.ai
+{{ :mk_2023-10-24_12-35-45_2x.png?1600 |}}
+=== Do I need to create a table or will Windsor.ai create a table? ===
+Windsor.ai will create a new table in your [[https://console.cloud.google.com/bigquery/|BigQuery Data Set]] with the name specified in the BigQuery configuration on [[https://onboard.windsor.ai|Windsor.ai]]
+=== How do I find my data set ID? ===
 Head to your [[https://console.cloud.google.com/bigquery/|BigQuery Console]] and click on the data set you would like to use. You can now see the data set ID.
@@ Line 9: / Line 31: @@
 {{ :find-data-set-id-google-bigquery.png?nolink&700 |}}
-  * Do I need to create a table or will Windsor.ai create a table?
-    Windsor.ai will create a new table in your [[https://console.cloud.google.com/bigquery/|BigQuery Data Set]] with the name specified in the BigQuery configuration on [[https://onboard.windsor.ai|Windsor.ai]]
+=== What user rights do I need to grant Windsor.ai? ===
-   * What user rights do I need to grant Windsor.ai?
-     Please grant access to the user **bq-upload@windsor-ai-bigquery.iam.gserviceaccount.com** in your [[https://console.cloud.google.com/iam-admin/|IAM & Admin Console]] and assign the roles **BigQuery Admin** and **Storage Admin**
+Please grant access to the user **bq-upload@windsor-ai-bigquery.iam.gserviceaccount.com** in your [[https://console.cloud.google.com/iam-admin/|IAM & Admin Console]] and assign the roles **BigQuery Admin** and **Storage Admin**
-   * How do I know if my data was processed successfully?
-     After you set up the configuration and click **Save**, it can take up to a few minutes for the data to load. A message will appear below **Last processing status**. If it is successful you can query your database with <code> select * from [your table name] </code>
+=== How do I know if my data was processed successfully? ===
+After you set up the configuration and click **Save**, it can take up to a few minutes for the data to load. A message will appear below **Last processing status**. If it is successful you can query your database with <code> select * from [your table name] </code>
+=== Why is access to the cloud storage required? ===
+Windsor.ai creates a file in JSON format for the data it streams into your BigQuery table.
+=== How do I set up the cloud storage bucket? ===
+Head to [[https://console.cloud.google.com/storage|Cloud Storage]] and create a new bucket (unless you want to reuse an existing one.
+{{ :create-google-cloud-storage-bucket.png?nolink&700 |}}
+Then specify your region. Here is a sample configuration:
+{{ :bigquery-configuration.png?nolink&800 |}}
+Once you click finish add the name (marketing-data-demo in this sample) in Google Cloud Storage Bucket on [[https://onboard.windsor.ai|Windsor.ai]]
+=== How do I set up a cloud storage folder? ===
+In your [[https://console.cloud.google.com/storage|Cloud Storage]] bucket, click on create new folder. Use this folder name on [[https://onboard.windsor.ai|Windsor.ai]]
+{{ :create-cloud-storage-folder.png?nolink&600 |}}
+=== I'm having problems with my connector URL. How do I test if it is working correctly? ===
+If you have a complex query it makes sense to test your connector URL in a tool like [[https://www.postman.com/|Postman]] or [[https://insomnia.rest/|Insomnia]] to make sure that it is working as expected.

Knowledge Base

User Tools

Site Tools

Differences

Page Tools