​
Step 1: In the Data Portal, click Tables and then click Create Table.

​
​Step 2: Select BigQuery as the Data Source.

​
​Step 3: Create a New Connection.

Click New Connection. If you want to use an existing connection, select the connection from the list and proceed to Step 5.

Enter a Source Name for the new connection.

​
Step 4: Configure Connection Parameters

Use the following JSON configuration:

{
  "sql.bigquery.projectid": "project_id",
  "sql.bigquery.jsonkey": ""
}

​
Property Descriptions

PropertyRequiredDescription
sql.bigquery.projectIdYesThe GCP project ID. Find your project ID in the Google Cloud console.
sql.bigquery.jsonKeyYesThe string-encoded Google service account key. Ensure the correct JSON key format. See Google’s documentation for creating a service account key.

​
Step 5: Test the Connection and Configure Data Ingestion

After you have configured the connection properties, test the connection to ensure it is working.

When the connection is successful, use the following JSON to configure additional data settings:

{
  "sql.queryTemplate": "SELECT * FROM <TABLE> WHERE <TIME_COLUMN> BETWEEN $START AND $END",
  "sql.timeColumnName": "TIME_COLUMN",
  "sql.timeColumnFormat": "yyyy-MM-dd",
  "sql.startTime": "",
  "sql.endTime": ""
}

​
Property Descriptions

PropertyRequiredDescription
sql.queryTemplateYesThe SQL query template for fetching data from BigQuery.
sql.timeColumnNameYesThe time column used for filtering data while ingesting.
sql.timeColumnFormatYesThe datetime format of the time column used for filtering.
sql.startTimeYesThe start time for data extraction. This value is dynamically used in the $START placeholder of sql.queryTemplate. It should match the specified time column format.
sql.endTimeYesThe end time for data extraction. This value is dynamically used in the $END placeholder of sql.queryTemplate. It should match the specified time column format.

​
Step 6: Preview the Data

Click Show Sample Data to preview the source data before finalizing the configuration.

​
Step 1: In the Data Portal, click Tables and then click Create Table.

​
​Step 2: Select BigQuery as the Data Source.

​
​Step 3: Create a New Connection.

Click New Connection. If you want to use an existing connection, select the connection from the list and proceed to Step 5.

Enter a Source Name for the new connection.

​
Step 4: Configure Connection Parameters

Use the following JSON configuration:

{
  "sql.bigquery.projectid": "project_id",
  "sql.bigquery.jsonkey": ""
}

​
Property Descriptions

PropertyRequiredDescription
sql.bigquery.projectIdYesThe GCP project ID. Find your project ID in the Google Cloud console.
sql.bigquery.jsonKeyYesThe string-encoded Google service account key. Ensure the correct JSON key format. See Google’s documentation for creating a service account key.

​
Step 5: Test the Connection and Configure Data Ingestion

After you have configured the connection properties, test the connection to ensure it is working.

When the connection is successful, use the following JSON to configure additional data settings:

{
  "sql.queryTemplate": "SELECT * FROM <TABLE> WHERE <TIME_COLUMN> BETWEEN $START AND $END",
  "sql.timeColumnName": "TIME_COLUMN",
  "sql.timeColumnFormat": "yyyy-MM-dd",
  "sql.startTime": "",
  "sql.endTime": ""
}

​
Property Descriptions

PropertyRequiredDescription
sql.queryTemplateYesThe SQL query template for fetching data from BigQuery.
sql.timeColumnNameYesThe time column used for filtering data while ingesting.
sql.timeColumnFormatYesThe datetime format of the time column used for filtering.
sql.startTimeYesThe start time for data extraction. This value is dynamically used in the $START placeholder of sql.queryTemplate. It should match the specified time column format.
sql.endTimeYesThe end time for data extraction. This value is dynamically used in the $END placeholder of sql.queryTemplate. It should match the specified time column format.

​
Step 6: Preview the Data

Click Show Sample Data to preview the source data before finalizing the configuration.