Connect BigQuery data with any data source.

Sync any source into BigQuery on the schedule you set.

Load data into BigQuery Read the docs

Sources: 590+
Certified support: 3.1.0

Overview

What is the Airbyte BigQuery connector?

The Airbyte BigQuery connector loads data from 590+ Airbyte sources into BigQuery, with full refresh and incremental sync on a schedule you control.

01
Load from any source
Move data into BigQuery from 590+ Airbyte sources on a schedule you control.
02
Incremental syncs
Pull only the records that changed since the last run instead of reloading everything.
03
Cloud or self-hosted
Run the BigQuery connector on Cloud, OSS, Hybrid.

Setup

Live in 14 steps

First, navigate to the Airbyte dashboard and select the "Destinations" tab on the left-hand side of the screen.
Scroll down until you find the "BigQuery" destination connector and click on it.
Click the "Create Destination" button to begin setting up your BigQuery destination.
Enter your Google Cloud Platform project ID and service account credentials in the appropriate fields.
Next, select the dataset you want to use for your destination and enter the table prefix you want to use.
Choose the schema mapping for your data, which will determine how your data is organized in BigQuery.
Finally, review your settings and click the "Create Destination" button to complete the setup process.
Once your destination is created, you can begin configuring your source connectors to start syncing data to BigQuery.
To do this, navigate to the "Sources" tab on the left-hand side of the screen and select the source connector you want to use.
Follow the prompts to enter your source credentials and configure your sync settings.
When you reach the "Destination" step, select your BigQuery destination from the dropdown menu and choose the dataset and table prefix you want to use.
Review your settings and click the "Create Connection" button to start syncing data from your source to your BigQuery destination.
Suggested Read:
Bigquery Source

Configuration fields

BigQuery configuration fields
Field	Type	Description
dataset_id*	string	The default BigQuery Dataset ID that tables are replicated to if the source does not specify a namespace. Read more here.
dataset_location*	string	The location of the dataset. Warning: Changes made after creation will not be applied. Read more here.
project_id*	string	The GCP project ID for the project containing the target BigQuery dataset. Read more here.
cdc_deletion_mode	string	Whether to execute CDC deletions as hard deletes (i.e. propagate source deletions to the destination), or soft deletes (i.e. leave a tombstone record in the destination). Defaults to hard deletes.
credentials_json	string	The contents of the JSON service account key. Check out the docs if you need help generating this key. Default credentials will be used if this field is left empty.
disable_type_dedupe	boolean	Write the legacy "raw tables" format, to enable backwards compatibility with older versions of this connector.
job_project_id	string	Optional. The GCP project ID where BigQuery jobs will be executed. When set, query jobs run against this project's quota instead of the dataset project's quota. This is useful for isolating BigQuery concurrent query quota between different workloads (e.g. data ingestion vs. analytics). The service account must have BigQuery Job User role on this project. If not set, jobs run in the dataset project (Project ID above).
loading_method	object	The way data will be uploaded to BigQuery.

Hybrid deployment

Sovereign by architecture, not by policy.

The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.

Cloud
OSS
Hybrid

Your environment

DataConnectorsCredentialsKeys

↕ metadata only

Airbyte control plane

OrchestrationMonitoringUI

FAQ

BigQuery connector questions

What data can I load into BigQuery with Airbyte?

Airbyte moves data from any supported source into BigQuery on a schedule you control, with full refresh and incremental sync where the destination supports it.

Does the BigQuery connector support incremental sync?

Yes. The BigQuery destination supports full refresh and incremental sync, so Airbyte can load only the records that changed since the last sync.

Where can I run the BigQuery connector?

Run the BigQuery connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.

Didn't find your answer? Talk to sales