Move BigQuery data anywhere it matters.

Stream BigQuery data to any warehouse or AI app.

Sync BigQuery free Read the docs

Source

BigQuery

Snowflake
BigQuery
Postgres
Databricks
Claude

Destinations: 50+
Standard support: 1.0.1

Overview

What is the Airbyte BigQuery connector?

The Airbyte BigQuery connector extracts data from BigQuery and loads it into 50+ destinations such as Snowflake, BigQuery, Databricks or Postgres, with full refresh and incremental sync. It publishes tables and events you can select per connection.

01
Sync to your warehouse
Land BigQuery data in 50+ destinations on a schedule you control.
02
Incremental syncs
Pull only the records that changed since the last run instead of reloading everything.
03
One authorization
Authenticate BigQuery once and Airbyte keeps every scheduled sync running on it.
04
Cloud or self-hosted
Run the BigQuery connector on Cloud, OSS, Hybrid.

Setup

Live in ten steps

First, you need to have a Google Cloud Platform account and a project with BigQuery enabled.
Go to the Google Cloud Console and create a new service account with the necessary permissions to access your BigQuery data.
Download the JSON key file for the service account and keep it safe.
Open Airbyte and go to the Sources page.
Click on the "Create a new source" button and select "BigQuery" from the list of available sources.
Enter a name for your source and click on "Next".
In the "Connection Configuration" section, enter the following information: - Project ID: the ID of your Google Cloud Platform project - JSON Key: copy and paste the contents of the JSON key file you downloaded earlier - Dataset: the name of the dataset you want to connect to
Click on "Test Connection" to make sure everything is working correctly.
If the test is successful, click on "Create Source" to save your configuration.
You can now use your BigQuery source connector to extract data from your dataset and load it into Airbyte for further processing.

Configuration fields

BigQuery configuration fields
Field	Type	Description
credentials_json*	string	The contents of the JSON service account key. Check out the docs if you need help generating this key.
project_id*	string	The GCP project ID for the project containing the BigQuery datasets to read from. Read more here.
dataset_id	string	The BigQuery dataset to read tables and views from. Leave empty to discover every dataset of the project; setting it makes schema discovery much faster on projects with many datasets. Read more here.
job_project_id	string	Optional. The GCP project ID where BigQuery query jobs are run. When set, the queries of a sync run against this project's quota and billing instead of the data project's. This isolates the concurrent query quota between workloads (e.g. data extraction vs. analytics) and allows reading from a project in which the service account only has data access. The service account must have the BigQuery Job User role on this project. If not set, jobs run in the data project (Project ID above).
max_db_connections	integer	Not configurable on self-managed Airbyte, where streams are read one at a time. Airbyte Cloud reads several streams concurrently.
use_storage_read_api	boolean	Not available on self-managed Airbyte, where tables are read through the standard query API. Airbyte Cloud reads tables through the BigQuery Storage Read API for high throughput.

Hybrid deployment

Sovereign by architecture, not by policy.

The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.

Cloud
OSS
Hybrid

Your environment

DataConnectorsCredentialsKeys

↕ metadata only

Airbyte control plane

OrchestrationMonitoringUI

FAQ

BigQuery connector questions

What data can I sync from BigQuery with Airbyte?

The BigQuery connector syncs the tables and events published in Airbyte docs.

Does the BigQuery connector support incremental sync?

Yes. The BigQuery connector supports incremental sync on selected streams, and full refresh on every stream.

Where can I run the BigQuery connector?

Run the BigQuery connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.

Didn't find your answer? Talk to sales