Move Google Cloud Storage (GCS) data anywhere it matters.

Stream Google Cloud Storage (GCS) avro, jsonl and csv to any warehouse or AI app.

Sync Google Cloud Storage (GCS) free Read the docs

Source

Google Cloud Storage (GCS)

Snowflake
BigQuery
Postgres
Databricks
Claude

Streams: 6
Destinations: 50+
Certified support: 0.10.38

Overview

What is the Airbyte Google Cloud Storage (GCS) connector?

The Airbyte Google Cloud Storage (GCS) connector extracts data from Google Cloud Storage (GCS) and loads it into 50+ destinations such as Snowflake, BigQuery, Databricks or Postgres, with full refresh and incremental sync. It publishes 6 streams you can select per connection.

01
Sync to your warehouse
Land 6 Google Cloud Storage (GCS) tables in 50+ destinations on a schedule you control.
02
Incremental syncs
Pull only the records that changed since the last run instead of reloading everything.
03
One authorization
Authenticate Google Cloud Storage (GCS) once and Airbyte keeps every scheduled sync running on it.
04
Cloud or self-hosted
Run the Google Cloud Storage (GCS) connector on Cloud, OSS, Hybrid.

6 streams

Every table you can sync from Google Cloud Storage (GCS)

avro
Sync modes FullIncr.
jsonl
Sync modes FullIncr.
csv
Sync modes FullIncr.
parquet
Sync modes FullIncr.
unstructured document format
Sync modes FullIncr.
excel
Sync modes FullIncr.

avro
Sync modes	FullIncr.

jsonl
Sync modes	FullIncr.

csv
Sync modes	FullIncr.

parquet
Sync modes	FullIncr.

unstructured document format
Sync modes	FullIncr.

excel
Sync modes	FullIncr.

Setup

Live in twelve steps

Log into your Airbyte Cloud account.
Click Sources and then click + New source.
On the Set up the source page, select Google Cloud Storage (GCS) from the Source type dropdown.
Enter a name for the Google Cloud Storage (GCS) connector.
Select authorization type:
Authenticate via Google (OAuth) from the Authentication dropdown, click Sign in with Google and complete the authentication workflow.
Service Account Information and paste the service account JSON key to the Service Account Information field .
Paste the service account JSON key to the Service Account Information field .
Enter your GCS bucket name to the Bucket field.
Add a stream:
Give a Name to the stream
In the Format box, use the dropdown menu to select the format of the files you'd like to replicate. Toggling the Optional fields button within the Format box will allow you to enter additional configurations based on the selected format. For a detailed breakdown of these settings, refer to the File Format section below.

Configuration fields

Google Cloud Storage (GCS) configuration fields
Field	Type	Description
bucket*	string	Name of the GCS bucket where the file(s) exist.
credentials*	object	Credentials for connecting to the Google Cloud Storage API
streams*	array	Each instance of this configuration defines a stream. Use this to define which files belong in the stream, their format, and how they should be parsed and validated. When sending data to warehouse destination such as Snowflake or BigQuery, each stream is a separate table.
delivery_method	object	Not documented.
sanitize_signed_urls	boolean	Deprecated - this option has no effect. The connector no longer generates signed URLs for Service Account authentication; _ab_source_file_url always contains the clean canonical HTTPS path.
start_date	string	UTC date and time in the format 2017-01-25T00:00:00.000000Z. Any file modified before this date will not be replicated.

Hybrid deployment

Sovereign by architecture, not by policy.

The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.

Cloud
OSS
Hybrid

Your environment

DataConnectorsCredentialsKeys

↕ metadata only

Airbyte control plane

OrchestrationMonitoringUI

FAQ

Google Cloud Storage (GCS) connector questions

What data can I sync from Google Cloud Storage (GCS) with Airbyte?

6 streams: avro, jsonl, csv, parquet, unstructured document format, excel.

Does the Google Cloud Storage (GCS) connector support incremental sync?

Yes. The Google Cloud Storage (GCS) connector supports incremental sync on selected streams, and full refresh on every stream.

Where can I run the Google Cloud Storage (GCS) connector?

Run the Google Cloud Storage (GCS) connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.

Didn't find your answer? Talk to sales