- Destination
- Engineering Analytics
- Alpha
Connect Google PubSub data with any data source.
Move data from any source into Google PubSub with Airbyte.
- Sources
- 590+
- Standard support
- 0.2.3
Overview
What is the Airbyte Google PubSub connector?
The Airbyte Google PubSub connector loads data from 590+ Airbyte sources into Google PubSub, with incremental sync on a schedule you control.
- 01
Load from any source
Move data into Google PubSub from 590+ Airbyte sources on a schedule you control.
- 02
Incremental syncs
Pull only the records that changed since the last run instead of reloading everything.
- 03
Cloud or self-hosted
Run the Google PubSub connector on Cloud, OSS, Hybrid.
Setup
Live in three steps
Confirm your Google PubSub destination credentials and permissions.
Configure the destination in Airbyte with the required connection settings.
Choose a source, map streams, and schedule syncs into Google PubSub.
Configuration fields
| Field | Type | Description |
|---|---|---|
| batching_enabled* | boolean | If TRUE messages will be buffered instead of sending them one by one |
| credentials_json* | string | The contents of the JSON service account key. Check out the docs if you need help generating this key. |
| ordering_enabled* | boolean | If TRUE PubSub publisher will have message ordering enabled. Every message will have an ordering key of stream |
| project_id* | string | The GCP project ID for the project containing the target PubSub. |
| topic_id* | string | The PubSub topic ID in the given GCP project ID. |
| batching_delay_threshold | integer | Number of ms before the buffer is flushed |
| batching_element_count_threshold | integer | Number of messages before the buffer is flushed |
| batching_request_bytes_threshold | integer | Number of bytes before the buffer is flushed |
Hybrid deployment
Sovereign by architecture, not by policy.
The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.
- Cloud
- OSS
- Hybrid
Your environment
Airbyte control plane
FAQ
Google PubSub connector questions
What data can I load into Google PubSub with Airbyte?
Airbyte moves data from any supported source into Google PubSub on a schedule you control, with full refresh and incremental sync where the destination supports it.
Does the Google PubSub connector support incremental sync?
Yes. The Google PubSub destination supports incremental sync, so Airbyte can load only the records that changed since the last sync.
Where can I run the Google PubSub connector?
Run the Google PubSub connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.
Didn't find your answer? Talk to sales
Start loading data into Google PubSub in minutes.
Free 14-day trial. No credit card needed.