Move Circleci data anywhere it matters.

Move Circleci context, self ids and self collaborations into your warehouse, lake or AI app.

Sync Circleci free Read the docs

Source

Circleci

Snowflake
BigQuery
Postgres
Databricks
Claude

Streams: 12
Incremental streams: 5
Destinations: 50+
Standard support: 0.1.0

Overview

What is the Airbyte Circleci connector?

The Airbyte Circleci connector extracts data from Circleci and loads it into 50+ destinations such as Snowflake, BigQuery, Databricks or Postgres, with full refresh and incremental sync. It publishes 12 streams you can select per connection.

01
Sync to your warehouse
Land 12 Circleci tables in 50+ destinations on a schedule you control.
02
Incremental syncs
Pull only the records that changed since the last run instead of reloading everything.
03
One authorization
Authenticate Circleci once and Airbyte keeps every scheduled sync running on it.
04
Cloud or self-hosted
Run the Circleci connector on Cloud, OSS, Hybrid.

12 streams

Every table you can sync from Circleci

contextIncremental
Primary key id
Pagination DefaultPaginator
Sync modes FullIncr.
self_ids
Primary key id
Pagination DefaultPaginator
Sync modes FullIncr.
self_collaborations
Primary key id
Pagination DefaultPaginator
Sync modes FullIncr.
meIncremental
Primary key analytics_id
Pagination DefaultPaginator
Sync modes FullIncr.
projects
Primary key vcs_url
Pagination DefaultPaginator
Sync modes FullIncr.
pipelinesIncremental
Primary key id
Pagination DefaultPaginator
Sync modes FullIncr.

contextIncremental
Primary key	id
Pagination	DefaultPaginator
Sync modes	FullIncr.

self_ids
Primary key	id
Pagination	DefaultPaginator
Sync modes	FullIncr.

self_collaborations
Primary key	id
Pagination	DefaultPaginator
Sync modes	FullIncr.

meIncremental
Primary key	analytics_id
Pagination	DefaultPaginator
Sync modes	FullIncr.

projects
Primary key	vcs_url
Pagination	DefaultPaginator
Sync modes	FullIncr.

pipelinesIncremental
Primary key	id
Pagination	DefaultPaginator
Sync modes	FullIncr.

Setup

Live in three steps

Get your Circleci credentials from the vendor dashboard or developer settings.
Configure the source in Airbyte with the required connection fields.
Pick a destination, choose streams, set full refresh or incremental, and schedule syncs.

Configuration fields

Circleci configuration fields
Field	Type	Description
api_key*	string	Not documented.
org_id*	string	The org ID found in https://app.circleci.com/settings/organization/circleci/xxxxx/overview
project_id*	string	Project ID found in the project settings, Visit https://app.circleci.com/settings/project/circleci/ORG_SLUG/YYYYY
start_date*	string	Not documented.
job_number	string	Job Number of the workflow for jobs stream, Auto fetches from workflow_jobs stream, if not configured
workflow_id	array	Workflow ID of a project pipeline, Could be seen in the URL of pipeline build, Example https://app.circleci.com/pipelines/circleci/55555xxxxxx/7yyyyyyyyxxxxx/2/workflows/WORKFLOW_ID

Hybrid deployment

Sovereign by architecture, not by policy.

The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.

Cloud
OSS
Hybrid

Your environment

DataConnectorsCredentialsKeys

↕ metadata only

Airbyte control plane

OrchestrationMonitoringUI

FAQ

Circleci connector questions

What data can I sync from Circleci with Airbyte?

12 streams: context, self ids, self collaborations, me, projects, pipelines, specific project, jobs, workflow, insights metrics, insights branches, workflow jobs.

Does the Circleci connector support incremental sync?

Yes. context, me, pipelines, workflow, workflow jobs support incremental sync, and every documented stream supports full refresh.

Where can I run the Circleci connector?

Run the Circleci connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.

Didn't find your answer? Talk to sales