• Source
  • Others
  • Alpha

Move KYVE data anywhere it matters.

Pull KYVE data into any warehouse or AI app.

Source

KYVE

  • Snowflake
  • BigQuery
  • Postgres
  • Databricks
  • Claude
Destinations
50+
Standard support
0.2.54

Overview

What is the Airbyte KYVE connector?

The Airbyte KYVE connector extracts data from KYVE and loads it into 50+ destinations such as Snowflake, BigQuery, Databricks or Postgres, with full refresh and incremental sync. It publishes tables and events you can select per connection.

  • 01

    Sync to your warehouse

    Land KYVE data in 50+ destinations on a schedule you control.

  • 02

    Incremental syncs

    Pull only the records that changed since the last run instead of reloading everything.

  • 03

    One authorization

    Authenticate once; every scheduled sync keeps running.

  • 04

    Cloud or self-hosted

    Run the KYVE connector on Cloud, OSS, Hybrid.

Setup

Live in three steps

  1. For Pool-IDs, enter the ID of the KYVE storage pool you want to sync. To sync more than one pool, enter a comma-separated list, for example 0,1.

  2. For Bundle-Start-IDs, enter the bundle ID to start syncing from for each pool. To start from the first bundle in a pool, enter 0. If you entered more than one pool, enter one start ID per pool in the same order, for example 0,0. The number of start IDs must match the number of pool IDs, or the connection check fails. You can browse a pool's bundles in the KYVE app, for example the Cosmos Hub pool bundles.

  3. For KYVE-API URL Base, enter the KYVE Chain API endpoint to read from. The default is the mainnet endpoint, https://api.kyve.network.

Configuration fields

KYVE configuration fields
FieldTypeDescription
pool_ids*stringThe IDs of the KYVE storage pool you want to archive. (Comma separated)
start_ids*stringThe start-id defines, from which bundle id the pipeline should start to extract the data. (Comma separated)
url_base*stringURL to the KYVE Chain API.
max_pagesintegerThe maximum amount of pages to go trough. Set to 'null' for all pages.
page_sizeintegerThe pagesize for pagination, smaller numbers are used in integration tests.

Hybrid deployment

Sovereign by architecture, not by policy.

The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.

  • Cloud
  • OSS
  • Hybrid

Your environment

DataConnectorsCredentialsKeys

↕ metadata only

Airbyte control plane

OrchestrationMonitoringUI

FAQ

KYVE connector questions

What data can I sync from KYVE with Airbyte?

The KYVE connector syncs the tables and events published in Airbyte docs.

Does the KYVE connector support incremental sync?

Yes. The KYVE connector supports incremental sync on selected streams, and full refresh on every stream.

Where can I run the KYVE connector?

Run the KYVE connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.

Didn't find your answer? Talk to sales

Start syncing KYVE in minutes.

Free 14-day trial. No credit card needed.