Connect Weaviate data with any data source.

Sync any source into Weaviate on the schedule you set.

Load data into Weaviate Read the docs

Sources: 590+
Standard support: 0.2.64

Overview

What is the Airbyte Weaviate connector?

The Airbyte Weaviate connector loads data from 590+ Airbyte sources into Weaviate, with full refresh and incremental sync on a schedule you control.

01
Load from any source
Move data into Weaviate from 590+ Airbyte sources on a schedule you control.
02
Incremental syncs
Pull only the records that changed since the last run instead of reloading everything.
03
Cloud or self-hosted
Run the Weaviate connector on Cloud, OSS, Hybrid.

Setup

Live in ten steps

First, navigate to the Weaviate destination connector on Airbyte's website.
Click on the "Get Started" button to begin the setup process.
Enter the required credentials for your Weaviate instance, including the URL, API key, and schema name.
Test the connection to ensure that the credentials are correct and the connection is successful.
Choose the tables or collections that you want to sync from your source connector to Weaviate.
Map the fields from your source connector to the corresponding fields in Weaviate.
Set up any necessary transformations or filters to ensure that the data is formatted correctly for Weaviate.
Schedule the sync to run at regular intervals or manually trigger it as needed.
Monitor the sync to ensure that the data is being transferred correctly and troubleshoot any issues that arise.
Once the sync is complete, verify that the data has been successfully transferred to Weaviate.

Configuration fields

Weaviate configuration fields
Field	Type	Description
embedding*	object	Embedding configuration
indexing*	object	Indexing configuration
processing*	object	Not documented.
omit_raw_text	boolean	Do not store the text that gets embedded along with the vector and the metadata in the destination. If set to true, only the vector and the metadata will be stored - in this case raw text for LLM use cases needs to be retrieved from another source.

Hybrid deployment

Sovereign by architecture, not by policy.

The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.

Cloud
OSS
Hybrid

Your environment

DataConnectorsCredentialsKeys

↕ metadata only

Airbyte control plane

OrchestrationMonitoringUI

FAQ

Weaviate connector questions

What data can I load into Weaviate with Airbyte?

Airbyte moves data from any supported source into Weaviate on a schedule you control, with full refresh and incremental sync where the destination supports it.

Does the Weaviate connector support incremental sync?

Yes. The Weaviate destination supports full refresh and incremental sync, so Airbyte can load only the records that changed since the last sync.

Where can I run the Weaviate connector?

Run the Weaviate connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.

Didn't find your answer? Talk to sales