- Source
- Engineering Analytics
- Alpha
Move PyPI data anywhere it matters.
Pull PyPI project, release and stats into any warehouse or AI app.
Source
PyPI
Snowflake
BigQuery
Postgres
Databricks
Claude
- Streams
- 3
- Destinations
- 50+
- Standard support
- 0.2.69
Overview
What is the Airbyte PyPI connector?
The Airbyte PyPI connector extracts data from PyPI and loads it into 50+ destinations such as Snowflake, BigQuery, Databricks or Postgres, with scheduled sync. It publishes 3 streams you can select per connection.
- 01
Sync to your warehouse
Land 3 PyPI tables in 50+ destinations on a schedule you control.
- 02
One authorization
Authenticate once; every scheduled sync keeps running.
- 03
Cloud or self-hosted
Run the PyPI connector on Cloud, OSS, Hybrid.
3 streams
Every table you can sync from PyPI
Project Sync modes FullIncr. Release Sync modes FullIncr. Stats Sync modes FullIncr.
Setup
Live in eight steps
First, you need to create an API token in PyPI. To do this, go to your PyPI account settings and click on "API Tokens" in the left-hand menu. Then, click on "Add API Token" and give it a name. Copy the token that is generated.
In Airbyte, go to the "Sources" tab and click on "Create a new Source". Select "PyPI" from the list of available connectors.
In the PyPI source configuration page, enter a name for your source and paste the API token you copied in step 1 into the "API Token" field.
In the "Package Name" field, enter the name of the package you want to sync data from.
In the "Start Date" field, enter the date from which you want to start syncing data. This is optional, and if you leave it blank, Airbyte will start syncing data from the beginning.
Click on "Test Connection" to make sure that your credentials are correct and that Airbyte can connect to your PyPI account.
If the test is successful, click on "Create Source" to save your PyPI source configuration.
You can now create a new destination to sync your PyPI data to, or you can add this source to an existing pipeline.
Configuration fields
| Field | Type | Description |
|---|---|---|
| project_name* | string | Name of the project/package. Can only be in lowercase with hyphen. This is the name used using pip command for installing the package. |
| version | string | Version of the project/package. Use it to find a particular release instead of all releases. |
Hybrid deployment
Sovereign by architecture, not by policy.
The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.
- Cloud
- OSS
- Hybrid
Your environment
Airbyte control plane
FAQ
PyPI connector questions
What data can I sync from PyPI with Airbyte?
3 streams: Project, Release, Stats.
Does the PyPI connector support incremental sync?
Check the stream list on this page for the sync modes each PyPI table supports.
Where can I run the PyPI connector?
Run the PyPI connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.
Didn't find your answer? Talk to sales
Start syncing PyPI in minutes.
Free 14-day trial. No credit card needed.