Move Web Scrapper data anywhere it matters.

Sync Web Scrapper sitemap list, sitemap detail, users, scraping jobs and analytics to any warehouse or AI app.

Sync Web Scrapper free Read the docs

Source

Web Scrapper

Snowflake
BigQuery
Postgres
Databricks
Claude

Streams: 5
Destinations: 50+
Standard support: 0.0.70

Overview

What is the Airbyte Web Scrapper connector?

The Airbyte Web Scrapper connector extracts data from Web Scrapper and loads it into 50+ destinations such as Snowflake, BigQuery, Databricks or Postgres, with full refresh. It publishes 5 streams you can select per connection.

01
Sync to your warehouse
Land 5 Web Scrapper tables in 50+ destinations on a schedule you control.
02
One authorization
Authenticate Web Scrapper once and Airbyte keeps every scheduled sync running on it.
03
Cloud or self-hosted
Run the Web Scrapper connector on Cloud, OSS, Hybrid.

5 streams

Every table you can sync from Web Scrapper

sitemap_list
Primary key id
Pagination DefaultPaginator
Sync modes FullIncr.
sitemap_detail
Primary key id
Pagination DefaultPaginator
Sync modes FullIncr.
users
Pagination No pagination
Sync modes FullIncr.
scraping_jobs
Primary key id
Pagination DefaultPaginator
Sync modes FullIncr.
scraping_job_data_quality
Pagination No pagination
Sync modes FullIncr.

sitemap_list
Primary key	id
Pagination	DefaultPaginator
Sync modes	FullIncr.

sitemap_detail
Primary key	id
Pagination	DefaultPaginator
Sync modes	FullIncr.

users
Pagination	No pagination
Sync modes	FullIncr.

scraping_jobs
Primary key	id
Pagination	DefaultPaginator
Sync modes	FullIncr.

scraping_job_data_quality
Pagination	No pagination
Sync modes	FullIncr.

Setup

Live in three steps

Get your Web Scrapper credentials from the vendor dashboard or developer settings.
Configure the source in Airbyte with the required connection fields.
Pick a destination, choose streams, set full refresh or incremental, and schedule syncs.

Configuration fields

Web Scrapper configuration fields
Field	Type	Description
api_token*	string	API token to use. Find it at https://cloud.webscraper.io/api

Hybrid deployment

Sovereign by architecture, not by policy.

The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.

Cloud
OSS
Hybrid

Your environment

DataConnectorsCredentialsKeys

↕ metadata only

Airbyte control plane

OrchestrationMonitoringUI

FAQ

Web Scrapper connector questions

What data can I sync from Web Scrapper with Airbyte?

5 streams: sitemap list, sitemap detail, users, scraping jobs, scraping job data quality.

Does the Web Scrapper connector support incremental sync?

The Web Scrapper connector supports full refresh sync. Check the stream list on this page for incremental support per table.

Where can I run the Web Scrapper connector?

Run the Web Scrapper connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.

Didn't find your answer? Talk to sales