- Source
- Warehouses and Lakes
- Alpha
Move Amazon SQS data anywhere it matters.
Load Amazon SQS recievemessage and queueattributes into the warehouse or AI app you already run.
Source
Amazon SQS
Snowflake
BigQuery
Postgres
Databricks
Claude
- Streams
- 2
- Destinations
- 50+
- Standard support
- 1.0.15
Overview
What is the Airbyte Amazon SQS connector?
The Airbyte Amazon SQS connector extracts data from Amazon SQS and loads it into 50+ destinations such as Snowflake, BigQuery, Databricks or Postgres, with full refresh. It publishes 2 streams you can select per connection.
- 01
Sync to your warehouse
Land 2 Amazon SQS tables in 50+ destinations on a schedule you control.
- 02
One authorization
Authenticate Amazon SQS once and Airbyte keeps every scheduled sync running on it.
- 03
Cloud or self-hosted
Run the Amazon SQS connector on Cloud, OSS, Hybrid.
2 streams
Every table you can sync from Amazon SQS
RecieveMessage Sync modes FullIncr. QueueAttributes Sync modes FullIncr.
Setup
Live in nine steps
Log in to your Airbyte account and navigate to the "Destinations" tab.
Click on the "Add Destination" button and select "Amazon SQS" from the list of available connectors.
Enter your AWS access key ID and secret access key in the appropriate fields.
Provide the name of your SQS queue and the AWS region where it is located.
Choose the format in which you want to receive your data (JSON or CSV).
Configure any additional settings, such as message retention period and maximum message size.
Test the connection by clicking on the "Test" button.
If the connection is successful, click on the "Save" button to create the destination connector.
You can now use this connector to send data from your Airbyte sources to your Amazon SQS queue.
Configuration fields
| Field | Type | Description |
|---|---|---|
| access_key* | string | The Access Key ID of the AWS IAM Role to use for pulling messages |
| queue_url* | string | URL of the SQS Queue |
| region* | string | AWS Region of the SQS Queue |
| secret_key* | string | The Secret Key of the AWS IAM Role to use for pulling messages |
| attributes_to_return | string | Comma separated list of Mesage Attribute names to return |
| max_batch_size | integer | Max amount of messages to get in one batch (10 max) |
| max_wait_time | integer | Max amount of time in seconds to wait for messages in a single poll (20 max) |
| target | string | Note - Different targets have different attribute enum requirements, please refer actions sections in https://docs.aws.amazon.com/AWSSimpleQueueService/latest/APIReference/Welcome.html |
Hybrid deployment
Sovereign by architecture, not by policy.
The data plane runs in your environment. Records, credentials and keys stay with you; the control plane only receives configuration and job metadata.
- Cloud
- OSS
- Hybrid
Your environment
Airbyte control plane
Related connectors
FAQ
Amazon SQS connector questions
What data can I sync from Amazon SQS with Airbyte?
2 streams: RecieveMessage, QueueAttributes.
Does the Amazon SQS connector support incremental sync?
The Amazon SQS connector supports full refresh sync. Check the stream list on this page for incremental support per table.
Where can I run the Amazon SQS connector?
Run the Amazon SQS connector on Cloud, OSS, Hybrid. Hybrid deployments keep the data plane in your environment while the control plane orchestrates syncs.
Didn't find your answer? Talk to sales
Start syncing Amazon SQS in minutes.
Free 14-day trial. No credit card needed.