About the services
About Airbyte
Airbyte is the leading open-source ELT tool, created in July 2020. Airbyte has more than 300 data connectors, and have 40,000 companies using them to sync data, syncing more than 1PB per month. Their ambition is to commoditize data integration by addressing the long tail of connectors through their growing contributor community. Airbyte released a Cloud offer in April 2022 with a new pricing model distinguishing database from APIs and files.
About Fivetran
Fivetran is a closed-source, managed ELT service that was created in 2012. Fivetran has about 200 data connectors and have over 5,000 customers. They are considered a reliable choice and have a large customer base. Fivetran charges on monthly active rows (in other words, the number of rows that have been edited or added in a given month).
Features
Focus
|
ELT as a first step.
Reverse-ETL coming in 2024.
|
ELT.
|
Sources
|
More than 300, 2 years from inception.
|
More than 300.
|
Destinations
|
30+ data warehouses, lakes, databases, and more.
|
10 data warehouses and databases.
|
Customizability of connectors
|
User can edit any pre-built connectors and build new ones within 30 minutes with Airbyte’s Connector Development Kit.
|
Limited through Fivetran’s Cloud functions.
|
Database replication
|
Full table and incremental via change data capture.
Pricing adapted for this use case.
|
Full table and incremental via change data capture.
Pricing is indexed on rows.
|
Integration with data stack
|
Integrate with Kubernetes, Airflow, Prefect, Dagster, and dbt.
|
Integrate with Airflow, Prefect, Dagster, and dbt.
|
Support SLAs
|
Available
|
Available
|
Security certifications
|
SOC 2, ISO 27001, GDPR
|
HIPAA, GDPR, SOC 2
|
Vendor lock-in
|
Airbyte Core and Connectors are open-source.
|
Same as any Cloud product.
|
Purchase process
|
Self-service for Airbyte Cloud.
Open-source edition deployable in minutes.
|
Self-service.
|
Pricing
|
Volume-based pricing differentiating APIs from databases. Credits are rolled over.
|
Free tier limited to 500k MARs (monthly active rows). Volume-based pricing with MARs above this.
|
API
|
Available. CLI also available in Open Source (coming soon on Airbyte Cloud)
|
Available.
|
Connectors
Pre-built connectors are the primary way to differentiate ETL / ELT solutions, as they enable data teams to focus only on the insights to build
Airbyte
Within 3 years from inception, Airbyte already offers connectors for more than 300 data sources, and 50 destinations including all major data warehouses, lakes and databases.
All Airbyte connectors are open-sourced and can be edited to address any custom needs the customers have. Airbyte users can leverage these connectors through the open-source edition or the Cloud offer.
Airbyte’s no-code Connector Builder also enables their users to build custom connectors in a standardized way within 10 minutes (instead of 2 days), and the Airbyte team and community can help in their maintenance.
More than 50% of the connectors have been contributed by the growing community. Airbyte will provide a SLA for the certified connectors, but Airbyte’s ambition is also to provide a SLA for other connectors through the community and its participative model on the long tail of connectors, and to reach 1,000+ connectors in the next few years.
Airbyte will offer reverse-ETL connectors in 2024.
Fivetran
Fivetran offers connectors for about 200 data sources. It supports the major data warehouses and databases as destinations. However, Fivetran doesn’t support any data lakes.
Customers can pay extra and request that Fivetran build a new data source, but no one outside the Fivetran team can build new data sources or make improvements to existing sources.
Fivetran’s customers often end up having to build and maintain custom connectors in-house with their own data engineering teams to address all their custom needs.
Transformation
Airbyte
Airbyte is an ELT tool, and does not transform data prior to loading. Airbyte offers two options to get your data out of the box: a serialized JSON object and the normalized version of the record as tables.
Airbyte also offers custom transformations via SQL and through deep integration with dbt, allowing their users and customers to trigger their own dbt packages at the destination level right after the EL.
Fivetran
Fivetran is an ELT tool, and does not transform data prior to loading, either. It offers its own opinionated normalization out of the box, and recently added support for post-load transformations via copy-and-paste SQL and dbt.
Customizability
Every company has custom data architectures and, therefore, unique data integration needs. A lot of tools don’t enable teams to address those, which results in a lot of investment in building and maintaining additional in-house scripts.
Airbyte
Airbyte’s architecture modularity implies that you can leverage any part of Airbyte. For instance, you can use Airflow’s orchestrator to trigger Airbyte’s ELT jobs.
You can also edit any pre-built connectors to your own specific needs, or even leverage the no-code / low-code Connector Builder to build your own custom connectors in a matter of minutes (instead of days) and have its maintenance shared with the community and the Airbyte team.
Airbyte’s promise is to address all your ELT needs and the long tail of integrations.
Fivetran
Fivetran released cloud functions to let their customers edit connectors by writing small function to fetch data using Go, Java, Node.js, Python, C# or F#. Customers will need to host their functions on a serverless platform.
Support & docs
Data integration tools can be complex, so customers need to have great support channels. This includes online documentation as well as tutorials, email and chat support. More complicated tools may also offer training services.
Airbyte
Airbyte provides in-app chat support with an average time to respond of less than 1 hour.
Their documentation is comprehensive and full of tutorials. Airbyte also has a Slack and Discourse community where help is available from the Airbyte team, other users or contributors.
Airbyte does not provide any training services.
Fivetran
Fivetran provides support through an in-app form, but does not offer chat support.
Their documentation is comprehensive, but Fivetran doesn’t offer a Slack or Discourse community.
Fivetran does not provide any training services.
Pricing
Airbyte
Airbyte provides a 14-day free trial or $1,000 worth of credits, whichever expires first. Airbyte’s pricing is credit-based, and you consume credits based on volume with a different price for APIs, databases and files, which enables it to adapt well to all use cases, including database replication.
Airbyte doesn’t charge for failed syncs or normalization.
Airbyte offers adapted pricing to customers with volume discounts.
Fivetran
Fivetran offers a free tier limited to 500 thousands monthly active rows, i.e., rows that are added or edited in a given month. Fivetran also provides a 14-day free trial on any of their paid plan. It discloses a pricing based on monthly active rows.
Fivetran’s volume-based pricing doesn’t adapt well with database replication use cases that involve the replication of millions of rows.
