Connectors

/

AWS CloudTrail

Data replication

Sync AWS CloudTrail data anywhere.

AWS CloudTrail is a web service developed to simplify and provide assistance with AWS accounts. Enabling compliance, governance, and operational and risk auditing, it allows users to monitor, log, and document AWS account-related activity in an easily searchable format. With its comprehensive account event history function, CloudTrail helps users analyze and troubleshoot security and operational issues, detect unusual account activity, and much more by increasing visibility into customers’ user and resource activity.

  • Standard
  • Alpha
  • 1 stream
Sync AWS CloudTrail dataRead the docs
AWS CloudTrail

One connector

Everything AWS CloudTrail can do in Airbyte

  • Sync to your warehouse

    Land 1 AWS CloudTrail table in 50+ destinations on a schedule you control.

    Sync to your warehouse

    Land 1 AWS CloudTrail table in 50+ destinations on a schedule you control.

  • Incremental syncs

    Pull only the records that changed since the last run instead of reloading everything.

    Incremental syncs

    Pull only the records that changed since the last run instead of reloading everything.

  • One authorization

    Authenticate AWS CloudTrail once and Airbyte keeps every scheduled sync running on it.

    One authorization

    Authenticate AWS CloudTrail once and Airbyte keeps every scheduled sync running on it.

  • Cloud or self-hosted

    Run the AWS CloudTrail connector on Cloud, Self-Managed Enterprise.

    Cloud or self-hosted

    Run the AWS CloudTrail connector on Cloud, Self-Managed Enterprise.

Specifications

What to know before you sync AWS CloudTrail

  • Support levelStandard
  • Available onCloud, Self-Managed Enterprise
  • Connector version1.1.0
  • Release stageAlpha

Sync capabilities

  • Full Refresh SyncSupported
  • Incremental SyncSupported
  • NamespacesNot supported
  • Destinations50+ Airbyte connectors

Set up in 15 steps

  1. First, navigate to the AWS Management Console and log in to your account.
  2. Once logged in, search for the CloudTrail service and select it.
  3. In the CloudTrail dashboard, select the Trails option from the left-hand menu.
  4. Click on the name of the trail you want to use as your source connector.
  5. In the trail details page, scroll down to the section labeled "Management events" and click on the "Edit" button.
  6. In the "Data events" section, click on the "Add data event" button.
  7. Select the type of data event you want to capture and configure the settings as needed.
  8. Once you have configured the data event, click on the "Save" button to save your changes.
  9. Next, navigate to the Airbyte dashboard and select the "Sources" option from the left-hand menu.
  10. Click on the "Create a new source" button and select the AWS CloudTrail connector.
  11. Enter your AWS access key ID and secret access key in the appropriate fields.
  12. Enter the name of the S3 bucket where your CloudTrail logs are stored.
  13. Enter the name of the CloudTrail trail you want to use as your source connector.
  14. Click on the "Test" button to ensure that your credentials are valid and that Airbyte can connect to your CloudTrail logs.
  15. Once the test is successful, click on the "Create" button to create your AWS CloudTrail source connector in Airbyte.

1 stream

Every table you can sync from AWS CloudTrail

  • Management Events

Authentication

Authenticate AWS CloudTrail once

  • API credentials

    Requires Key ID and Secret Key.

    API credentials

    Requires Key ID and Secret Key.

Explore

Related connectors

AirbyteEngineering AnalyticsStandard Sources cloudself-managed-enterprise
AshbyEngineering AnalyticsStandard Sources cloudself-managed-enterprise
Auth0Engineering AnalyticsStandard Sources cloudself-managed-enterprise
BasecampEngineering AnalyticsStandard Sources cloudself-managed-enterprise
BugsnagEngineering AnalyticsStandard Sources cloudself-managed-enterprise
BuildkiteEngineering AnalyticsStandard Sources cloudself-managed-enterprise
All connectors

Common questions

Didn't find your answer?
Please don't hesitate to reach out.

Talk to sales

ETL, an acronym for Extract, Transform, Load, is a vital data integration process. It involves extracting data from diverse sources, transforming it into a usable format, and loading it into a database, data warehouse or data lake. This process enables meaningful data analysis, enhancing business intelligence.

AWS CloudTrail provides access to a wide range of data related to AWS account activity and resource usage. The following are the categories of data that can be accessed through the API:

1. Event history: This includes information about all the events that have occurred in an AWS account, such as API calls, console sign-ins, and resource changes.
2. Resource activity: This category includes data related to the usage of AWS resources, such as EC2 instances, S3 buckets, and RDS databases.
3. User activity: This category includes data related to user activity in an AWS account, such as user sign-ins, password changes, and access key usage.
4. Security analysis: This category includes data related to security events in an AWS account, such as failed login attempts, unauthorized access attempts, and changes to security groups.
5. Compliance auditing: This category includes data related to compliance auditing in an AWS account, such as changes to IAM policies, CloudTrail configuration changes, and VPC network changes.

Overall, the AWS CloudTrail API provides a comprehensive view of AWS account activity and resource usage, making it a valuable tool for monitoring and managing AWS environments.

1. First, navigate to the AWS Management Console and log in to your account.
2. Once logged in, search for the CloudTrail service and select it.
3. In the CloudTrail dashboard, select the Trails option from the left-hand menu.
4. Click on the name of the trail you want to use as your source connector.
5. In the trail details page, scroll down to the section labeled "Management events" and click on the "Edit" button.
6. In the "Data events" section, click on the "Add data event" button.
7. Select the type of data event you want to capture and configure the settings as needed.
8. Once you have configured the data event, click on the "Save" button to save your changes.
9. Next, navigate to the Airbyte dashboard and select the "Sources" option from the left-hand menu.
10. Click on the "Create a new source" button and select the AWS CloudTrail connector.
11. Enter your AWS access key ID and secret access key in the appropriate fields.
12. Enter the name of the S3 bucket where your CloudTrail logs are stored.
13. Enter the name of the CloudTrail trail you want to use as your source connector.
14. Click on the "Test" button to ensure that your credentials are valid and that Airbyte can connect to your CloudTrail logs.
15. Once the test is successful, click on the "Create" button to create your AWS CloudTrail source connector in Airbyte.

The most prominent ETL tools to transfer data to include: Airbyte, Fivetran, StitchData, Matillion, Talend Data Integration. These tools help in extracting data from various sources (APIs, databases, and more), transforming it efficiently, and loading it into and other databases, data warehouses and data lakes, enhancing data management capabilities.

ELT, standing for Extract, Load, Transform, is a modern take on the traditional ETL data integration process. In ELT, data is first extracted from various sources, loaded directly into a data warehouse, and then transformed. This approach enhances data processing speed, analytical flexibility and autonomy.

ETL and ELT are critical data integration strategies with key differences. ETL (Extract, Transform, Load) transforms data before loading, ideal for structured data. In contrast, ELT (Extract, Load, Transform) loads data before transformation, perfect for processing large, diverse data sets in modern data warehouses. ELT is becoming the new standard as it offers a lot more flexibility and autonomy to data analysts.

Start moving AWS CloudTrail data today

Free for 14 days on Airbyte Cloud. Set up the AWS CloudTrail connector once and let Airbyte keep it in sync.

Try it freeTalk to sales