How to load data from BigQuery to DynamoDB

Install and configure the Google Cloud SDK and AWS CLI on your local machine or cloud-based VM. This will enable you to interact with BigQuery and DynamoDB programmatically.
- For Google Cloud SDK, download and install it from [Google Cloud's official site](https://cloud.google.com/sdk/docs/install) and authenticate using `gcloud init`.
- For AWS CLI, download and install it from [AWS CLI's official site](https://aws.amazon.com/cli/) and configure it using `aws configure` with your access keys and preferred region.

Use BigQuery's export functionality to move data to Google Cloud Storage (GCS) as CSV or JSON files.
- Use the `bq extract` command for exporting data:
```
bq extract --destination_format CSV 'project_id:dataset.table' gs://your-bucket-name/filename.csv
```
- Ensure the Google Cloud Storage bucket is accessible and that you have the necessary permissions.

Using the Google Cloud SDK, download the exported data files from GCS to your local machine or a compute instance.
- Use the `gsutil` command to download the files:
```
gsutil cp gs://your-bucket-name/filename.csv /local/path/
```

Convert the downloaded data into a format suitable for DynamoDB. This usually involves transforming the data into JSON and organizing it to match your DynamoDB table’s schema.
- Write a script in Python or another language to read the CSV/JSON file, process each record, and convert it to a JSON object compatible with DynamoDB.
- Ensure the data types and attribute names conform to your DynamoDB table structure.

Use AWS SDKs to write a script that reads the prepared data and imports it into DynamoDB.
- Utilize the `boto3` library for Python to interact with DynamoDB:
```python
import boto3

dynamodb = boto3.resource('dynamodb', region_name='your-region')
table = dynamodb.Table('your-table-name')

# Example function to put a single item
def put_item(item):
table.put_item(Item=item)
```
- Loop through your JSON data and call the `put_item` function for each entry.

DynamoDB supports batch write operations, which can be more efficient than writing items one by one.
- Modify your script to use `batch_write_item` to send batches of up to 25 items at a time.
```python
with table.batch_writer() as batch:
for item in items:
batch.put_item(Item=item)
```

After importing the data, verify that the data in DynamoDB matches the original data from BigQuery.
- Run queries in DynamoDB to ensure all records are present and check a sample of the data for accuracy.
- Consider implementing checksums or hash totals to validate data integrity.

By following these steps, you can effectively move data from BigQuery to DynamoDB without relying on third-party connectors or integrations, using native tools and scripting.