How to load data from Alpha Vantage to Clickhouse

To access Alpha Vantage data, first, sign up at the Alpha Vantage website and obtain an API key. This key is essential for authenticating your requests to the Alpha Vantage API.

Ensure you have `curl` or `wget` installed on your system to make HTTP requests, and `clickhouse-client` to interact with your ClickHouse database. These tools are typically available on most Unix-like operating systems.

Use `curl` or `wget` to fetch data from Alpha Vantage. Construct the HTTP GET request using your API key and desired parameters. For example, to get time series data for a stock, you might use:
```bash
curl "https://www.alphavantage.co/query?function=TIME_SERIES_DAILY&symbol=IBM&apikey=YOUR_API_KEY&datatype=csv" -o data.csv
```
Replace `YOUR_API_KEY` with your actual API key and adjust the parameters as needed for your data requirements.

Set up a table in your ClickHouse database to store the data. Connect to your ClickHouse server using `clickhouse-client` and create a table with the appropriate schema. For instance:
```sql
CREATE TABLE IF NOT EXISTS stock_data (
date Date,
open Float32,
high Float32,
low Float32,
close Float32,
volume UInt64
) ENGINE = MergeTree()
ORDER BY date;
```

Ensure the CSV data fetched from Alpha Vantage is formatted correctly for importing into ClickHouse. This might include removing headers, ensuring date formats are correct, and matching column order with your ClickHouse table schema.

Use the `clickhouse-client` to import the CSV data into the ClickHouse table. For example:
```bash
clickhouse-client --query="INSERT INTO stock_data FORMAT CSV" < data.csv
```
This command reads `data.csv` and inserts it into the `stock_data` table in your ClickHouse database.

Finally, verify that the data has been successfully imported into ClickHouse by running a simple query to check the data:
```sql
SELECT * FROM stock_data LIMIT 10;
```
Ensure the output matches your expectations and that the data has been correctly parsed and stored.

By following these steps, you can manually move data from Alpha Vantage to a ClickHouse warehouse without relying on third-party connectors or integrations.