Start by visiting the US Census Bureau's website to locate the specific dataset you need. Navigate to the "Data" section, search for the dataset, and download it in a format compatible with SQL Server, such as CSV or Excel.

Open the downloaded file in a spreadsheet application like Microsoft Excel or a text editor. Clean the data by removing any unnecessary columns or rows, ensuring that the column names are clear, and checking that there are no missing values or special characters that might cause issues during import.

Open SQL Server Management Studio (SSMS) and connect to your SQL Server instance. Create a new database if necessary using the following SQL command:
```sql
CREATE DATABASE CensusData;
```
Then, create a table to match the structure of your cleaned data:
```sql
USE CensusData;
CREATE TABLE CensusTable (
Column1 DATA_TYPE,
Column2 DATA_TYPE,
...
);
```
Replace `Column1`, `Column2`, etc., with your actual column names and appropriate SQL data types.

If your data file is in Excel format, save it as a CSV file. Ensure that the file is saved with a delimiter (usually a comma) and that the first row contains the column headers.

Use the `BULK INSERT` SQL command to import the data into your SQL Server table. Execute the following command in SSMS, adjusting the file path and other parameters as needed:
```sql
BULK INSERT CensusTable
FROM 'C:\\Path\\To\\Your\\File.csv'
WITH (
FIELDTERMINATOR = ',',
ROWTERMINATOR = '\n',
FIRSTROW = 2
);
```
This command specifies the delimiter and starts the import from the second row, assuming the first row contains headers.

After the import, run a simple `SELECT` query to verify that the data has been imported correctly:
```sql
SELECT TOP 10 FROM CensusTable;
```
Check that the data appears as expected without any missing or malformed entries.

If you need to perform this data import regularly, consider automating the process using SQL Server Agent to schedule the `BULK INSERT` task or create a stored procedure. This will save time and reduce the risk of errors in future data imports.

By following these steps, you can manually move data from the US Census website to an MS SQL Server database without relying on third-party tools or connectors.