Data Universe

Clone the data-universe repository

git clone https://github.com/RusticLuftig/data-universe.git

Create and activate a Python virtual environment (or use Conda)

cd data-universe && python -m venv venv && source venv/bin/activate

Install the data-universe package and dependencies

python -m pip install -e .

Create a Bittensor wallet and register a hotkey (see Bittensor docs)

btcli wallet new_coldkey --wallet.name your-wallet && btcli wallet new_hotkey --wallet.name your-wallet --wallet.hotkey your-hotkey

Register your hotkey on Subnet 13

btcli subnets register --wallet.name your-wallet --wallet.hotkey your-hotkey --netuid 13

Set up optional .env file with API tokens (Apify for X/Reddit scraping, or Reddit OAuth credentials)(optional)

echo 'APIFY_API_TOKEN="your_token"' > .env

Start the miner using pm2 (install pm2 first if needed: npm install -g pm2)

pm2 start python -- ./neurons/miner.py --wallet.name your-wallet --wallet.hotkey your-hotkey

Verify the miner is actually scraping data (check logs for successful scrapes)

pm2 logs <process-name> | grep -i 'scrap\|status 403\|status 401'

Clone the data-universe repository

git clone https://github.com/RusticLuftig/data-universe.git

Create and activate a Python virtual environment (or use Conda)

cd data-universe && python -m venv venv && source venv/bin/activate

Install the data-universe package and dependencies

python -m pip install -e .

Create a Bittensor wallet and register a hotkey

btcli wallet new_coldkey --wallet.name your-wallet && btcli wallet new_hotkey --wallet.name your-wallet --wallet.hotkey your-hotkey

Register your hotkey on Subnet 13

btcli subnets register --wallet.name your-wallet --wallet.hotkey your-hotkey --netuid 13

Set up .env file with API tokens (Apify required for validators; Reddit OAuth optional)

echo 'APIFY_API_TOKEN="your_token"
REDDIT_CLIENT_ID="..."
REDDIT_CLIENT_SECRET="..."' > .env

Start the validator with auto-updates (recommended; requires pm2 and git)(optional)

pm2 start --name net13-vali-updater --interpreter python scripts/start_validator.py -- --pm2_name net13-vali --wallet.name your-wallet --wallet.hotkey your-hotkey

Alternatively, start the validator without auto-updates(optional)

pm2 start python -- ./neurons/validator.py --wallet.name your-wallet --wallet.hotkey your-hotkey