Loading
Loading
This information was auto-extracted from the GitHub repository and may be incomplete or out of date. Always refer to the subnet's GitHub repository for the latest instructions.
Qwen3.6-35B-A3B (35GB) runs on 2x RTX 4090 or better. Reference config: 4x RTX 4090 with tensor-parallelism. Model checkpoint must be on local disk. sglang serve required with --enable-return-hidden-states flag and miner folder on PYTHONPATH. No inbound ports required.
Light validator is CPU-only. Requires unencrypted Bittensor wallet at ~/.bittensor/wallets with hotkey registered on netuid 53 with validator permit. Uses named Docker volume for state persistence across restarts.
Install sglang serving framework and miner dependencies
pip install 'sglang>=0.4.6' toploc transformers torch numpy requests websockets
Place the miner script and Qwen3.6-35B-A3B model checkpoint on the mining node
# Copy miner/engy_miner.py to target node and download model checkpoint to local disk
Get a miner key from the provider dashboard
# Register at provider.engy.ai to obtain MINER_KEY
Start sglang serve with hidden states enabled and parser flags for agentic buyers. Adjust --tp-size and --max-running-requests based on your hardware.
PYTHONPATH=/path/to/engy/miner python -m sglang.launch_server --model-path /data/models/Qwen/Qwen3.6-35B-A3B-FP8 --served-model-name Qwen3.6 --tp-size 4 --trust-remote-code --kv-cache-dtype fp8_e4m3 --mem-fraction-static 0.83 --chunked-prefill-size 8192 --max-running-requests 8 --context-length 262144 --enable-return-hidden-states --enable-cache-report --tool-call-parser qwen3_coder --reasoning-parser qwen3 --host 0.0.0.0 --port 8000
Wait for sglang serve to be ready
curl -s http://127.0.0.1:8000/get_model_info >/dev/null && echo 'serve up'
Start the miner, connecting to the gateway and serving on local sglang. MAX_INFLIGHT is total concurrent requests (minimum 8, typically equals --max-running-requests times data-parallel size)
GW=wss://api.engy.ai/gw MINER_KEY=<your-key> MODEL=qwen3.6-35b-a3b MAX_INFLIGHT=<serve-concurrency> python miner/engy_miner.py --checkpoint /data/models/Qwen/Qwen3.6-35B-A3B-FP8 --serve-url http://127.0.0.1:8000
Clone the subnet repository
git clone https://github.com/hanlinai/engy && cd engy
Copy example environment file for validator configuration
cp .env.validator.example .env.validator
Configure wallet names in .env.validator
# Edit .env.validator and set ENGY_SN53_WALLET and ENGY_SN53_WALLET_HOTKEY to your wallet names (as shown by 'btcli wallet list')
Start the validator container with Docker Compose (includes auto-updating Watchtower)
docker compose --env-file .env.validator -f docker/docker-compose.validator.yml up -d
Watch validator logs to confirm startup and verify the wallet/hotkey is correct
docker compose -f docker/docker-compose.validator.yml logs -f validator
Check validator health status(optional)
docker inspect -f '{{.State.Health.Status}}' engy_sn53_validator