NexisGen

Nexisgen is a Bittensor subnet where miners produce interval-based video clip datasets (with captions and metadata) and validators verify dataset integrity, score miners, and submit chain weights. Miners collect YouTube video clips, generate captions from timeline-sampled frames, and upload parquet datasets with manifests to Cloudflare R2 storage every 50 blocks. Validators download submissions, perform schema/integrity/asset verification, run optional semantic and category checks, prune overlaps using a shared index, and compute miner scores based on validation sampling.

Miners run a continuous loop that: (1) discovers new 50-block intervals from chain, (2) collects YouTube video clips using yt-dlp, (3) generates clip records with captions from timeline-sampled frames, (4) writes interval package (dataset.parquet + manifest.json), (5) uploads to Cloudflare R2 bucket. Validators run a continuous loop that: (1) discover active miners via metagraph and committed on-chain credentials, (2) download each miner's interval packages, (3) validate via multi-layer checks (manifest identity, integrity, schema, asset verification, sampled semantic/category validation), (4) prune rows using shared overlap index from owner validator, (5) arbitrate same-interval cross-miner conflicts by earliest manifest timestamp, (6) compute per-miner scores, (7) accumulate scores over 250-block windows and submit set_weights to chain. Owner-validator is a special validator instance that additionally publishes accepted metadata bundles and overlap index snapshots to shared buckets for other validators to use.

Docker Compose orchestrates validator + watchtower for automated image updates.

Validators sample rows from each miner submission (sample_rate=0.25, min=2, max=35 rows per interval; for each miner, if row_count<=10 sample all, else sample 20% capped at 10). Hard checks run on full dataset (schema, source URLs, overlap, captions). Sampled rows undergo additional expensive checks (asset verification, semantic caption validation, category validation).

Accepted intervals contribute to miner score; rejected intervals contribute zero. Failure types include non-YouTube sources, schema violations, asset hash mismatches, caption mismatches, overlap violations, source authenticity failures, and category validation failures. Validators maintain rolling 10-interval failure lookback and can dampen/zero recent hard-failure miners.

API-backed invalid hotkey lists (interval_id-500 to interval_id) are fetched and applied before weight submission.