Détails

Source

TAO Daily

Publication

28 août à 16h33

Lien direct

https://taodaily.io/numinous-sn6-just-overhauled-how-it-grades-miner-forecasts/

Contenu source (brut)

<p class="wp-block-paragraph">Predicting a market&#8217;s next move is a different skill from predicting an actual outcome, and <a href="https://taodaily.io/numinous-rebuilds-sn6-to-reward-forecasters-who-move-first/">Numinous (SN6)</a> had been grading miners mostly on the first one.</p> <p class="wp-block-paragraph">The subnet published a scoring overhaul that keeps every forecast live from day seven until the event resolves, with the grade updating daily against whatever price the market currently shows.</p> <p class="wp-block-paragraph">Miners now get progressively tested against the truth as it comes into focus rather than judged on a single week-old snapshot forever.</p> <p class="wp-block-paragraph">The leaderboard becomes a rolling mark-to-market view of every open prediction across the entire miner population.</p> <h2 class="wp-block-heading">What Changed</h2> <p class="wp-block-paragraph">The design difference between the old scoring rule and the new one is at the heart of everything the overhaul produces.</p> <figure class="wp-block-table"><table class="has-fixed-layout"><tbody><tr><td><strong>Dimension</strong></td><td><strong>Old Scoring</strong></td><td><strong>New Scoring</strong></td></tr><tr><td>When forecasts get graded</td><td>Once, at day seven</td><td>Every day from day seven until resolution</td></tr><tr><td>What each grade measures</td><td>Market price at day seven</td><td>Whatever price the market shows on that day</td></tr><tr><td>Final grade at event resolution</td><td>Ignored entirely</td><td>Equals the true difficulty-adjusted Brier score</td></tr><tr><td>Leaderboard behaviour</td><td>Frozen totals of week-old scores</td><td>Live mark-to-market of every open forecast</td></tr><tr><td>Score target over time</td><td>Never changes after day seven</td><td>Sharpens as the market absorbs more information</td></tr></tbody></table></figure> <p class="wp-block-paragraph">The stale snapshot got replaced by a continuous grading pipeline that converges toward outcome truth.</p> <h2 class="wp-block-heading">Why the Change Matters</h2> <p class="wp-block-paragraph">The design tension every forecasting subnet faces is whether to reward immediate signal or eventual accuracy, and Numinous just picked accuracy.</p> <figure class="wp-block-table"><table class="has-fixed-layout"><tbody><tr><td><strong>What Improves</strong></td><td><strong>Effect on Miners</strong></td></tr><tr><td>Genuine forecasting skill</td><td>Outranks market-timing skill because being right about the outcome carries more weight than anticipating short-term herd behaviour</td></tr><tr><td>Resistance to arbitrage</td><td>Private information advantage narrows every day the forecast stays open, since the market absorbs whatever edge miners started with</td></tr><tr><td>Honesty of the incentive</td><td>Optimal report at every horizon remains a miner&#8217;s true belief about the outcome, keeping the mechanism gameable-resistant</td></tr><tr><td>Uncertainty profile</td><td>New source appears from unresolved events, adding mark-to-market volatility on top of sampling uncertainty from forecast count</td></tr></tbody></table></figure> <p class="wp-block-paragraph">Skill compounds very well under this system while short-term gaming produces diminishing returns as events approach resolution.</p> <h2 class="wp-block-heading">Grading That Follows the Truth</h2> <p class="wp-block-paragraph">Forecasting subnets that measure the wrong signal train miners to optimize for the wrong outcome. Numinous just closed that loop by keeping every forecast open until the underlying event resolves.</p> <p class="wp-block-paragraph">The leaderboard now delivers what the subnet always promised its buyers: rankings measured against outcomes rather than proxies.</p> <p class="wp-block-paragraph">That change should attract exactly the kind of quantitative forecaster the subnet needs to reach commercial scale.</p> <p class="wp-block-paragraph">More on Numinous (SN6) below:</p> <figure class="wp-block-embed is-type-wp-embed is-provider-the-tao-daily wp-block-embed-the-tao-daily"><div class="wp-block-embed__wrapper"> <blockquote class="wp-embedded-content" data-secret="GWNQnWo29R"><a href="https://taodaily.io/numinous-rebuilds-sn6-to-reward-forecasters-who-move-first/">Numinous Rebuilds SN6 to Reward Forecasters Who Move First</a></blockquote><iframe class="wp-embedded-content" sandbox="allow-scripts" security="restricted" style="position: absolute; visibility: hidden;" title="“Numinous Rebuilds SN6 to Reward Forecasters Who Move First” — The TAO Daily" src="https://taodaily.io/numinous-rebuilds-sn6-to-reward-forecasters-who-move-first/embed/#?secret=5hNbOMIcbk#?secret=GWNQnWo29R" data-secret="GWNQnWo29R" width="500" height="282" frameborder="0" marginwidth="0" marginheight="0" scrolling="no"></iframe> </div></figure>