Method note / Proposed study
Do validators agree on the top miner?
Count how often two validators give their highest weight to the same miner in the same round.
Read the study method
- Pick one subnet and scoring mechanism. Record 30 consecutive scoring rounds and take each validator’s latest weights revealed within each round.
- Include validators with fresh weights and one miner with a uniquely highest positive weight. Count every eligible pair once and record ties and missing submissions separately.
- Divide the number of pairs that chose the same miner by the total number of eligible pairs. Mark rounds with zero eligible pairs as unavailable.
This measures ranking agreement. A separate comparison against ground truth would measure accuracy.