Evidence records
Contested-direction loading predicts human rater disagreement
Store key
campaign.adjudication.VALUES-CONTEST The reading
- H-contest inconclusive
- H-contest-vs-ensemble inconclusive
registered
- card
- VALUES-CONTEST
- status
- inconclusive
- reason
- missing intermediate: no intermediate 'campaign.scores' for roster_key='armorm' slice='helpsteer3-pref-2000'; the arc that produces it has not run or its shard was not merged
- killed
- false
- staged_violation
- false
- pre_freeze_violation
- false
Uncertainty
- ci_low
- not measured
- ci_high
- not measured
- ci_level
- not measured
- n
- not measured
- n_effective
- not measured
- seed_spread
- not measured
- method
- none
Subject
- card
- VALUES-CONTEST
- spec
- campaign-values-contest
- signals
- not measured
- dataset
- not measured
- readout
- not measured
- frame
- not measured
- interventions
- not measured
- gauge
- invariant
- calibration
- not measured
- observable_version
- 1.0
- trust
- registered
Measurements
metrics
No rows returned.
thresholds
- H-contest
- 0.2
- H-contest-vs-ensemble
- 0.05
comparators
- H-contest
- >
- H-contest-vs-ensemble
- <
kill_thresholds
- K-contest
- 0
kill_comparators
- K-contest
- <=
killed_by
No rows returned.
overlay_notes
No rows returned.
Provenance
- git_sha
- f93f4b5578c221d3d2665f9b305f3e86759be862+dirty
- study
- study:campaign-values-contest@v1#2a1ead40
- config_hash
- not measured
- gpu_seconds
- 0
- tokens
- 0
- wall_seconds
- 0
- gpu
- cpu
- arc
- reporting
- seeds
- not measured
- oracle_calls
- not measured
- created_at
- parents, Derived from
- not measured
Rendered on
ev:e036326c47c7a0f52330559479e03790