reward-lens

Values, pluralism and paradigm physiology

Contested-direction loading predicts human rater disagreement

inconclusive registered

The reading

  1. contested-direction loading predicts per-item human rater disagreement

    contested_raterspread_spearman > 0.2 0.55 not measured inconclusive

  2. single-model contested loading comes within 0.05 of the 5x-cost ensemble baseline

    ensemble_minus_contested_spearman < 0.05 not measured inconclusive

VALUES-CONTEST was not adjudicated this run: missing intermediate: no intermediate 'campaign.scores' for roster_key='armorm' slice='helpsteer3-pref-2000'; the arc that produces it has not run or its shard was not merged.
VALUES-CONTEST was not adjudicated this run: missing intermediate: no intermediate 'campaign.scores' for roster_key='armorm' slice='helpsteer3-pref-2000'; the arc that produces it has not run or its shard was not merged.

Provenance

card
VALUES-CONTEST
frozen_at
adjudicated_at
spec_hash
spec:2a1ead40948d8a58ae00bf095cad321f
study_id
study:campaign-values-contest@v1#2a1ead40
Evidence records
e036326c47c7a0f52330559479e03790
spec_file
campaign-values-contest.json