Reward embryology and pretraining origins

Surface biases enter the reward direction before quality features

mixed registered

The reading

  1. surface biases reach half their final loading earlier than quality features

    real_bias_before_quality > 1 0.6 Surface biases enter the reward direction before quality features mixed registered > 1 The frozen study "Surface biases enter the reward direction before quality features", adjudicated on 19 July 2026 at the registered level of the project's evidence ladder. One frozen study, adjudicated once, on skywork-v2-qwen3-0.6b, over ultrafeedback-train-20k. It does not establish that the same holds on another subject, another dataset or another run. entry-ratio point call at the frozen > 1.0, the null median: power equals the null pass rate 0.501, ratios at or above 2.60 confirm at 80 percent, and the s07 plant sits far above that; passes only through the explicit accept-underpowered path. Open the record › refuted

  2. the reward direction settles rather than wandering

    w_r_stabilization_monotone == 1 Surface biases enter the reward direction before quality features mixed registered == 1 The frozen study "Surface biases enter the reward direction before quality features", adjudicated on 19 July 2026 at the registered level of the project's evidence ladder. One frozen study, adjudicated once, on skywork-v2-qwen3-0.6b, over ultrafeedback-train-20k. It does not establish that the same holds on another subject, another dataset or another run. entry-ratio point call at the frozen > 1.0, the null median: power equals the null pass rate 0.501, ratios at or above 2.60 confirm at 80 percent, and the s07 plant sits far above that; passes only through the explicit accept-underpowered path. Open the record › confirmed

EMB-LORA against its frozen predictions: mixed.
EMB-LORA against its frozen predictions: mixed.

Measurements

order_recovery_auc
Surface biases enter the reward direction before quality features mixed registered < 0.5 The frozen study "Surface biases enter the reward direction before quality features", adjudicated on 19 July 2026 at the registered level of the project's evidence ladder. One frozen study, adjudicated once, on skywork-v2-qwen3-0.6b, over ultrafeedback-train-20k. It does not establish that the same holds on another subject, another dataset or another run. entry-ratio point call at the frozen > 1.0, the null median: power equals the null pass rate 0.501, ratios at or above 2.60 confirm at 80 percent, and the s07 plant sits far above that; passes only through the explicit accept-underpowered path. Open the record ›

Provenance

card
EMB-LORA
frozen_at
adjudicated_at
spec_hash
spec:119143a118781b223e14c8cf1ce1c560
study_id
study:campaign-emb-lora@v1#119143a1
power_acceptance
entry-ratio point call at the frozen > 1.0, the null median: power equals the null pass rate 0.501, ratios at or above 2.60 confirm at 80 percent, and the s07 plant sits far above that; passes only through the explicit accept-underpowered path