weights: allenai/Llama-3.1-Tulu-3-8B-RM

tulu-rm index table (rb2-full)

Metric Value
crystallization tulu-rm index table (rb2-full) Value 0.8405759976579511 Subject tulu-rm Trust Exploratory Evidence ev:5f52a75ef2516724e231ec971560ab54
snr tulu-rm index table (rb2-full) Value 0.9058368993198023 Subject tulu-rm Trust Exploratory Evidence ev:5f52a75ef2516724e231ec971560ab54
contested_loading tulu-rm index table (rb2-full) Value 3.6737993088422973 Subject tulu-rm Trust Exploratory Evidence ev:5f52a75ef2516724e231ec971560ab54
chi_teacher_variance tulu-rm index table (rb2-full) Value 1.438792769578777 Subject tulu-rm Trust Exploratory Evidence ev:5f52a75ef2516724e231ec971560ab54
dark_reward tulu-rm index table (rb2-full) Value 0.7913525891931383 Subject tulu-rm Trust Exploratory Evidence ev:5f52a75ef2516724e231ec971560ab54
k_criteria tulu-rm index table (rb2-full) Subject tulu-rm Trust Exploratory Evidence ev:5f52a75ef2516724e231ec971560ab54
coherence_d_eff tulu-rm index table (rb2-full) Subject tulu-rm Trust Exploratory Evidence ev:5f52a75ef2516724e231ec971560ab54

Every stored observable

The full card: one row per stored Evidence about this model, built with reward_lens.artifacts.card.build_card against the merged campaign store. Values that are payloads (vectors, tables, captures) show their shape. These ids name records in the store itself, whose payload arrays are too large to host; the records this site cites as receipts resolve at /evidence/.

Show all rows
Observable Value Trust Gauge Calibrated Evidence
campaign.bias.battery {name: str, vector: ndarray, labels: list, meta: {effect: str}} E Exploratory invariant no ev:1002d96f817a6a97ef81d3fbda431723
campaign.bias.battery {name: str, vector: ndarray, labels: list, meta: {probe: str}} E Exploratory invariant no ev:e7e225cbd3ded7a3e6b6f280ddf9d1bf
campaign.capture {store_key: str, roster_key: str, slice_name: str, sites: list} E Exploratory invariant no ev:da280f6867a00d7c43321ef6e79c403c
campaign.capture.fp32 {store_key: str, roster_key: str, slice_name: str, sites: list} E Exploratory invariant no ev:ce2836377c2ed9372ff0c7861c6ddbce
campaign.conformance {name: str, columns: list, rows: list, meta: {tol: 0.05, summary: str}} E Exploratory invariant no ev:2d8dac674ee215743d8cb04fb9e3f3d0
campaign.features.internal {item_ids: list, names: list, matrix: ndarray, meta: {site_order: list, contested_correlation: 0.4133, kui_star: str, n_layers: 31}} E Exploratory invariant no ev:5445a4b97dfe7cb3c9c61efb3bc5b308
campaign.features.internal {item_ids: list, names: list, matrix: ndarray, meta: {excluded: list}} E Exploratory invariant no ev:c90b84f86fd66e2055221fef85517658
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:c1a8cfce59e3f06c373634ea401c871a
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:e5f746b9f773eb0af6439bf71e8f1c2a
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:a25dd5b755253b8401907639d876e78e
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:e2dbdd767037aa95913b2651df9775d9
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:076c4faa88eafbc7447e2cf998f65dbf
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:e629e1bf348701c25e53495df408deaf
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:2eb63e3560164adaf6e85ff6557edb20
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:72ce4bb5a0bf101eb4834f6d14580309
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:c6837d63d76220ab972aea9e3b435f16
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:4ef2bf0ab4ee53839e79c53dcd307384
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:2ce90facaeed49bbe9019a09ad0044df
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:da69b744d9570f9ffbb548608497d48b
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:d9198ef3cfe385a03e89ba297c30abe1
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:6ebd52f7bddb6e9b47c65fc63a1b9da7
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:a63f11e8ab07b9b7c185a59a57a40ab1
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:e794781a4d47ae84bde49cce0b780bbb
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:00e8f1230ebad88cb73abbc972ed1aba
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:4b43696d26ced0ea0a2ffc1b10b5659f
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:209f64ba4d3e7944789f98d8f222ddf2
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:bde556c34f40659b3c6e822209dacbd2
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:3c7d7f973c7d82781a40d051c2689a38
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:85de85e718609d4e17489453946f899d
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:bcde02db98e48e46d121a029e916815f
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:9c85ece84101180207e3cddf93e0f0a3
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:f0c06c490b05a8ff9e3826f15f5b831f
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:c09f7bcb9d0cccbe32cebf88344e6af8
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:c6cfad51a19969692d77d2dd8f0832b6
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:f5bee9311a96f084000169f20881e84f
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:18e836c8687017fa13160b118b9e2f68
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:122e72c3301277a61ea6bb7d397c1893
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E Exploratory invariant no ev:0826b8a0a9b0a6d4264de24727597a31
campaign.index.table {name: str, columns: list, rows: list, meta: {roster_key: str, slice: str}} E Exploratory invariant no ev:5f52a75ef2516724e231ec971560ab54
campaign.index.table {name: str, columns: list, rows: list, meta: {star: str, control: str}} E Exploratory invariant no ev:5b695916203848160276a32a9b68b806
campaign.index.table {name: str, columns: list, rows: list, meta: {orientation: str}} E Exploratory invariant no ev:a6ff0a075d33604f5eae7833baa77729
campaign.lens.trajectory {name: str, vector: ndarray, labels: list, meta: {}} E Exploratory invariant no ev:af1d9fea23f09b0ed3caaecb24558320
campaign.rb2.category_accuracy {name: str, columns: list, rows: list, meta: {excluded_calibration_rows: 200, exclusion: str}} E Exploratory invariant no ev:680b1a38cb4707a404f34774bb807a44
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {derived_from: str, readout: str, subsets: list}} E Exploratory invariant no ev:af15b5e863c13907e1cd0227113cff62
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 7962}} E Exploratory invariant no ev:bd729e7f7bf2a162058308aed97562b4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 7962}} E Exploratory invariant no ev:52cc052cbea23f4fceb82dab4909f4e9
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 7962}} E Exploratory invariant no ev:c1a12be6d39c0f9709d946f68e155e09
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 7962}} E Exploratory invariant no ev:20267344b789260d72c4d544ccb67836
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 7962}} E Exploratory invariant no ev:c797fe3372a92484dfd23711d3b3f623
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 7962}} E Exploratory invariant no ev:4cd2f021cd0d741ef5863022f9c0cd75
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 7962}} E Exploratory invariant no ev:019bb3439d8b9f821641b1e3b1e543f7
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 7962}} E Exploratory invariant no ev:995127b065d549f5a2a3c2696f67278a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 7962}} E Exploratory invariant no ev:139ae512f937aab585db718cc00aa575
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 7962}} E Exploratory invariant no ev:5f73a5ac519596c0d4c8bdb5459cc309
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 7962}} E Exploratory invariant no ev:ac4c1b4bad9cf6816d857bf54c325b6e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 7962}} E Exploratory invariant no ev:28d42f9ba6463ad5d9c70ba6ac45b18a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 7962}} E Exploratory invariant no ev:db25748aeb8b6e9586b26de07292d484
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 7962}} E Exploratory invariant no ev:c25a324916bac1cc0d0005a5eaeaf5df
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 7962}} E Exploratory invariant no ev:0aa0c8a0a6fbba4f70f0be9f0542fc32
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 7962}} E Exploratory invariant no ev:ba46a491ac7e3b3a334d99e2578dcea9
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {tiers: list, columns: list}} E Exploratory invariant no ev:9b3e5ba736a4bf80027c9467f4e3b6bb
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 168}} E Exploratory invariant no ev:676e22409888e0dc3652af17d78dc368
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list, axes: list}} E Exploratory invariant no ev:c7f48959637241d3e58a1ad58b5b8afe
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 216}} E Exploratory invariant no ev:372f9a45b4419464096e5546de721e9c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list, families: list}} E Exploratory invariant no ev:9b6d8672a8bb9a867aa1ef51311e2c70
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 4000}} E Exploratory invariant no ev:81f7cb9a91dac614fb988cf1df20f154
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 4000}} E Exploratory invariant no ev:1a8a562baf5df87f3887749ffda818a4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 4000}} E Exploratory invariant no ev:c8d82c398dc256834ef3995da7e55c22
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 4000}} E Exploratory invariant no ev:106609b7efda02b523eb3be298ce1b34
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 4000}} E Exploratory invariant no ev:90e7d342a25ac3cbe990af5d79dbfa21
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 4000}} E Exploratory invariant no ev:315e3ac8d71da5870330e7560f818f62
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 4000}} E Exploratory invariant no ev:1f1ef97917ea9fbf6e6139cf2d02b343
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 4000}} E Exploratory invariant no ev:f903e51758c0f16c59b1c46131e2f856
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {margin: str}} E Exploratory invariant no ev:7774c6f055a9b170e7296dcb39936ca9
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 4800}} E Exploratory invariant no ev:087091d8bfb9db89de205dadf5964922
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 4800}} E Exploratory invariant no ev:1f30332fb2e16656c452960bdfe46458
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 4800}} E Exploratory invariant no ev:5df5d0c8db1ebd9c9ddcd3dd8dea5178
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 4800}} E Exploratory invariant no ev:f29b9b8c845b9a81fbeca260bf2d0704
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 4800}} E Exploratory invariant no ev:854a654e0aecb61097b8a533b00f2aaa
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 4800}} E Exploratory invariant no ev:ab06b448a45bcc71f6d677acbe7ce0b6
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 4800}} E Exploratory invariant no ev:0b77982eb7835f9b86a183bbfb33f03d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 4800}} E Exploratory invariant no ev:edb42a1ceefd2a89531a9b0a4978f856
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 4800}} E Exploratory invariant no ev:2bd91bec6b5f04d6adef4985f7ead92d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 4800}} E Exploratory invariant no ev:fa0c96b6bae71c1d11eacd6de1066832
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list}} E Exploratory invariant no ev:c97714288e8bf976d8ffb5ae589c6c3e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list, derived_from: str, derivation: str, indexed_rows: 200}} E Exploratory invariant no ev:21264272fe15595055850489e44a0002
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list, derived_from: str, derivation: str, indexed_rows: 512}} E Exploratory invariant no ev:5fa7e8d786dacb927fbee2f211c303d0
campaign.subspace {name: str, matrix: ndarray, row_labels: list, col_labels: list} E Exploratory invariant no ev:a21fb1ed8b48aeb2c045b18b2895de0d
campaign.subspace {name: str, matrix: ndarray, row_labels: list, col_labels: list} E Exploratory invariant no ev:0c45dbfebd245af9a1c36489a53b779b
campaign.w_r {name: str, vector: ndarray, labels: list, meta: {readout: str, site: str}} E Exploratory invariant no ev:be350eec750bb0d9156457d680b5f04b

Source: the merged campaign evidence store, opened read-only; card built at site build time. The store itself is not published; its projections and provenance manifest are in the site repository.