atlas

skywork-v2-llama31-8b

299 stored measurements; 4,089 GPU-seconds metered, summed over this model’s records (the method page groups spend by arc, a different total).

weights: Skywork/Skywork-Reward-V2-Llama-3.1-8B

skywork-v2-llama31-8b index table (rb2-full)

Metric Value
crystallization skywork-v2-llama31-8b index table (rb2-full) Value 0.9141675662818143 Subject skywork-v2-llama31-8b Trust Exploratory Evidence ev:8296c115cd8d23d608021b4f036c2bbf
snr skywork-v2-llama31-8b index table (rb2-full) Value 1.7322235041858554 Subject skywork-v2-llama31-8b Trust Exploratory Evidence ev:8296c115cd8d23d608021b4f036c2bbf
contested_loading skywork-v2-llama31-8b index table (rb2-full) Value 13.195674042889769 Subject skywork-v2-llama31-8b Trust Exploratory Evidence ev:8296c115cd8d23d608021b4f036c2bbf
chi_teacher_variance skywork-v2-llama31-8b index table (rb2-full) Value 68.5506817583119 Subject skywork-v2-llama31-8b Trust Exploratory Evidence ev:8296c115cd8d23d608021b4f036c2bbf
dark_reward skywork-v2-llama31-8b index table (rb2-full) Value 0.9653072579596813 Subject skywork-v2-llama31-8b Trust Exploratory Evidence ev:8296c115cd8d23d608021b4f036c2bbf
k_criteria skywork-v2-llama31-8b index table (rb2-full) Subject skywork-v2-llama31-8b Trust Exploratory Evidence ev:8296c115cd8d23d608021b4f036c2bbf
coherence_d_eff skywork-v2-llama31-8b index table (rb2-full) Subject skywork-v2-llama31-8b Trust Exploratory Evidence ev:8296c115cd8d23d608021b4f036c2bbf

Every stored observable

The full card: one row per stored Evidence about this model, built with reward_lens.artifacts.card.build_card against the merged campaign store. Values that are payloads (vectors, tables, captures) show their shape. These ids name records in the store itself, whose payload arrays are too large to host; the records this site cites as receipts resolve at /evidence/.

Show all rows
Observable Value Trust Gauge Calibrated Evidence
campaign.bias.battery {name: str, vector: ndarray, labels: list, meta: {effect: str}} E invariant no ev:efbc058704dda8addfbe804f23b6f052
campaign.bias.battery {name: str, vector: ndarray, labels: list, meta: {probe: str}} E invariant no ev:5d344331769463480be7909695a39629
campaign.capture {store_key: str, roster_key: str, slice_name: str, sites: list} E invariant no ev:1bfb0e322f7849b29b366626ee63326c
campaign.capture.fp32 {store_key: str, roster_key: str, slice_name: str, sites: list} E invariant no ev:1ea03a98ea4ea104c89c26e67be6b363
campaign.conformance {name: str, columns: list, rows: list, meta: {tol: 0.05, summary: str}} E invariant no ev:b53ee8326eb78e88c9a866978a7487cc
campaign.contested.loading {name: str, vector: ndarray, labels: list, meta: {split: str, fit_correlation: 0.09154, n_fit: 1000}} E invariant no ev:0bf422678d65a25373b0de67391caf5a
campaign.direction.flagged {name: str, vector: ndarray, labels: list, meta: {family: str, realized_delta: -4.593}} E invariant no ev:7e14aaf8098921a86f71b1799cb7b74a
campaign.evalaware.paired {item_ids: list, names: list, matrix: ndarray, meta: {is_benchmark: list, rms: list}} E invariant no ev:20e9fc18b28bb9ba37e9129e2e9dd6c5
campaign.features.internal {item_ids: list, names: list, matrix: ndarray, meta: {site_order: list, contested_correlation: 0.8034, kui_star: str, n_layers: 31}} E invariant no ev:895fa41bd7c01389ddd55b635292f1bd
campaign.features.internal {item_ids: list, names: list, matrix: ndarray, meta: {site_order: list, contested_correlation: 0.9822, kui_star: str, n_layers: 31}} E invariant no ev:7b8621ed57af4faac99a908b213b8ddf
campaign.features.internal {item_ids: list, names: list, matrix: ndarray, meta: {excluded: list}} E invariant no ev:d061754f841d8697cf8597cf3805871c
campaign.heartbeat {arc: str, gpu: str, roster_key: str, seq_per_s: 0} E invariant no ev:4c94537129c06252da40ca4f15f1ddb8
campaign.index.table {name: str, columns: list, rows: list, meta: {roster_key: str, slice: str}} E invariant no ev:8296c115cd8d23d608021b4f036c2bbf
campaign.index.table {name: str, columns: list, rows: list, meta: {star: str, control: str}} E invariant no ev:eb4975ccaf0965e77c94c2faded24eb3
campaign.index.table {name: str, columns: list, rows: list, meta: {orientation: str}} E invariant no ev:b8efa17c05dae97990505ad574da1ce3
campaign.lens.trajectory {name: str, vector: ndarray, labels: list, meta: {}} E invariant no ev:77e98806969fb911356e79f206d1043b
campaign.rb2.category_accuracy {name: str, columns: list, rows: list, meta: {excluded_calibration_rows: 200, exclusion: str}} E invariant no ev:9271e213f3220b23f23485c1fc413c6d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 7052}} E invariant no ev:2d31415dfbf76b09a5fee353ec545585
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 7052}} E invariant no ev:83a433691c3077899e0596673912c75f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 7052}} E invariant no ev:8b282847cfdf2b2d08ce91b6003046e3
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 7052}} E invariant no ev:ad666dd96e1fc4b4440c9cef05b2044f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 7052}} E invariant no ev:194e2e8c0fb571d98a7021c962fdcf7b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 7052}} E invariant no ev:31ff88ff814324fd2c120224ee05a895
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 7052}} E invariant no ev:f83264aa747557bba7028c0c432150f9
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 7052}} E invariant no ev:38fafe3d7fc6fc2e7ae24dbc4cd969d1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 7052}} E invariant no ev:da805f68820255b94056272455545cfe
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 7052}} E invariant no ev:4a17bb42c2e9759a337a57701aa133b8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 7052}} E invariant no ev:90dd0b5947be57e7880824d8e3d671a8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 7052}} E invariant no ev:a51ac68d384af2448b93f0ede0c4d074
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 7052}} E invariant no ev:c736c71341d7d15877372aa9794b264b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 7052}} E invariant no ev:1309eb8399557942b96de6f063eb4bd5
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 7052}} E invariant no ev:6a0cf6330476da68a9f38d5e3cc76003
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {subsets: list}} E invariant no ev:bf4867a035506ca7d3603ce0d597ecad
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 7962}} E invariant no ev:3e955934c80cc68292d8ea8c54da449a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 7962}} E invariant no ev:21ed3b59276e695cc4b1163bb887437e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 7962}} E invariant no ev:c0c8209a3a0de7a3e69766770af56d26
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 7962}} E invariant no ev:8a533f639fec71f8c3db4169fd5c02c6
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 7962}} E invariant no ev:73e194a400a3f0938d781472fdee27b7
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 7962}} E invariant no ev:42394549ab6f6d7830e014166b2ae7db
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 7962}} E invariant no ev:33fdabb529aa9e22778f756edec73784
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 7962}} E invariant no ev:cebed3b9e7d3b1140afde161c60f96dd
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 7962}} E invariant no ev:f58c2e3ba3b08e9a39c14c5d6b95692c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 7962}} E invariant no ev:f2e5e3282d38bd867efcd9e9840eb344
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 7962}} E invariant no ev:a03ec8b4a2158af78656825263f316c8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 7962}} E invariant no ev:287740a3e9eb54dc6e92de90493cb6d4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 7962}} E invariant no ev:c9ddd9baa289efaffa9c44a6e5a233dc
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 7962}} E invariant no ev:2d6cbf326804a1aeb3fe8f2ed875d8e1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 7962}} E invariant no ev:77f237404560653591ab526e7a22d01a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 7962}} E invariant no ev:a90c1584ec6d9a42d5697ecfe61a08bf
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {tiers: list, columns: list}} E invariant no ev:3c602c1c9b87df9fb2ee0bacb08870c9
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 168}} E invariant no ev:159dc3f74fcf7fc2efe1832500c13b8c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list, axes: list}} E invariant no ev:14c92e2ca6c3970025f6a133e569c52e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 8000}} E invariant no ev:6cd9b191b755efa376d69e8ae41b65e1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 8000}} E invariant no ev:b600523e65fb00e61d3f6713c59c1e1e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 8000}} E invariant no ev:c1f7b721f53c1dc23723a6db680f1c07
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 8000}} E invariant no ev:66d3a4eef520139f43ea86836006e3b6
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 8000}} E invariant no ev:5a677afb68ce55e2fcdd48d108da6a5a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 8000}} E invariant no ev:3337f9b94f5a1b93f407f6343a40f382
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 8000}} E invariant no ev:f29deced2f9fd796d3e1c9ce13d58a74
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 8000}} E invariant no ev:1923f38f586ef10cef9e0697aecfd839
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 8000}} E invariant no ev:c0a8314091d8f511eb6ea88d24a19c78
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 8000}} E invariant no ev:a9affdd9cbaee9620f9a899335ce32d5
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 8000}} E invariant no ev:61bba308e664ed3b562eec458133f082
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 8000}} E invariant no ev:a12d1b3c4db9de76f0b2ff590bc16fc3
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 8000}} E invariant no ev:d2b1524316416b4616f57cc2cd18c41a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 8000}} E invariant no ev:f4a66b40145b5fed48ebf7106caf0eec
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 8000}} E invariant no ev:297f974e0f6ef17d687a40fcbdd92a79
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 8000}} E invariant no ev:a85a715905826208706ed226b8aa34f7
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {}} E invariant no ev:96c069194081d979ff046cffaea02833
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 216}} E invariant no ev:7d98fc3da3af3721c1bbf63413731ef7
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list, families: list}} E invariant no ev:35cbdf1aa21cf2001df5ef81da6b4c2b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 4000}} E invariant no ev:59afce8f613f855a179b81e55e579b7b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 4000}} E invariant no ev:875425ceeb174fbf2a92c85667e4bf46
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 4000}} E invariant no ev:17d67dcdffdca23d6f1137324d108e02
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 4000}} E invariant no ev:6d404c9b9cce06b898f0c5cd4b47b1a4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 4000}} E invariant no ev:902147e2f0970ab780717b3c003816d6
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 4000}} E invariant no ev:5bacfd7bde0dedcd6dbdfd0c00db13a7
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 4000}} E invariant no ev:c523789ffe6b0c01cbc4369be1f1b11d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 4000}} E invariant no ev:a6b99bb476597c3ba80bd78034f943bb
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {margin: str}} E invariant no ev:5caf8bd94163f1cf24360f078c6060fb
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 4800}} E invariant no ev:73124068cc8317958490d8cc6fee1c8e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 4800}} E invariant no ev:6a370ad309c075a4ee88d7689daeb9cc
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 4800}} E invariant no ev:d7c03ed96dcbdbd1eb7220654c63a443
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 4800}} E invariant no ev:258896b2cce9ee660aea7468eec344b8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 4800}} E invariant no ev:3edff5d076f78fdce3ab4443fa499801
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 4800}} E invariant no ev:cdc2768344d811c5f581a9ef93ac3096
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 4800}} E invariant no ev:baaf75fb943b954098147dc458a2a015
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 4800}} E invariant no ev:2fd24b03f3c9c608738df8c15ab32a08
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 4800}} E invariant no ev:1cec320ccc60a33b44a5f7b969bafb62
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 4800}} E invariant no ev:f483983fc7693dbd7f9abb405a1dac83
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list}} E invariant no ev:d0af629c5ed1064d0d5cbbdf1beab3d2
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list, derived_from: str, derivation: str, indexed_rows: 200}} E invariant no ev:5df87ede7d4a99c655aa7e5952cbb556
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {columns: list, derived_from: str, derivation: str, indexed_rows: 512}} E invariant no ev:cec2edbbd0ecc7a53a484d29a72ad9a6
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 1.638e+04}} E invariant no ev:23657a948bf1766fc91e1308e7f8a93d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 1.638e+04}} E invariant no ev:f554d843032de71032c71e5e55eb88e1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 1.638e+04}} E invariant no ev:58a31e67a310b5bd74fc84c61059a63c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 1.638e+04}} E invariant no ev:c08b5c04ce806dad4bc4bedd226303d3
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 1.638e+04}} E invariant no ev:f92c3c860725cb48ca1ad60e0090d3e6
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 1.638e+04}} E invariant no ev:53f0fb6140f27c50331345da6292bff4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 1.638e+04}} E invariant no ev:bbbd7f9c3e7747e4c4dca5ebc3c65dd1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 1.638e+04}} E invariant no ev:b9ed9939c1150a671959f960d1bf6ee8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 1.638e+04}} E invariant no ev:6d06090c21b3b9db31b3ac9ebdcade5f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 1.638e+04}} E invariant no ev:cfefc487201893b1a305ac43027a7cf1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 1.638e+04}} E invariant no ev:27dd593187dc5c483d6e77ef30f3c084
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 1.638e+04}} E invariant no ev:cbbe041e988231bc51ec2b39b269ea95
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 1.638e+04}} E invariant no ev:cf2fed643820a546c4e1e93a5df86ddb
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 1.638e+04}} E invariant no ev:206f7f4e9a598810d1c216dc33190d3b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 1.638e+04}} E invariant no ev:3b12ab93e643c71f76a4bc9232c6099e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 1.638e+04}} E invariant no ev:5a5e8c7792567b48a3bdd80701f81f84
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 16, n_total: 1.638e+04}} E invariant no ev:0a44abbc3845df42e2503a8e97dce7aa
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 17, n_total: 1.638e+04}} E invariant no ev:e47aeea3443c715d6ab4c253bc6e490d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 18, n_total: 1.638e+04}} E invariant no ev:fa6576947048b754edc74f71e97297bf
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 19, n_total: 1.638e+04}} E invariant no ev:9adcdaf4f6acc9c29f9033c7be777862
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 20, n_total: 1.638e+04}} E invariant no ev:7d26c16cb4d3b14f45fa241d29d39997
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 21, n_total: 1.638e+04}} E invariant no ev:549dcde94bbf3783cff570d81c95a4d4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 22, n_total: 1.638e+04}} E invariant no ev:e380650c4c8967a5500c7b0bca26a546
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 23, n_total: 1.638e+04}} E invariant no ev:e48170cb585c6d0bd69fcd0ac5a3f0f0
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 24, n_total: 1.638e+04}} E invariant no ev:85e73fb022dfcabc4f22bf283b7c6122
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 25, n_total: 1.638e+04}} E invariant no ev:976160705992194d6d8167e897fa94ff
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 26, n_total: 1.638e+04}} E invariant no ev:68dfe603249a98863611d1c18a7eea24
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 27, n_total: 1.638e+04}} E invariant no ev:0dfcd84a4acc61c65187f1e488b1d156
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 28, n_total: 1.638e+04}} E invariant no ev:bcb2b24c87d0b44ead773dec22dbff36
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 29, n_total: 1.638e+04}} E invariant no ev:a4e00f29b7cd6ba3d554a7885ec496a8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 30, n_total: 1.638e+04}} E invariant no ev:1824d764d2a19fd492cddebf8b7c7638
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 31, n_total: 1.638e+04}} E invariant no ev:07460720eba9d965d9aa8f672c8a5738
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 32, n_total: 1.638e+04}} E invariant no ev:e9be49e06e4d93538ba3d2e889c7e40a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {correct: ndarray}} E invariant no ev:615b19db87ddf38045e0351d94a93920
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 1.638e+04}} E invariant no ev:c763ccce43ca611096ffcba3064a6236
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 1.638e+04}} E invariant no ev:09ae490889e562bda3257b4c307eaf2a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 1.638e+04}} E invariant no ev:ea2ce1329674c78f182d648d091028e8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 1.638e+04}} E invariant no ev:ad4892da285dbf577bc7ac5fae67bf3d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 1.638e+04}} E invariant no ev:8432f90af3d48c14202ee1d88ab26b6d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 1.638e+04}} E invariant no ev:9b217b34d12a90ad702147da1e71d9e2
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 1.638e+04}} E invariant no ev:e282934bbeba2c9e2e1ebd7de2abd9ce
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 1.638e+04}} E invariant no ev:4f1975707a2d46fea6dc17cd596e7234
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 1.638e+04}} E invariant no ev:cffd82184d96081a149c3d61e882fb16
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 1.638e+04}} E invariant no ev:a2603fd062a2b9d2e314aa13b262ab44
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 1.638e+04}} E invariant no ev:3111c1c8e924625c3e0b68b57610714c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 1.638e+04}} E invariant no ev:a67e3942bf41dd494da8bfc6d92cd877
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 1.638e+04}} E invariant no ev:420724e1e3817aeb18bd1ea69ee78f5a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 1.638e+04}} E invariant no ev:3c4299bb5b35b15bb76080d5afbb6e28
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 1.638e+04}} E invariant no ev:58d4d28b19304e7a22f24e954f7f2868
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 1.638e+04}} E invariant no ev:28fdfb5630addbc33fa35eceeb52babe
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 16, n_total: 1.638e+04}} E invariant no ev:eaaf1e946ac4974a4313a67eeb3bac97
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 17, n_total: 1.638e+04}} E invariant no ev:ba5202c82a1910d6b1afffa4e8df6f35
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 18, n_total: 1.638e+04}} E invariant no ev:f3915996cc93c3065570b588642340e4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 19, n_total: 1.638e+04}} E invariant no ev:e748ca86618ecb4b04ccd3e0751c0f62
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 20, n_total: 1.638e+04}} E invariant no ev:52cbb26ea927d05b4ed9a5160a4e37f7
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 21, n_total: 1.638e+04}} E invariant no ev:351cb91d3d06fe99df49b18a660928ef
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 22, n_total: 1.638e+04}} E invariant no ev:63de5d395dd2b8b945ebb6784b24f7e8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 23, n_total: 1.638e+04}} E invariant no ev:b053485938718105279f882c79efa40d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 24, n_total: 1.638e+04}} E invariant no ev:556a097e5dad30008dbc68dc1f6c8adf
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 25, n_total: 1.638e+04}} E invariant no ev:0c62b65a99e6c553e3e82f6a56e531f4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 26, n_total: 1.638e+04}} E invariant no ev:73986a32caeefc7731fba74a2ada8cd5
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 27, n_total: 1.638e+04}} E invariant no ev:ab5f7ac28ad5cda0b01a4faa90bfb765
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 28, n_total: 1.638e+04}} E invariant no ev:5b9b4012ae642c5d49f250ee5dc3ea53
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 29, n_total: 1.638e+04}} E invariant no ev:4f49602bf94a08c96ec55b2dccfe51d4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 30, n_total: 1.638e+04}} E invariant no ev:b5db792a2bded4d6d4f2e9a1237d8883
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 31, n_total: 1.638e+04}} E invariant no ev:354e98f836fa5b940b660178c2700c92
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 32, n_total: 1.638e+04}} E invariant no ev:33aba5d4bf1f8b8ccbe3045816f834a9
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {correct: ndarray}} E invariant no ev:4bd9cbc43a223a2bcfea71a51f46ee87
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 1.638e+04}} E invariant no ev:01da47ab61f0da2aa9c7ab784538f22a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 1.638e+04}} E invariant no ev:a79f302929c4cc358113b189c56dca1f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 1.638e+04}} E invariant no ev:8714d4d100d6bfed09035a9ce56be8bd
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 1.638e+04}} E invariant no ev:64dc5b821e93ed1e36a909113956f56d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 1.638e+04}} E invariant no ev:29aa7c31260e383e332c722e4fb5383e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 1.638e+04}} E invariant no ev:1a0078187c52843e332e9215dbd6b768
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 1.638e+04}} E invariant no ev:c7153916876d76218eafe76911b76159
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 1.638e+04}} E invariant no ev:fa4ae3868d8db75f89b80be92b111f1a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 1.638e+04}} E invariant no ev:3d8fcdace5d5e205f04341ad8e5a4996
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 1.638e+04}} E invariant no ev:43d38b5f44548ddde813b884fb4046b2
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 1.638e+04}} E invariant no ev:af5fb4018564a4dd945e649711d8d949
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 1.638e+04}} E invariant no ev:b7ccb6010aa81422d8440bb1175d0e5d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 1.638e+04}} E invariant no ev:059d133c83cb7caa469e147b0e71e461
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 1.638e+04}} E invariant no ev:b5f4ffbde64e75c8a417a78cf49fa103
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 1.638e+04}} E invariant no ev:2ea4bcb46b0148308565b23e6c358243
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 1.638e+04}} E invariant no ev:a397b84c8132a2f338986536eb78c37f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 16, n_total: 1.638e+04}} E invariant no ev:1796564955efe4f8cc32688571787c59
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 17, n_total: 1.638e+04}} E invariant no ev:8facacc2ec4ef6989ecc1eb0e4e28466
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 18, n_total: 1.638e+04}} E invariant no ev:940427044c0902c3d0883e39574d78d6
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 19, n_total: 1.638e+04}} E invariant no ev:e9fb8d6915a15f0120a2fe4c24e35a1d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 20, n_total: 1.638e+04}} E invariant no ev:10353f031964f9abe87a06533889226c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 21, n_total: 1.638e+04}} E invariant no ev:6f3a783ce33cce3d92dbfd6b9ac1a0a6
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 22, n_total: 1.638e+04}} E invariant no ev:0335f87e2aa8e747a790d6700fd4c53a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 23, n_total: 1.638e+04}} E invariant no ev:7558801a20a3cfafcf4eba9a3fb6d724
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 24, n_total: 1.638e+04}} E invariant no ev:2ad0b0037463cb3c015bd707d6c964ac
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 25, n_total: 1.638e+04}} E invariant no ev:459ab632c276b90be099e4bd1d06416c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 26, n_total: 1.638e+04}} E invariant no ev:67281e7dbeea891a393ace6dc9181ffb
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 27, n_total: 1.638e+04}} E invariant no ev:6c80d250be58cfd93a6f74ee9c6c1f04
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 28, n_total: 1.638e+04}} E invariant no ev:93340e856aaa94c2804d9f55744eebb4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 29, n_total: 1.638e+04}} E invariant no ev:e978c8200110f2eaf5acf5de320007e8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 30, n_total: 1.638e+04}} E invariant no ev:f0ca266124ac1f130dd27a093cc485f8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 31, n_total: 1.638e+04}} E invariant no ev:517617e6e184c8d34d84baa475ced455
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 32, n_total: 1.638e+04}} E invariant no ev:2b1a559952d7f20453b726cd062f4eab
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {correct: ndarray}} E invariant no ev:71fefb2d9edd41eb81e7473f2b06ddbd
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 1.622e+04}} E invariant no ev:15dcf5d34c91ac51f958dde60fc6a634
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 1.622e+04}} E invariant no ev:bf8a5fed54cf966137fdd7d8cdf82673
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 1.622e+04}} E invariant no ev:c84cd571c2ac9103c1adf0f2419d4707
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 1.622e+04}} E invariant no ev:573ebacfa1e47618fafea2147d716c75
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 1.622e+04}} E invariant no ev:d64a6f5ce72880299d2dbbb06e1e7f8a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 1.622e+04}} E invariant no ev:39e57943f4b399b758b53dc56c59c25b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 1.622e+04}} E invariant no ev:1442d36376fcbdfa221f69f3f3ab5aaa
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 1.622e+04}} E invariant no ev:dbab1e6e9c9520a2ff994623bf45fca5
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 1.622e+04}} E invariant no ev:1a48a2549389541bd30b17a081144c02
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 1.622e+04}} E invariant no ev:2eaff7f654423c08f7193a20b53a5df0
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 1.622e+04}} E invariant no ev:064b293eeb4cd93b9a48a581cace9a84
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 1.622e+04}} E invariant no ev:58fb8f822a1c07975d5e2be679f66ddb
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 1.622e+04}} E invariant no ev:0b226b09c877a22dd937df8c8d303b99
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 1.622e+04}} E invariant no ev:3af1c21402c1b785f26c37aef77ca71d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 1.622e+04}} E invariant no ev:a1c993249c466ba070c54e8791dacead
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 1.622e+04}} E invariant no ev:96dd075f15eb2cf89794aa76acf1483f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 16, n_total: 1.622e+04}} E invariant no ev:292e61c3d3c5aacb6353c50599c922a4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 17, n_total: 1.622e+04}} E invariant no ev:0423240e6bd93e840627594506c7558f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 18, n_total: 1.622e+04}} E invariant no ev:8b3845d18a16a98f3c48e9dba5662d56
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 19, n_total: 1.622e+04}} E invariant no ev:4d0ee4ec3f3319e82404e865bdb0a5f4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 20, n_total: 1.622e+04}} E invariant no ev:68b5eacd9c8e86e52db9dc0468df2ca3
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 21, n_total: 1.622e+04}} E invariant no ev:c4d7418b9a5c9f9d506ad54170852776
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 22, n_total: 1.622e+04}} E invariant no ev:9af1a48065bd7ee5b5fb2479a6bdeddd
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 23, n_total: 1.622e+04}} E invariant no ev:12910ff67015e7b16a046b4b5801bfd8
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 24, n_total: 1.622e+04}} E invariant no ev:2741e1a849e8f5a721ede202774e7ebf
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 25, n_total: 1.622e+04}} E invariant no ev:c0918b2f4f8e8aeb1db54dc96dfb8752
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 26, n_total: 1.622e+04}} E invariant no ev:a9cb8f082f67fe02329529bead07ae16
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 27, n_total: 1.622e+04}} E invariant no ev:4b369fdcde10562cc9f68599b549a634
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 28, n_total: 1.622e+04}} E invariant no ev:2f318f8593abe1fcdbd0a648b3197d2e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 29, n_total: 1.622e+04}} E invariant no ev:99b691f2deb62968ecddeb18595e8b9c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 30, n_total: 1.622e+04}} E invariant no ev:29f7e6ec536aa1de317ca65d574c4859
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 31, n_total: 1.622e+04}} E invariant no ev:c30a8b655d5eae0d3a22c86e132c1844
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 32, n_total: 1.622e+04}} E invariant no ev:36513c9fd0b95d43f3f26c31fc5f1469
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {correct: ndarray}} E invariant no ev:dd9b6a8dbd69d28988f76797f037a2e1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 1.638e+04}} E invariant no ev:e9982443a18ad22ac7131e606f13e18f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 1.638e+04}} E invariant no ev:9222275690f356ad8fdfd65945684a49
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 1.638e+04}} E invariant no ev:da584307e9916e8bf2f96b98d71bebce
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 1.638e+04}} E invariant no ev:e312ca18c1205b986bb5459e9ab2bafe
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 1.638e+04}} E invariant no ev:1afaa4df0248b468d7f38eb5fb3f5889
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 1.638e+04}} E invariant no ev:faec6c3b76541f299ac3c9eca6aa8e1a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 1.638e+04}} E invariant no ev:4f4059335b9840ef2062972920b75846
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 1.638e+04}} E invariant no ev:ce19e22dcfc68d1bc0a6f71697ff0b91
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 1.638e+04}} E invariant no ev:e8fa2286f784615a00ccc4e2a94f7632
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 1.638e+04}} E invariant no ev:2cb142357010bda2e38634934ee699ce
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 1.638e+04}} E invariant no ev:64316ad8807af71648090c88b554bfe7
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 1.638e+04}} E invariant no ev:43e6e132ed680308830fe9dab13ff4f5
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 1.638e+04}} E invariant no ev:285e65023ec3bb29f076a3f2733180ff
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 1.638e+04}} E invariant no ev:6f98186b3c3162f49aaba775486e0e98
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 1.638e+04}} E invariant no ev:f573f9d6c8cb9332a249123f7417615b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 1.638e+04}} E invariant no ev:e8f13ee8c2807fb8e99d3421b6cc8ee4
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 16, n_total: 1.638e+04}} E invariant no ev:1d8afbbd71b6ec606b84763591013c4b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 17, n_total: 1.638e+04}} E invariant no ev:b1de014ff6ed801767dfd2db7c928d1a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 18, n_total: 1.638e+04}} E invariant no ev:d66195e52c2aa8df2d28fa5b62707dcb
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 19, n_total: 1.638e+04}} E invariant no ev:ba387b9f73bd26966f7ab39a08d469d2
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 20, n_total: 1.638e+04}} E invariant no ev:7d4e6e2cfde7ad849967b64323920813
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 21, n_total: 1.638e+04}} E invariant no ev:d9ac8f47110a0543ecab50e7bc08de6d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 22, n_total: 1.638e+04}} E invariant no ev:e480c86c1cfda8c711b8e294be909961
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 23, n_total: 1.638e+04}} E invariant no ev:b278ee4bc5afda01972f3e7efc10111e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 24, n_total: 1.638e+04}} E invariant no ev:8470f8775edd5bf6363f5bd6d89d4ed5
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 25, n_total: 1.638e+04}} E invariant no ev:33f0717b652ac93ddb5508b9f54806d5
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 26, n_total: 1.638e+04}} E invariant no ev:3f18847c5a84eb58a299844f88226351
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 27, n_total: 1.638e+04}} E invariant no ev:e738118280927cffc0b3bd099731b8ac
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 28, n_total: 1.638e+04}} E invariant no ev:c87da71d865481aa12d8f5690f2d4556
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 29, n_total: 1.638e+04}} E invariant no ev:089b02a832c0d9c64b9753fe7730423f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 30, n_total: 1.638e+04}} E invariant no ev:c8cb1795758fdfdf5062f5a16c3f14cb
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 31, n_total: 1.638e+04}} E invariant no ev:0f3ac2ca1649e6f698942a53d89d013e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 32, n_total: 1.638e+04}} E invariant no ev:5e03c4643371de07e355f828dcd7052f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {correct: ndarray}} E invariant no ev:d4026eb2bd5dc61fa818cd430875bf2b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 0, n_total: 1.6e+04}} E invariant no ev:b0d9eef84cc44eb1ed6a2ac81ff1fe35
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 1, n_total: 1.6e+04}} E invariant no ev:7ee607d476314eda15c423455c2cedd1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 2, n_total: 1.6e+04}} E invariant no ev:4778128e19d0ed65280bf72c8d995fbc
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 3, n_total: 1.6e+04}} E invariant no ev:e1dab0d3ca062dec2103b5765f21786b
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 4, n_total: 1.6e+04}} E invariant no ev:5933502086b2ba52b9004fce5510cb3f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 5, n_total: 1.6e+04}} E invariant no ev:54ae64ab15efe28049423975e5d857ec
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 6, n_total: 1.6e+04}} E invariant no ev:171d5659b31671dcd6751fa5dcb81e87
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 7, n_total: 1.6e+04}} E invariant no ev:7b23b2ba21ce7403ba6865c2bc599cd1
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 8, n_total: 1.6e+04}} E invariant no ev:6a6242feb25f606ff1634f62dbe58edd
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 9, n_total: 1.6e+04}} E invariant no ev:5430c03280f431c460c686c7f93691fe
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 10, n_total: 1.6e+04}} E invariant no ev:3338c0640d5661f28bd122b1017b6ca5
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 11, n_total: 1.6e+04}} E invariant no ev:43356dfed0c4fb6011ce4b6af3c80f7c
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 12, n_total: 1.6e+04}} E invariant no ev:49dadbfbe09b73241ed4a622e42c50b0
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 13, n_total: 1.6e+04}} E invariant no ev:944f9daf27607203ffc164872c569d5e
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 14, n_total: 1.6e+04}} E invariant no ev:beae39875a8c2364425e616b4bb0cf6d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 15, n_total: 1.6e+04}} E invariant no ev:fadebd655a46384a0d3e06bbf08b2591
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 16, n_total: 1.6e+04}} E invariant no ev:aed7d696733396e883f1da154b0ed230
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 17, n_total: 1.6e+04}} E invariant no ev:0f13149957b9bf5123d62a8de405934d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 18, n_total: 1.6e+04}} E invariant no ev:3d2b7fc6b39908fdaf0a00cb4c3cfb7f
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 19, n_total: 1.6e+04}} E invariant no ev:a661883dd593c4adcb6e7878ef59b2bc
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 20, n_total: 1.6e+04}} E invariant no ev:75c410f5d1d687802f4ad0193b9ace13
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 21, n_total: 1.6e+04}} E invariant no ev:258efd5f3d487da1051d44bacee4a045
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 22, n_total: 1.6e+04}} E invariant no ev:9d0d2c43e99d332e4c961c014d48bd54
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 23, n_total: 1.6e+04}} E invariant no ev:2de639dd07584a0767731dd4bed1daf9
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 24, n_total: 1.6e+04}} E invariant no ev:0d4137c66d9422acd03cb4960aca4c5a
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 25, n_total: 1.6e+04}} E invariant no ev:5f2ae3d0edbd3bd7791ec93db8569238
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 26, n_total: 1.6e+04}} E invariant no ev:71f858522d585fc333848dbc7aa76aac
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 27, n_total: 1.6e+04}} E invariant no ev:de337378326c355992d43adba44c2984
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 28, n_total: 1.6e+04}} E invariant no ev:0c759852a6fd9e60628d67f8401052af
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 29, n_total: 1.6e+04}} E invariant no ev:25097ba32afa9100b95c78f737de0e07
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 30, n_total: 1.6e+04}} E invariant no ev:866a661f33646ca50607ffa4ce302d0d
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {partial: 1, part: 31, n_total: 1.6e+04}} E invariant no ev:fb86088a56e2de6854693950112f85c0
campaign.scores {item_ids: list, scores: ndarray, layout: str, meta: {role: str}} E invariant no ev:add4845813661c67dfc8bbe94b3e087d
campaign.subspace {name: str, matrix: ndarray, row_labels: list, col_labels: list} E invariant no ev:80106ee258587c3c52f147a06d0e1e1d
campaign.subspace {name: str, matrix: ndarray, row_labels: list, col_labels: list} E invariant no ev:b719df4eac7d507ad1a1920e01bdbc03
campaign.w_r {name: str, vector: ndarray, labels: list, meta: {readout: str, site: str}} E invariant no ev:00aa315fed98cd54bb7262f17ad496e1

Source: the merged campaign evidence store, opened read-only; card built at site build time. The store itself is not published; its projections and provenance manifest are in the site repository.