Data and provenance
Where every number on this site comes from, and what state the study is in.
- Study status
SIMULATION_ONLY- Human data exist
- no
- Participants
- 0
- Ethics approval
- none on file
- Preregistration
- not submitted
- Results built from
git e756953, tier standard- Environment
- Python 3.11.15 · numpy 2.4.6 · scipy 1.17.1 · pandas 3.0.5
The site computes nothing. scripts/export_site_data.py copies the canonical result files in results/ into one bundle at build time, and every page reads from it. Each result file has a manifest recording the run id, git commit, study status, data source, seed, configuration, key metrics and a content hash. A figure on the site names its source file and run id in its caption.
No participant-level human data are published, because none exist. If they ever do, trial-level data stay in the private database behind the collection endpoint; only aggregated, anonymised results would reach this site. Synthetic observer data are regenerable from seeds with make simulate and are not committed.
Result manifests
| Result | Run | Rows | Content hash | Data source |
|---|---|---|---|---|
crossval_by_observer | crossval_by_observer-280346c-4 | 270 | 1c641866a9cea019 | SYNTHETIC_OBSERVER |
data_quality | data_quality-280346c-0 | 9 | 9985c9a439fb194c | SYNTHETIC_OBSERVER |
design_optimization | design_optimization-8964a2e-6000 | 9 | 2827ae9cca195153 | SYNTHETIC_OBSERVER |
design_optimization_raw | design_optimization_raw-8964a2e-6000 | 540 | bdc007410295ba81 | SYNTHETIC_OBSERVER |
early_vs_late | early_vs_late-e756953-13 | 3 | 6cedb2c532fece15 | SYNTHETIC_OBSERVER |
failure_taxonomy | failure_taxonomy-e756953-8 | 14 | 910cecb900972214 | SYNTHETIC_OBSERVER |
failures | failures-e756953-8 | 13 | d7930e6fa856ea48 | SYNTHETIC_OBSERVER |
individual_effects | individual_effects-280346c-5 | 30 | 6eeb636c2ef92567 | SYNTHETIC_OBSERVER |
joint_recovery | joint_recovery-8964a2e-2000 | 270 | b4a96784fab4c651 | SYNTHETIC_OBSERVER |
lag_effects | lag_effects-280346c-2 | 8 | a5916f9a4386df81 | SYNTHETIC_OBSERVER |
leave_one_block_out | leave_one_block_out-e756953-12 | 6 | d31f89627026fd99 | SYNTHETIC_OBSERVER |
leave_one_observer_out | leave_one_observer_out-e756953-11 | 30 | 3409986ef9b71c80 | SYNTHETIC_OBSERVER |
model_comparison | model_comparison-280346c-4 | 9 | dcb376a1c82f0363 | SYNTHETIC_OBSERVER |
model_confusion | model_confusion-e756953-3000 | 64 | 92c3e23d3d7f9da6 | SYNTHETIC_OBSERVER |
model_discrimination | model_discrimination-e756953-3000 | 320 | 7e39d11919f2ad54 | SYNTHETIC_OBSERVER |
parameter_recovery | parameter_recovery-8964a2e-1000 | 1080 | 73e8b91d27978c5a | SYNTHETIC_OBSERVER |
parameter_recovery_summary | parameter_recovery_summary-8964a2e-1000 | 27 | 98dfe20b41c5bee2 | SYNTHETIC_OBSERVER |
participants | participants-280346c-0 | 30 | 6e99f5da7f876abe | SYNTHETIC_OBSERVER |
per_observer_fits | per_observer_fits-280346c-1 | 30 | 619e65e70cb352c2 | SYNTHETIC_OBSERVER |
permutation_null | permutation_null-e756953-7 | 100 | 5eabaf53b020b056 | SYNTHETIC_OBSERVER |
posterior_predictive | posterior_predictive-280346c-6 | 360 | 6d0c80df21811c6b | SYNTHETIC_OBSERVER |
power | power-8964a2e-5000 | 96 | 1189be79997df107 | SYNTHETIC_OBSERVER |
power_pool | power_pool-8964a2e-5000 | 3000 | 6342e2702154a0b9 | SYNTHETIC_OBSERVER |
red_team | red_team-e756953-4000 | 30 | a585f1dcf418fa44 | SYNTHETIC_OBSERVER |
red_team_raw | red_team_raw-8964a2e-4000 | 2000 | cbee03d10cf6f47c | SYNTHETIC_OBSERVER |
robustness | robustness-e756953-10 | 65 | 48d45da40090c874 | SYNTHETIC_OBSERVER |
serial_dependence | serial_dependence-280346c-1 | 229 | 83c9c27b61529736 | SYNTHETIC_OBSERVER |
trial_count_sensitivity | trial_count_sensitivity-e756953-14 | 4 | 3555f6e8224d9a7f | SYNTHETIC_OBSERVER |
uncertainty_effects | uncertainty_effects-e756953-3 | 6 | 917e9d39109b5cfd | SYNTHETIC_OBSERVER |
The full data dictionary — every field, its units, range and missingness — is in docs/DATA_DICTIONARY.md.