Evaluation run
casp16-monomer-regular-official
Scopefull · n=54
ShotsNot applicable
TurnsNot applicable
System prompt publicNot applicable
Reasoning / effortNot applicable
Browsermethod-specific
Internetmethod-specific
Databasesmethod-specific
Code executionallowed
ContainerNot reported
External toolsmethod-specific
Token budgetNot applicable
Time / cost budgetapproximately three weeks per target for regular groups
TemperatureNot applicable
SeedNot reported
Repeatsup to five submitted models per target
Graderofficial CASP structure-comparison pipeline plus independent monomer assessor team · human review: yes
Statisticsper-evaluation-unit scores converted to group ranking summaries including cumulative clipped z-scores
Contaminationexperimental structures withheld until prediction closes
Metrics, results, and full protocol
Metrics
| Metric | Kind / baseline | Unit | Aggregation | Threshold / tolerance |
|---|---|---|---|---|
| GDT_TS | absolute | score | computed per evaluation unit; official group rankings use first/best model views and z-score summaries | Not reported |
| GDT_HA | absolute | score | per evaluation unit | Not reported |
| lDDT | absolute | proportion | per evaluation unit | Not reported |
| TM-score | absolute | proportion | per evaluation unit | Not reported |
| SUM Z-score (> -2.0) | absolute | z-score sum | sum across eligible evaluation units after clipping values below -2.0 | Not reported |
No numeric result rows are published yet; the verified protocol remains useful.
Evidence
- section: Results and Discussion; performance evaluation and ranking (54 evaluation units, model-1/best-model analyses, metrics, and assessor interpretation.) — supports /benchmark_version, /scope, /protocol/grader, /protocol/statistical, /metrics
- section: Registration; Targets; Model submission/format; Assessment (Blind targets, regular versus server settings, deadlines, and independent assessment.) — supports /protocol/shots, /protocol/turns, /protocol/system_prompt_public, /protocol/reasoning, /protocol/tools, /protocol/token_budget, /protocol/time_budget, /protocol/temperature, /protocol/seed, /protocol/repeats, /protocol/contamination