BioBench Atlas
Benchmarks/CASP/CASP Protein Monomers

track · audited-with-caveats · verified 2026-07-21

CASP Protein Monomers

Formal CASP track assessing blind predictions of single-protein structures and post hoc protein evaluation units against withheld experimental coordinates.

Protein structureProtein monomer structure prediction
Audited with caveats: 1 field(s) are marked provisional or conflicted. Warnings are shown next to affected values and these claims are excluded from unqualified comparisons.

Benchmark definition

What is counted

Version
CASP17
Total
Not reported (CASP17 assessed monomer evaluation units)
Task formats
blind monomer structure prediction
Capabilities
Prediction
Modalities
Protein sequence3D structure

Version history

VersionStatusRelease / as-ofTotalFormal tracks
CASP16
casp-monomer-casp16		superseded2024-05-0154 (assessed protein monomer evaluation units)None registered
CASP17
casp-monomer-casp17		rolling2026-04-27Not reported (assessed protein monomer evaluation units)None registered

Scientific Task Atlas

Scientific task classification

complete for CASP17 · as of 2026-07-21. Single-purpose formal track; the current round is rolling.

Scientific taskCoverageCountMappingEvidence
Protein monomer structure predictionexplicitly-in-scopeNot reported
CASP17 assessed monomer evaluation units.		official-track
high confidence		casp-monomer-evidence-casp17
Final assessed count is not reported while CASP17 is active.

Scientific coverage notes

DomainCoverageCountInterpretation
Protein structureexplicitly-in-scopeNot reportedCASP17 is active and its final assessed monomer evaluation-unit count is not yet available.

Evaluation registry

Works and run settings

A setting change—scope, prompt, tools, budget, grader, or repeats—creates a separate run. Charts never cross a comparability group.

Evaluation run

casp16-monomer-regular-official

From CASP16 Protein Monomer Structure Prediction Assessment

casp16-monomer-regular-officialvCASP16
Scopefull · n=54
ShotsNot applicable
TurnsNot applicable
System prompt publicNot applicable
Reasoning / effortNot applicable
Browsermethod-specific
Internetmethod-specific
Databasesmethod-specific
Code executionallowed
ContainerNot reported
External toolsmethod-specific
Token budgetNot applicable
Time / cost budgetapproximately three weeks per target for regular groups
TemperatureNot applicable
SeedNot reported
Repeatsup to five submitted models per target
Graderofficial CASP structure-comparison pipeline plus independent monomer assessor team · human review: yes
Statisticsper-evaluation-unit scores converted to group ranking summaries including cumulative clipped z-scores
Contaminationexperimental structures withheld until prediction closes
Metrics, results, and full protocol

Metrics

MetricKind / baselineUnitAggregationThreshold / tolerance
GDT_TSabsolutescorecomputed per evaluation unit; official group rankings use first/best model views and z-score summariesNot reported
GDT_HAabsolutescoreper evaluation unitNot reported
lDDTabsoluteproportionper evaluation unitNot reported
TM-scoreabsoluteproportionper evaluation unitNot reported
SUM Z-score (> -2.0)absolutez-score sumsum across eligible evaluation units after clipping values below -2.0Not reported

No numeric result rows are published yet; the verified protocol remains useful.

Evidence

  • section: Results and Discussion; performance evaluation and ranking (54 evaluation units, model-1/best-model analyses, metrics, and assessor interpretation.) — supports /benchmark_version, /scope, /protocol/grader, /protocol/statistical, /metrics
  • section: Registration; Targets; Model submission/format; Assessment (Blind targets, regular versus server settings, deadlines, and independent assessment.) — supports /protocol/shots, /protocol/turns, /protocol/system_prompt_public, /protocol/reasoning, /protocol/tools, /protocol/token_budget, /protocol/time_budget, /protocol/temperature, /protocol/seed, /protocol/repeats, /protocol/contamination

Evidence and change history

Source locators remain visible; expand an item to inspect the exact Registry fields it supports.

casp-monomer-casp1-history-resource · section: CASP1 description (The 1994 experiment included comparative modeling, fold recognition, and ab initio folding of protein targets.) · Supports 6 fields

Open source →

  • /name
  • /aliases
  • /organizations
  • /release_date
  • /kind
  • /parent_id
CASP16 Protein Monomer Structure Prediction Assessment · section: Abstract; Results and Discussion; Figure 1 (Reports 54 assessed evaluation units, including 42 complete protein monomers, and the GDT_TS-based assessment.) · Supports 11 fields

Open source →

  • /summary
  • /domains
  • /capabilities
  • /modalities
  • /task_formats
  • /versions/0/task_counts/total
  • /versions/0/task_counts/basis
  • /versions/0/task_counts/subsets
  • /access/grader
  • /resources
  • /implementations
CASP17 official competition · section: Difficult Protein Structures and Complexes; Timetable; Assessment (Active track scope and the absence of final 2026 results.) · Supports 16 fields

Open source →

  • /latest_version
  • /task_counts/total
  • /task_counts/basis
  • /task_counts/subsets
  • /coverage_notes
  • /versions/1/release_date
  • /versions/1/as_of
  • /versions/1/task_counts/total
  • /versions/1/task_counts/basis
  • /versions/1/task_counts/subsets
  • /access/level
  • /access/tasks
  • /access/artifacts
  • /access/license
  • /access/biosafety_notes
  • /scientific_task_classification/entries/0

Unresolved field claims

  • /release_dateProvisional · medium — The official history establishes monomeric protein structure prediction in CASP1 in 1994 but does not report an exact first-target day; the date is year-normalized.
    Evidence: casp-monomer-evidence-origin

View source-level modification history on GitHub →