Benchmarks/CASP/CASP Protein Multimers

track · audited · verified 2026-07-21

CASP Protein Multimers

Formal CASP track assessing blind protein-complex predictions, including overall folds, interfaces, stoichiometry-free phases, and model-selection phases.

Benchmark definition

What is counted

Version: CASP17
Total: 61 (CASP17 multimer target re-releases with stoichiometry as of 2026-07-21)
Task formats: blind protein complex prediction; stoichiometry prediction; complex model selection
Capabilities: Prediction
Modalities: Protein sequence3D structure

Version history

Version	Status	Release / as-of	Total	Formal tracks
CASP16 `casp-multimer-casp16`	superseded	2024-05-01	40 (unique protein complex targets in the Phase-1 main assessment)	None registered
CASP17 `casp-multimer-casp17`	rolling	2026-04-28	61 (multimer target re-releases with stoichiometry)	casp-immune-complexes

Registered child tracks

CASP17 Immune Complexes

Dedicated CASP17 category for blind prediction of antibody-antigen, nanobody-antigen, and T-cell receptor complex structures.

0 evaluation run(s)

Scientific Task Atlas

Scientific task classification

complete for CASP17 · as of 2026-07-21. Formal complex-prediction track, including interface and model-selection phases.

Scientific task	Coverage	Count	Mapping	Evidence
Protein complex structure prediction	explicitly-in-scope	61 targets CASP17 multimer target re-releases with stoichiometry as of 2026-07-21.	official-track high confidence	`casp-multimer-evidence-casp17` Rolling release count; not a final assessed-set total.
Protein model quality assessment	explicitly-in-scope	Not reported CASP17 multimer model-selection evaluation units.	official-track high confidence	`casp-multimer-evidence-casp17-protocol` Model-selection is in scope but not separately counted.

Scientific coverage notes

Domain	Coverage	Count	Interpretation
Protein-protein binding	explicitly-in-scope	61	Rolling CASP17 with-stoichiometry releases; this is not the final assessed target count.
Antibody-antigen	explicitly-in-scope	Not reported	Immune complexes are separated into a dedicated CASP17 child track; the in-numbers page does not publish its count.

Evaluation registry

Works and run settings

A setting change—scope, prompt, tools, budget, grader, or repeats—creates a separate run. Charts never cross a comparability group.

Evaluation run

casp16-multimer-phase1-regular

From Assessment of Protein Complex Predictions in CASP16: Are We Making Progress?

Scopefull · n=40

ShotsNot applicable

TurnsNot applicable

System prompt publicNot applicable

Reasoning / effortNot applicable

Browsermethod-specific

Internetmethod-specific

Databasesmethod-specific

Code executionallowed

ContainerNot reported

External toolsmethod-specific

Token budgetNot applicable

Time / cost budgetapproximately three weeks per target for regular groups

TemperatureNot applicable

SeedNot reported

Repeatsup to five standard models per target

Graderofficial CASP/OpenStructure and CAPRI-compatible scoring plus independent complex assessor team · human review: yes

Statisticscumulative per-target z-scores and head-to-head comparisons; rankings reported for first and best models

Contaminationexperimental complex structures withheld until prediction closes

Metrics, results, and full protocol

Metrics

Metric	Kind / baseline	Unit	Aggregation	Threshold / tolerance
DockQ	absolute	proportion	per target followed by cumulative z-score ranking	0.5
TM-score	absolute	proportion	per target followed by cumulative z-score ranking	Not reported
lDDT	absolute	proportion	per target followed by cumulative z-score ranking	Not reported
ICS	absolute	F1 score	per target followed by cumulative z-score ranking	Not reported
IPS	absolute	Jaccard score	per target followed by cumulative z-score ranking	Not reported
QSbest	absolute	Jaccard score	per target followed by cumulative z-score ranking	Not reported

No numeric result rows are published yet; the verified protocol remains useful.

Evidence

section: Overview of targets; Phase 1 Ranking; Performance Evaluation and Ranking (40 Phase-1 targets, supplied stoichiometry, overall/interface metrics, first/best model analyses, and group ranking aggregation.) — supports /benchmark_version, /scope, /protocol/grader, /protocol/statistical, /metrics
section: Protein Complexes; Registration; Model submission/format; Assessment (Blind regular-group protocol, participant method freedom, deadlines, and assessors.) — supports /protocol/shots, /protocol/turns, /protocol/system_prompt_public, /protocol/reasoning, /protocol/tools, /protocol/token_budget, /protocol/time_budget, /protocol/temperature, /protocol/seed, /protocol/repeats, /protocol/contamination

Evidence and change history

Source locators remain visible; expand an item to inspect the exact Registry fields it supports.

Assessment of Protein Complex Predictions in CASP16: Are We Making Progress? · section: Overview of CASP16 oligomer targets; Performance Evaluation and Ranking (Reports 40 Phase-1 targets, 30 reused in Phase 0, 35 in Phase 2, eight antibody/nanobody-antigen targets, and DockQ/TM/lDDT/interface metrics.) · Supports 15 fields

Open source →

/name
/aliases
/summary
/kind
/organizations
/domains
/capabilities
/modalities
/task_formats
/access/grader
/resources
/implementations
/versions/0/task_counts/total
/versions/0/task_counts/basis
/versions/0/task_counts/subsets

CASP16 official competition and results archive · section: CASP16 Timetable and Protein Complexes (Establishes the 2024 round start and the completed multimer category protocol.) · Supports 2 fields

Open source →

/release_date
/versions/0/release_date

casp-multimer-casp17-numbers-resource · table: CASP17 in numbers, accessed 2026-07-21 (Reports 61 multimer targets released with stoichiometry.) · Supports 9 fields

Open source →

/task_counts/total
/task_counts/basis
/task_counts/subsets
/coverage_notes/0
/versions/1/as_of
/versions/1/task_counts/total
/versions/1/task_counts/basis
/versions/1/task_counts/subsets
/scientific_task_classification/entries/0

CASP17 official competition · section: Difficult Protein Structures and Complexes; Immune Complexes; Timetable; Results (Defines the active CASP17 complex categories, public target protocol, and scheduled result release.) · Supports 8 fields

Open source →

/latest_version
/versions/1/formal_tracks
/access/level
/access/tasks
/access/artifacts
/access/license
/access/biosafety_notes
/scientific_task_classification/entries/1

casp-multimer-casp17-target-list-resource · table: Target List, first protein-complex target H1311 released 2026-04-28 (Establishes the first release date used for the CASP17 multimer snapshot.) · Supports 1 field

Open source →

/versions/1/release_date

View source-level modification history on GitHub →

Access & reproducibility

Access: Partially open
License: CC BY 4.0 for Prediction Center website content; linked structures and predictions may have separate terms
Grader: OpenStructure/CASP and CAPRI measures plus independent assessor review.
Implementations: 1 recorded · official

Resources & implementations

Primary resources

casp-multimer-casp16-home-resource · CC BY 4.0 (website)
website · snapshot CASP16 · checked 2026-07-21
casp-multimer-casp16-results-resource · CC BY 4.0 (website)
leaderboard · snapshot CASP16-protein-multimers · checked 2026-07-21
casp-multimer-casp16-paper-resource · CC BY 4.0
paper · version Proteins 94(1):106-130 · checked 2026-07-21
casp-multimer-casp17-numbers-resource · CC BY 4.0 (website)
documentation · snapshot 2026-07-21 · checked 2026-07-21
casp-multimer-casp17-target-list-resource · CC BY 4.0 (website metadata)
dataset · snapshot 2026-07-21 · checked 2026-07-21

Implementations

Prediction Center/OpenStructure multimer assessment
official