CAMEO
Weekly, automated, independent, blind evaluation of registered macromolecular structure-prediction servers on complete PDB entries whose experimental structures are withheld during prediction.
Scientific task · Structure prediction
Predict or assess the three-dimensional structure of proteins or protein assemblies.
蛋白质结构预测
protein-structureCoverage
Weekly, automated, independent, blind evaluation of registered macromolecular structure-prediction servers on complete PDB entries whose experimental structures are withheld during prediction.
Biennial blind community experiments that assess macromolecular structure, complex, ligand, and model-accuracy prediction against experimental structures withheld during prediction.
Formal CASP track assessing blind protein-complex predictions, including overall folds, interfaces, stoichiometry-free phases, and model-selection phases.
A five-task benchmark for protein representation learning spanning secondary structure, residue contacts, remote homology, fluorescence, and stability.
A living collection of eight curated 3D molecular-learning tasks spanning small molecules, protein interactions and mutations, ligand binding, and protein/RNA structure ranking.
Formal CASP track assessing blind predictions of single-protein structures and post hoc protein evaluation units against withheld experimental coordinates.
A creator-curated set of 944 protein-science multiple-choice questions with answer explanations, generated from research literature and released for evaluating text LLM protein understanding.
Each row keeps its original unit and basis. Rows with different units or overlapping mappings are never added.
| Benchmark | Mapped task | Coverage | Count | Version | Evidence |
|---|---|---|---|---|---|
| CAMEO root: cameo | Protein complex structure prediction official-taxonomy · high | explicitly-in-scope | Not reported Weekly complete-complex targets in the current CAMEO service. | current-complex-3d as of 2026-07-21 | cameo-evidence-current-help |
| CASP root: casp | Protein complex structure prediction official-track · high | explicitly-in-scope | 61 targets CASP17 multimer target re-releases with stoichiometry as of 2026-07-21. | CASP17 as of 2026-07-21 | casp-evidence-casp17-counts |
| CASP Protein Multimers root: casp | Protein complex structure prediction official-track · high | explicitly-in-scope | 61 targets CASP17 multimer target re-releases with stoichiometry as of 2026-07-21. | CASP17 as of 2026-07-21 | casp-multimer-evidence-casp17 |
| TAPE root: tape | Protein contact-map prediction official-taxonomy · high | explicitly-in-scope | 1 tasks Supervised downstream benchmark tasks. | original-2019 | tape-paper-definition-evidence |
| ATOM3D root: atom3d | Protein model quality assessment official-track · high | explicitly-in-scope | 1 tasks Curated 3D benchmark datasets. | v0.2.6 as of 2026-07-22 | atom3d-paper-definition-evidence |
| CAMEO root: cameo | Protein model quality assessment official-taxonomy · high | explicitly-in-scope | Not reported Weekly targets and submitted server models. | current-complex-3d as of 2026-07-21 | cameo-evidence-2024-study |
| CASP root: casp | Protein model quality assessment official-track · high | explicitly-in-scope | Not reported CASP17 model-selection and accuracy-estimation targets. | CASP17 as of 2026-07-21 | casp-evidence-casp17-protocol |
| CASP Protein Multimers root: casp | Protein model quality assessment official-track · high | explicitly-in-scope | Not reported CASP17 multimer model-selection evaluation units. | CASP17 as of 2026-07-21 | casp-multimer-evidence-casp17-protocol |
| CASP root: casp | Protein monomer structure prediction official-track · high | explicitly-in-scope | Not reported CASP17 assessed monomer evaluation units. | CASP17 as of 2026-07-21 | casp-evidence-casp17-protocol |
| CASP Protein Monomers root: casp | Protein monomer structure prediction official-track · high | explicitly-in-scope | Not reported CASP17 assessed monomer evaluation units. | CASP17 as of 2026-07-21 | casp-monomer-evidence-casp17 |
| TAPE root: tape | Protein secondary-structure prediction official-taxonomy · high | explicitly-in-scope | 1 tasks Supervised downstream benchmark tasks. | original-2019 | tape-paper-definition-evidence |
| ProteinLMBench root: proteinlmbench | Protein structure prediction official-taxonomy · high | explicitly-in-scope | Not reported Released ProteinLMBench question records. | hf-f139796 | proteinlmbench-evidence-paper |
Runs are included only for benchmark records mapped here (and formal child tracks when a mapped suite is the root). A task mapping does not imply that every run isolates this task.