track · audited · verified 2026-07-21
ProteinGym Clinical Substitutions
ProteinGym track for classifying expert-annotated human clinical substitution variants on a per-protein basis.
Benchmark definition
What is counted
- Version
- 1.3
- Total
- 2525 (clinical proteins)
- Task formats
- clinical variant classification
- Capabilities
- Modalities
Version history
| Version | Status | Release / as-of | Total | Formal tracks |
|---|---|---|---|---|
1.0proteingym-clinical-sub-v10 | superseded | 2023-12-08 | 2525 (clinical proteins) | None registered |
1.3proteingym-clinical-sub-v13 | current | 2025-04-27 | 2525 (clinical proteins) | None registered |
Scientific Task Atlas
Scientific task classification
complete for 1.3. Formal clinical substitution track.
| Scientific task | Coverage | Count | Mapping | Evidence |
|---|---|---|---|---|
| Protein clinical variant interpretation | explicitly-in-scope | 2525 records Clinical proteins. | official-track high confidence | proteingym-clinical-sub-evidence-v13The registry count unit is proteins, not variants. |
Evaluation registry
Works and run settings
A setting change—scope, prompt, tools, budget, grader, or repeats—creates a separate run. Charts never cross a comparability group.
No normalized evaluation run is published yet. Creator evidence is still attached below.
Evidence and change history
Source locators remain visible; expand an item to inspect the exact Registry fields it supports.
ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · section: pp. 1–9 and 31, Sections 3–5 and Appendix A.3.2 (Track definition, identity, domains, modalities, classification format, metric, and access.) · Supports 10 fields
/name/organizations/release_date/latest_version/kind/summary/domains/capabilities/modalities/task_formats
ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · table: pp. 6 and 29, Tables 1 and A1 (2,525 clinical substitution proteins in v1.0.) · Supports 3 fields
/versions/0/task_counts/total/versions/0/task_counts/basis/versions/0/task_counts/subsets
proteingym-clinical-sub-v13-resource · repository-path: clinical_substitutions.csv in Zenodo record 15293562 (2,525 reference rows, one per clinical protein.) · Supports 7 fields
/task_counts/total/task_counts/basis/task_counts/subsets/versions/1/task_counts/total/versions/1/task_counts/basis/versions/1/task_counts/subsets/scientific_task_classification/entries/0
proteingym-clinical-sub-repository-resource · repository-path: README.md Overview, Results, Resources, Usage and reproducibility, and License (Current version, downloads, scoring, implementation, and MIT license.) · Supports 9 fields
/latest_version/access/level/access/tasks/access/artifacts/access/grader/access/license/access/biosafety_notes/resources/implementations