LAB-Bench DbQA — Protein variant from sequence
Uses a protein sequence and ClinVar lookup to identify benign or pathogenic variants.
Scientific task · Variant and perturbation effect
Classify or prioritize protein variants for clinical relevance or pathogenicity.
蛋白质临床变异解读
protein-clinical-variant-interpretationCoverage
Uses a protein sequence and ClinVar lookup to identify benign or pathogenic variants.
Identifies ClinVar variant pathogenicity while reasoning across multiple protein sequences.
Versioned deep-mutational-scanning and clinical-variant benchmarks for protein fitness prediction and design in zero-shot and supervised regimes.
ProteinGym track for classifying short human clinical insertion and deletion variants against ClinVar and gnomAD-derived labels.
ProteinGym track for classifying expert-annotated human clinical substitution variants on a per-protein basis.
Each row keeps its original unit and basis. Rows with different units or overlapping mappings are never added.
| Benchmark | Mapped task | Coverage | Count | Version | Evidence |
|---|---|---|---|---|---|
| LAB-Bench DbQA — Protein variant from sequence root: lab-bench | Protein clinical variant interpretation official-track · high | explicitly-in-scope | 100 questions questions across public and private splits | repository-998a8e0 | lab-bench-dbqa-variant-from-sequence-evidence-paper |
| LAB-Bench DbQA — Protein variant with multiple sequences root: lab-bench | Protein clinical variant interpretation official-track · high | explicitly-in-scope | 100 questions questions across public and private splits | repository-998a8e0 | lab-bench-dbqa-variant-multi-sequence-evidence-paper |
| ProteinGym root: proteingym | Protein clinical variant interpretation official-track · high | explicitly-in-scope | Not reported Clinical substitution and indel tracks. | 1.3 | proteingym-evidence-taxonomy |
| ProteinGym Clinical Indels root: proteingym | Protein clinical variant interpretation official-track · high | explicitly-in-scope | 1555 records Clinical proteins. | 1.3 | proteingym-clinical-indel-evidence-v13 |
| ProteinGym Clinical Substitutions root: proteingym | Protein clinical variant interpretation official-track · high | explicitly-in-scope | 2525 records Clinical proteins. | 1.3 | proteingym-clinical-sub-evidence-v13 |
Runs are included only for benchmark records mapped here (and formal child tracks when a mapped suite is the root). A task mapping does not imply that every run isolates this task.
| Work | Provider / class | Related runs |
|---|---|---|
| LAB-Bench: Measuring Capabilities of Language Models for Biology Research | FutureHouse benchmark_creator | lab-bench-dbqa-variant-from-sequence-creator-mcqlab-bench-dbqa-variant-multi-sequence-creator-mcq |
| ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design | University of Oxford, Harvard Medical School, Seismic Therapeutic, Harvard University, Centre for Genomic Regulation, Universitat Pompeu Fabra, Broad Institute benchmark_creator | proteingym-v10-dms-substitutions-zero-shot |