CompBioBench
A 100-task agent benchmark of objectively gradable computational-biology problems requiring multi-step reasoning, bespoke code, tools, and real-world external resources.
Scientific domain
Preclinical-to-clinical reasoning
临床与转化
A 100-task agent benchmark of objectively gradable computational-biology problems requiring multi-step reasoning, bespoke code, tools, and real-world external resources.
A research-level agent benchmark of 129 synthetic, multistage computational-biology analyses that require iterative QC, statistical modeling, diagnostics, and decision-relevant judgment.
A practical biology-research suite of 2,457 multiple-choice questions across eight broad categories and 31 versioned task files, with public and private contamination-monitoring splits.
Database-retrieval category spanning 10 genomics, clinical, protein, regulatory, vaccine-response, and viral-PPI tasks.
Identifies genes associated with a phenotype in DisGeNET but not OMIM.
Retrieves genes in Mammalian Phenotype Tumor Ontology gene sets.
Retrieves membership in MSigDB C6 oncogenic-signature gene sets.
Uses a protein sequence and ClinVar lookup to identify benign or pathogenic variants.
Identifies ClinVar variant pathogenicity while reasoning across multiple protein sequences.
Retrieves membership in MSigDB vaccine-response gene sets.
Expert-authored, artifact-rich free-response tasks that evaluate realistic research judgment across applied life-science workflows.
The original molecular-machine-learning benchmark of 17 dataset collections and more than 800 prediction endpoints spanning quantum, physicochemical, biophysical, and physiological properties.
Versioned deep-mutational-scanning and clinical-variant benchmarks for protein fitness prediction and design in zero-shot and supervised regimes.
ProteinGym track for classifying short human clinical insertion and deletion variants against ClinVar and gnomAD-derived labels.
ProteinGym track for classifying expert-annotated human clinical substitution variants on a per-protein basis.
Registry records tagged Clinical and translational, counted by capability.
| Capability | Records |
|---|---|
| Knowledge | 6 |
| Evidence synthesis | 2 |
| Retrieval | 10 |
| Prediction | 6 |
| Classification | 8 |
| Regression | 2 |
| Design | 3 |
| Generation | 1 |
| Optimization | 2 |
| Data analysis | 4 |
| Coding | 2 |
| Tool use | 3 |
| Experiment planning | 2 |
| Troubleshooting | 2 |
| Scientific reasoning | 8 |
| Scientific communication | 1 |
Task mappings are evidence-backed and may be partial for mixed suites.