BioMysteryBench
An agentic bioinformatics benchmark of objective, expert-authored mysteries over anonymized real-world biological data, scored on final answers rather than prescribed analysis paths.
Scientific domain
Single-cell
Single-cell molecular measurements and analyses.
单细胞组学
10 registered benchmarks and tracks
BixBench
A containerized benchmark of long-horizon bioinformatics analysis over real published notebooks and associated data, with open-answer and multiple-choice evaluation modes.
CompBioBench
A 100-task agent benchmark of objectively gradable computational-biology problems requiring multi-step reasoning, bespoke code, tools, and real-world external resources.
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing
A reusable benchmark for comparing differential transcript usage detection tools across simulated and real transcriptomics data.
crafted experiments
Real single-cell RNA-seq data augmented with known gene perturbations for comparing feature-selection methods.
GeneBench-Pro
A research-level agent benchmark of 129 synthetic, multistage computational-biology analyses that require iterative QC, statistical modeling, diagnostics, and decision-relevant judgment.
scBench
Agentic evaluation suite for data-grounded single-cell analysis across diverse sequencing technologies and workflow stages.
scIB
A 13-task benchmark of single-cell data integration across simulated, scRNA-seq, and scATAC-seq settings, evaluated with 14 batch-removal and biological-conservation metrics.
Single-cell Omics Arena
A benchmark for evaluating LLM cell-type annotation across scRNA-seq and single-cell multiomics data.
SpatialBench
A benchmark of deterministic, verifiable agentic problems derived from real spatial-transcriptomics workflows, testing whether agents can manipulate data and recover key biological results.
Capability coverage
Registry records tagged Single-cell, counted by capability.
Accessible data table
| Capability | Records |
|---|---|
| Retrieval | 1 |
| Classification | 1 |
| Data analysis | 9 |
| Coding | 6 |
| Tool use | 6 |
| Scientific reasoning | 7 |
Scientific Tasks in this domain
Task mappings are evidence-backed and may be partial for mixed suites.
Coverage-gap reading: zero counts indicate a gap in this registry, not proof that no benchmark exists. Propose a primary source through the contribution form.