BEACON
A 13-task RNA representation benchmark covering structure, function, processing, modification, translation, degradation, programmable switches, and CRISPR activity.
Scientific domain
Genomics
Genome variation
基因组学
44 registered benchmarks and tracks
benchmark-dual human CRISPR-Cas9 library
A human CRISPR-Cas9 paired-guide library created to compare dual- and single-targeting strategies in loss-of-function screens.
benchmark human CRISPR-Cas9 library
A human CRISPR-Cas9 guide-RNA library assembled to compare single-targeting library performance in loss-of-function screens.
Biology-Instructions
A multi-omics sequence-instruction suite with 21 formal predictive tasks across DNA, RNA, protein, and multi-molecule inputs; the final paper reports task-specific held-out evaluations rather than a single aggregate score.
Biology-Instructions Core Promoter Detection
Binary detection of a core promoter in a short DNA sequence, evaluated with Matthews correlation coefficient.
Biology-Instructions CRISPR On-Target Prediction
Regression of CRISPR guide on-target activity from an RNA sequence, evaluated with Spearman rank correlation.
Biology-Instructions Enhancer Activity Prediction
Two-output regression of housekeeping and developmental enhancer activity from a DNA sequence, evaluated with separate Pearson correlations.
Biology-Instructions Epigenetic Marks Prediction
Binary prediction of whether a DNA sequence carries an epigenetic mark, evaluated with Matthews correlation coefficient.
Biology-Instructions Enhancer-Promoter Interaction Prediction
Binary interaction prediction for enhancer and promoter DNA sequences, evaluated with Matthews correlation coefficient.
Biology-Instructions Promoter Detection 300
Binary promoter detection in a 300-base-pair DNA context, evaluated with Matthews correlation coefficient.
Biology-Instructions Human Transcription Binding Sites Detection
Binary detection of transcription-factor binding sites in human DNA sequences, evaluated with Matthews correlation coefficient.
Biology-Instructions Mouse Transcription Binding Sites Detection
Binary detection of transcription-factor binding sites in mouse DNA sequences, evaluated with Matthews correlation coefficient.
BioMysteryBench
An agentic bioinformatics benchmark of objective, expert-authored mysteries over anonymized real-world biological data, scored on final answers rather than prescribed analysis paths.
BioSecBench-Surveillance
Agentic evaluation of pathogen genomic-surveillance workflow selection and analysis from raw or near-raw sequencing data.
BixBench
A containerized benchmark of long-horizon bioinformatics analysis over real published notebooks and associated data, with open-answer and multiple-choice evaluation modes.
CompBioBench
A 100-task agent benchmark of objectively gradable computational-biology problems requiring multi-step reasoning, bespoke code, tools, and real-world external resources.
GeneBench-Pro
A research-level agent benchmark of 129 synthetic, multistage computational-biology analyses that require iterative QC, statistical modeling, diagnostics, and decision-relevant judgment.
Genomic Benchmarks
A versioned collection of nine DNA sequence-classification datasets covering regulatory elements, promoters, enhancers, open chromatin, species, and coding-context discrimination.
LAB-Bench
A practical biology-research suite of 2,457 multiple-choice questions across eight broad categories and 31 versioned task files, with public and private contamination-monitoring splits.
LAB-Bench CloningScenarios
Human-hard, multi-step multiple-choice scenarios involving plasmids, DNA fragments, enzymes, and molecular-cloning workflows.
LAB-Bench DbQA
Database-retrieval category spanning 10 genomics, clinical, protein, regulatory, vaccine-response, and viral-PPI tasks.
LAB-Bench DbQA — Disease gene associations
Identifies genes associated with a phenotype in DisGeNET but not OMIM.
LAB-Bench DbQA — Gene location
Retrieves human-gene cytogenetic locations from the stated Ensembl release.
LAB-Bench DbQA — miRNA targets
Retrieves computationally predicted human miRNA targets from miRDB.
LAB-Bench DbQA — Mouse tumor gene sets
Retrieves genes in Mammalian Phenotype Tumor Ontology gene sets.
LAB-Bench DbQA — Oncogenic signatures
Retrieves membership in MSigDB C6 oncogenic-signature gene sets.
LAB-Bench DbQA — GTRD transcription-factor binding sites
Retrieves promoter-region transcription-factor binding-site annotations from GTRD.
LAB-Bench SeqQA
Sequence-comprehension and manipulation category spanning 15 formal tasks involving PCR, restriction digestion, ORFs, translation, GC content, and DNA–protein relationships.
LAB-Bench SeqQA — ORF amino-acid position
Finds the amino acid encoded at a specified position in the longest ORF of a DNA sequence.
LAB-Bench SeqQA — ORF amino-acid sequence
Translates the longest ORF in a DNA sequence to its amino-acid sequence.
LAB-Bench SeqQA — ORF count above length
Counts open reading frames encoding proteins above a specified amino-acid length.
LAB-Bench SeqQA — Gene-to-restriction primers
Selects restriction-cloning primers from a named gene and enzyme pair.
LAB-Bench SeqQA — Gene-to-Gibson primers (HindIII)
Selects primers for Gibson assembly into a HindIII-linearized vector.
LAB-Bench SeqQA — Gene-to-Gibson primers (SmaI)
Selects primers for Gibson assembly into a SmaI-linearized vector.
LAB-Bench SeqQA — Primers-to-restriction enzymes
Infers restriction enzymes from a gene name and primer pair.
LAB-Bench SeqQA — Amplicon length to primers
Selects primers that produce a requested amplicon length from a DNA template.
LAB-Bench SeqQA — Primers to amplicon length
Calculates expected amplicon length from a primer pair and DNA template.
LAB-Bench SeqQA — Sequence-to-restriction primers
Selects restriction-cloning primers from an explicit gene sequence and enzyme pair.
LAB-Bench SeqQA — Amplicon sequence to primers
Selects primers that produce a requested amplicon sequence from a DNA template.
LAB-Bench SeqQA — GC percentage
Calculates the rounded GC percentage of a DNA sequence.
LAB-Bench SeqQA — Restriction-fragment lengths
Calculates fragment lengths after restriction digestion of a DNA sequence.
LAB-Bench SeqQA — Restriction-fragment count
Calculates the number of fragments after restriction digestion of a DNA sequence.
LifeSciBench
Expert-authored, artifact-rich free-response tasks that evaluate realistic research judgment across applied life-science workflows.
VirBench
Retrieval benchmark that tests whether scientific agents can answer verified viral-sequence questions by querying NCBI Virus.
Capability coverage
Registry records tagged Genomics, counted by capability.
Accessible data table
| Capability | Records |
|---|---|
| Knowledge | 8 |
| Evidence synthesis | 2 |
| Retrieval | 11 |
| Prediction | 17 |
| Classification | 11 |
| Regression | 4 |
| Design | 10 |
| Generation | 1 |
| Optimization | 1 |
| Data analysis | 18 |
| Coding | 4 |
| Tool use | 8 |
| Experiment planning | 3 |
| Troubleshooting | 3 |
| Scientific reasoning | 23 |
| Scientific communication | 1 |
Scientific Tasks in this domain
Task mappings are evidence-backed and may be partial for mixed suites.
Coverage-gap reading: zero counts indicate a gap in this registry, not proof that no benchmark exists. Propose a primary source through the contribution form.