BioBench Atlas
Benchmarks/Biology-Instructions/Biology-Instructions Mouse Transcription Binding Sites Detection

track · audited · verified 2026-07-21

Biology-Instructions Mouse Transcription Binding Sites Detection

Binary detection of transcription-factor binding sites in mouse DNA sequences, evaluated with Matthews correlation coefficient.

GenomicsTranscription-factor binding-site prediction

Benchmark definition

What is counted

Version
emnlp-2025
Total
100028 (distinct examples across the published train, validation, and test splits)
Task formats
mouse DNA-sequence binary classification
Capabilities
PredictionClassification
Modalities
TextDNA or RNA sequence

Version history

VersionStatusRelease / as-ofTotalFormal tracks
emnlp-2025
bioinstruction-tb-mouse-emnlp-2025		current2025-11-04100028 (distinct examples across the published train, validation, and test splits)None registered

Tracks and subsets

IDCountBasisPartition?Notes
Training split
bioinstruction-tb-mouse-train		80018examplesExclusive & exhaustivePublished training split.
Validation split
bioinstruction-tb-mouse-validation		10005examplesExclusive & exhaustivePublished validation split.
Test split
bioinstruction-tb-mouse-test		10005examplesExclusive & exhaustiveHeld-out split used for creator-paper Tables 4-7.

Scientific Task Atlas

Scientific task classification

complete for emnlp-2025. Single-purpose formal Biology-Instructions evaluation track.

Scientific taskCoverageCountMappingEvidence
Transcription-factor binding-site predictionexplicitly-in-scope100028 examples
distinct examples across the published train, validation, and test splits		official-track
high confidence		bioinstruction-tb-mouse-evidence-paper
Mouse transcription-factor binding-site detection.

Evaluation registry

Works and run settings

A setting change—scope, prompt, tools, budget, grader, or repeats—creates a separate run. Charts never cross a comparability group.

bioinstruction-tb-mouse-closed-baselines-emnlp-2025vemnlp-2025

Evaluated models / systems: GPT-4o (Biology-Instructions snapshot not reported), GPT-4o-mini (Biology-Instructions snapshot not reported)

Scopesubset · n=10005
Shots0
Turnssingle-turn
System prompt publicYes
Reasoning / effortThe prompt requests a direct JSON answer and no chain-of-thought.
BrowserNo
InternetNo
DatabasesNo
Code executionNo
ContainerNot reported
External toolsNo
Token budgetNot reported
Time / cost budgetNot reported
TemperatureNot reported
SeedNot reported
RepeatsNot reported
Graderkeyword-first binary extraction with sentiment-model fallback, followed by MCC · model: cardiffnlp/twitter-roberta-base-sentiment-latest fallback · human review: no
StatisticsPoint metric over the complete published test split, scaled by 100 and rounded to two decimals; no confidence interval is reported.
ContaminationNot reported
Metrics, results, and full protocol

Metrics

MetricKind / baselineUnitAggregationThreshold / tolerance
MCCabsolutepercentMatthews correlation coefficient across held-out test examples, scaled by 100Not reported

Results

ModelMetricValuen
GPT-4o-mini (Biology-Instructions snapshot not reported)MCC-0.31 percent
TB-M creator-paper result; metric scaled by 100.		10005
GPT-4o (Biology-Instructions snapshot not reported)MCC-1.38 percent
TB-M creator-paper result; metric scaled by 100.		10005

Evidence

  • table: Table 2 (TB-M test split); Appendix A.3; Table 8; Table 9 closed-source prompt (Scope, prompt, output parser, grader, scaling, and aggregation.) — supports /scope, /benchmark_version, /model_ids, /protocol, /metrics
  • table: Table 4 (TB-M column) (All registered model values; literature-SOTA row omitted.) — supports /results
bioinstruction-tb-mouse-creator-systems-emnlp-2025vemnlp-2025

Evaluated models / systems: ChatMultiOmics stage 1 + balanced stage 2, ChatMultiOmics stage 1 + stage 2, ChatMultiOmics, ChatMultiOmics stage 2 only

Scopesubset · n=10005
Shots0
Turnssingle-turn
System prompt publicYes
Reasoning / effortPsc requests clear, concise task answers and numeric output for regression tasks.
BrowserNo
InternetNo
DatabasesNo
Code executionNo
ContainerNot reported
External toolsNo
Token budgetNot reported
Time / cost budgetNot reported
TemperatureNot reported
SeedNot reported
RepeatsNot reported
Graderkeyword-first binary extraction with sentiment-model fallback, followed by MCC · model: cardiffnlp/twitter-roberta-base-sentiment-latest fallback · human review: no
StatisticsPoint metric over the complete published test split, scaled by 100 and rounded to two decimals; no confidence interval is reported.
ContaminationNot reported
Metrics, results, and full protocol

Metrics

MetricKind / baselineUnitAggregationThreshold / tolerance
MCCabsolutepercentMatthews correlation coefficient across held-out test examples, scaled by 100Not reported

Results

ModelMetricValuen
ChatMultiOmics stage 1 + balanced stage 2MCC0.88 percent
TB-M creator-paper result; metric scaled by 100.		10005
ChatMultiOmics stage 2 onlyMCC0.13 percent
TB-M creator-paper result; metric scaled by 100.		10005
ChatMultiOmics stage 1 + stage 2MCC27.94 percent
TB-M creator-paper result; metric scaled by 100.		10005
ChatMultiOmicsMCC39.91 percent
TB-M creator-paper result; metric scaled by 100.		10005

Evidence

  • table: Table 2 (TB-M test split); Appendix A.3; Table 8; Section 4.2 Psc prompt (Scope, prompt, output parser, grader, scaling, and aggregation.) — supports /scope, /benchmark_version, /model_ids, /protocol, /metrics
  • table: Table 4 (TB-M column) (All registered model values; literature-SOTA row omitted.) — supports /results
bioinstruction-tb-mouse-open-baselines-emnlp-2025vemnlp-2025

Evaluated models / systems: Alpaca-7B (Biology-Instructions label), Galactica-1.3B (Biology-Instructions label), GLM-4-9B-Chat (Biology-Instructions label), InstructProtein-1.3B (Biology-Instructions label), Llama-molinst-protein-7B (Mol-Ins), Llama2-7B-Chat (Biology-Instructions label), LLaMA3.1-8B-Instruct (Biology-Instructions label), Qwen2-7B (Biology-Instructions label), Vicuna-v1.5-7B (Biology-Instructions label)

Scopesubset · n=10005
Shots0
Turnssingle-turn
System prompt publicNo
Reasoning / effortThe prompt requests the task-formatted answer and says not to explain or repeat.
BrowserNo
InternetNo
DatabasesNo
Code executionNo
ContainerNot reported
External toolsNo
Token budgetNot reported
Time / cost budgetNot reported
TemperatureNot reported
SeedNot reported
RepeatsNot reported
Graderkeyword-first binary extraction with sentiment-model fallback, followed by MCC · model: cardiffnlp/twitter-roberta-base-sentiment-latest fallback · human review: no
StatisticsPoint metric over the complete published test split, scaled by 100 and rounded to two decimals; no confidence interval is reported.
ContaminationNot reported
Metrics, results, and full protocol

Metrics

MetricKind / baselineUnitAggregationThreshold / tolerance
MCCabsolutepercentMatthews correlation coefficient across held-out test examples, scaled by 100Not reported

Results

ModelMetricValuen
LLaMA3.1-8B-Instruct (Biology-Instructions label)MCC-1.42 percent
TB-M creator-paper result; metric scaled by 100.		10005
Qwen2-7B (Biology-Instructions label)MCC-1.59 percent
TB-M creator-paper result; metric scaled by 100.		10005
Llama2-7B-Chat (Biology-Instructions label)MCC0.97 percent
TB-M creator-paper result; metric scaled by 100.		10005
Alpaca-7B (Biology-Instructions label)MCC0 percent
TB-M creator-paper result; metric scaled by 100.		10005
GLM-4-9B-Chat (Biology-Instructions label)MCC0 percent
TB-M creator-paper result; metric scaled by 100.		10005
Vicuna-v1.5-7B (Biology-Instructions label)MCC0 percent
TB-M creator-paper result; metric scaled by 100.		10005
Galactica-1.3B (Biology-Instructions label)MCC-2.81 percent
TB-M creator-paper result; metric scaled by 100.		10005
InstructProtein-1.3B (Biology-Instructions label)MCC1.19 percent
TB-M creator-paper result; metric scaled by 100.		10005
Llama-molinst-protein-7B (Mol-Ins)MCC0.33 percent
TB-M creator-paper result; metric scaled by 100.		10005

Evidence

  • table: Table 2 (TB-M test split); Appendix A.3; Table 8; Table 9 open-source prompt (Scope, prompt, output parser, grader, scaling, and aggregation.) — supports /scope, /benchmark_version, /model_ids, /protocol, /metrics
  • table: Table 4 (TB-M column) (All registered model values; literature-SOTA row omitted.) — supports /results

Comparable result views

MCC

bioinstruction-tb-mouse-closed-baselines · bioinstruction-tb-mouse-closed-baselines-emnlp-2025

CSV ↓
Accessible data table
ModelValueComparability group
GPT-4o-mini (Biology-Instructions snapshot not reported)-0.31bioinstruction-tb-mouse-closed-baselines-emnlp-2025
GPT-4o (Biology-Instructions snapshot not reported)-1.38bioinstruction-tb-mouse-closed-baselines-emnlp-2025

MCC

bioinstruction-tb-mouse-creator-systems · bioinstruction-tb-mouse-creator-systems-emnlp-2025

CSV ↓
Accessible data table
ModelValueComparability group
ChatMultiOmics stage 1 + balanced stage 20.88bioinstruction-tb-mouse-creator-systems-emnlp-2025
ChatMultiOmics stage 2 only0.13bioinstruction-tb-mouse-creator-systems-emnlp-2025
ChatMultiOmics stage 1 + stage 227.94bioinstruction-tb-mouse-creator-systems-emnlp-2025
ChatMultiOmics39.91bioinstruction-tb-mouse-creator-systems-emnlp-2025

MCC

bioinstruction-tb-mouse-open-baselines · bioinstruction-tb-mouse-open-baselines-emnlp-2025

CSV ↓
Accessible data table
ModelValueComparability group
LLaMA3.1-8B-Instruct (Biology-Instructions label)-1.42bioinstruction-tb-mouse-open-baselines-emnlp-2025
Qwen2-7B (Biology-Instructions label)-1.59bioinstruction-tb-mouse-open-baselines-emnlp-2025
Llama2-7B-Chat (Biology-Instructions label)0.97bioinstruction-tb-mouse-open-baselines-emnlp-2025
Alpaca-7B (Biology-Instructions label)0bioinstruction-tb-mouse-open-baselines-emnlp-2025
GLM-4-9B-Chat (Biology-Instructions label)0bioinstruction-tb-mouse-open-baselines-emnlp-2025
Vicuna-v1.5-7B (Biology-Instructions label)0bioinstruction-tb-mouse-open-baselines-emnlp-2025
Galactica-1.3B (Biology-Instructions label)-2.81bioinstruction-tb-mouse-open-baselines-emnlp-2025
InstructProtein-1.3B (Biology-Instructions label)1.19bioinstruction-tb-mouse-open-baselines-emnlp-2025
Llama-molinst-protein-7B (Mol-Ins)0.33bioinstruction-tb-mouse-open-baselines-emnlp-2025

Evidence and change history

Source locators remain visible; expand an item to inspect the exact Registry fields it supports.

Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models · table: Table 2 (TB-M row); Appendix A.2-A.3; Table 8; Tables 4-7 (Task definition, split counts, input/output format, metric, and creator evaluation.) · Supports 29 fields

Open source →

  • /name
  • /aliases
  • /summary
  • /kind
  • /parent_id
  • /organizations
  • /release_date
  • /latest_version
  • /domains
  • /capabilities
  • /modalities
  • /task_formats
  • /task_counts/total
  • /task_counts/basis
  • /task_counts/subsets
  • /access/level
  • /access/tasks
  • /access/artifacts
  • /access/grader
  • /access/license
  • /access/biosafety_notes
  • /resources
  • /implementations
  • /versions/0/release_date
  • /versions/0/as_of
  • /versions/0/task_counts/total
  • /versions/0/task_counts/basis
  • /versions/0/task_counts/subsets
  • /scientific_task_classification/entries/0
bioinstruction-tb-mouse-repository-resource · repository-path: evaluation/evaluate.py and evaluation/register_tasks.json at 600acaa08c0302e8f5ce86de0fe041f21c13b53e (Public grader implementation, partial artifact release, and absent repository license.) · Supports 7 fields

Open source →

  • /access/level
  • /access/tasks
  • /access/artifacts
  • /access/grader
  • /access/license
  • /resources
  • /implementations

View source-level modification history on GitHub →