Tier B · benchmark_suite

Numeric results available

BEACON

Thirteen native tasks; some reuse OpenVaccine, Optimus and CRISPR datasets.

Result coverage

221 result rows across 13 protocols

Primary sources: primary_sources_screened
Related works: priority_systematic_search_complete
Authority readiness: verified_for_internal_use
Literature cutoff: 2026-08-06

Track	Numeric coverage	Evidence closure	Blocker
`B09-TR01` BEACON — RNA secondary-structure base-pair prediction	numeric_results_available 34 results	closed_with_numeric_evidence	NR
`B09-TR02` BEACON — RNA contact or distance-map prediction	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR03` BEACON — RNA probing-reactivity prediction	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR04` BEACON — Splice-site prediction	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR05` BEACON — Alternative polyadenylation quantification	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR06` BEACON — ncRNA family classification	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR07` BEACON — RNA modification-site prediction	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR08` BEACON — Translation efficiency or ribosome-load prediction	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR09` BEACON — RNA degradation and vaccine-stability prediction	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR10` BEACON — Programmable RNA-switch function prediction	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR11` BEACON — CRISPR guide on-target design	numeric_results_available 17 results	closed_with_numeric_evidence	NR
`B09-TR12` BEACON — CRISPR guide off-target design	numeric_results_available 17 results	closed_with_numeric_evidence	NR

Protocol-level results

Choose the evaluation unit before comparing scores.

Each card keeps the four claim types inside one protocol + metric fingerprint.

RNA secondary-structure base-pair prediction · B09-TR01 · same_source_table

SSP

Full results →

SSP · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

F1binary · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

RNA-FM0.685F1 · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-11F3C2F05D3765DD38CCB2BE

RNA contact or distance-map prediction · B09-TR02 · same_source_table

CMP

Full results →

CMP · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

P@Lcontact prediction · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

BEACON-B5120.612P@L · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-7DE315964061D7CBFF53C6DF

RNA probing-reactivity prediction · B09-TR03 · same_source_table

DMP

Full results →

DMP · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

R²coefficient of determination · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

BEACON-B5120.5682R² · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-D65649B0ADEB7DB8A73DD55E

RNA secondary-structure base-pair prediction · B09-TR01 · same_source_table

SSI

Full results →

SSI · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

R²coefficient of determination · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

RNA-FM0.4236R² · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-F46220E46265671267C34BA2

Splice-site prediction · B09-TR04 · same_source_table

SPL

Full results →

SPL · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

ACC@Ktop-K accuracy · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

Splice-MS5100.5055ACC@K · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-8F93B5DB293C785E3C145950

Alternative polyadenylation quantification · B09-TR05 · same_source_table

APA

Full results →

APA · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

R²coefficient of determination · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

UTRBERT-4mer0.7271R² · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-EBD0D882A306F188559DA397

ncRNA family classification · B09-TR06 · same_source_table

NcRNA

Full results →

NcRNA · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

Accuracyclassification · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

RNA-FM0.9681Accuracy · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-00E960A8D8262B6DDD7F2E75

RNA modification-site prediction · B09-TR07 · same_source_table

Modif

Full results →

Modif · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

AUROCclassification · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

UTRBERT-3mer0.9514AUROC · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-35DA7A81E1849F1E3859741B

Translation efficiency or ribosome-load prediction · B09-TR08 · same_source_table

MRL

Full results →

MRL · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

R²coefficient of determination · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

Splice-MS5100.8498R² · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-9EA295D7EE86D044AEB0BFBD

RNA degradation and vaccine-stability prediction · B09-TR09 · same_source_table

VDP

Full results →

VDP · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

MCRMSEmulti-column RMSE · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

Splice-MS10240.313MCRMSE · rawEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-DBF811A8F3504CF49BA29EC3

Programmable RNA-switch function prediction · B09-TR10 · same_source_table

PRS

Full results →

PRS · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

R²coefficient of determination · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

Splice-MS10240.5772R² · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-251A42653730B4EE237E2D78

CRISPR guide on-target design · B09-TR11 · same_source_table

CRI-On

Full results →

CRI-On · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

Spearman ρrank correlation · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

RNA-MSM0.3492Spearman ρ · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-A4BEAECD3FC62C85E6D28EFC

CRISPR guide off-target design · B09-TR12 · same_source_table

CRI-Off

Full results →

CRI-Off · official train/validation/test split · full fine-tuning for BERT-like RNA LMs; official baseline setup

Spearman ρrank correlation · 17 results

Official baseline

No eligible claimNo qualifying result exists in this snapshot.

Original-table best

ResNet0.115Spearman ρ · fractionEvidence ↗

Official board / challenge leader

No eligible claimNo qualifying result exists in this snapshot.

Strict cross-work SOTA

No eligible claimAn original-table best is never substituted for cross-work SOTA.

Fingerprint: PMF-v1-59245AB58779E53AF0996E96

Tasks & tracks

B09-TR01
BEACON — RNA secondary-structure base-pair prediction
B09-TR02
BEACON — RNA contact or distance-map prediction
B09-TR03
BEACON — RNA probing-reactivity prediction
B09-TR04
BEACON — Splice-site prediction
B09-TR05
BEACON — Alternative polyadenylation quantification
B09-TR06
BEACON — ncRNA family classification
B09-TR07
BEACON — RNA modification-site prediction
B09-TR08
BEACON — Translation efficiency or ribosome-load prediction
B09-TR09
BEACON — RNA degradation and vaccine-stability prediction
B09-TR10
BEACON — Programmable RNA-switch function prediction
B09-TR11
BEACON — CRISPR guide on-target design
B09-TR12
BEACON — CRISPR guide off-target design

Official links

License: repo/source-specific
Access: open

Atlas crosswalk

beacon-rna
same_entity