BEACON
Thirteen native tasks; some reuse OpenVaccine, Optimus and CRISPR datasets.
13 benchmark-wide protocols · 221 benchmark-wide rows (not a task subtotal)D2 · Structure & conformation
Predict base pairs or dot-bracket secondary structure.
Benchmark coverage
Thirteen native tasks; some reuse OpenVaccine, Optimus and CRISPR datasets.
13 benchmark-wide protocols · 221 benchmark-wide rows (not a task subtotal)Board is public; DeepASmRNA and DeeReCT-PolyA/PAS are exposed as distinct tracks; verify exact release and frozen splits before comparative claims.
79 benchmark-wide protocols · 2,093 benchmark-wide rows (not a task subtotal)Three core tasks plus a task-family view of the ribozyme-assay subset; the subset track is separated from the aggregate DMS-effect track.
2 benchmark-wide protocols · 7 benchmark-wide rows (not a task subtotal)Meta-suite packaging RGB, BEACON, GUE, Genomic Benchmarks and PGB; native_task_count=5 suites, not the sum of their downstream tasks.
0 benchmark-wide protocols · 0 benchmark-wide rows (not a task subtotal)One-time model study spanning 15 named data packages; PrismNet is additionally stratified into 17 HeLa RBP assays.
12 benchmark-wide protocols · 231 benchmark-wide rows (not a task subtotal)Evaluation protocols
| Protocol | Track | Split / subset | Comparability |
|---|---|---|---|
PROT-B09-SSP-OFFICIAL-TRAIN-VALIDATION-TEST-SPLIT-SSP-2C3CC744 | SSP B09-TR01 | official train/validation/test split SSP | same_table_comparable external_data_policy;inference_budget |
PROT-B09-SSI-OFFICIAL-TRAIN-VALIDATION-TEST-SPLIT-SSI-187B601E | SSI B09-TR01 | official train/validation/test split SSI | same_table_comparable external_data_policy;inference_budget |
PROT-B10-BPRNA-INTRA-FAMILY-PRECISION-49A347D1 | bpRNA B10-TR04 | intra-family Precision | official_board_comparable external_data_policy;inference_budget |
PROT-B10-BPRNA-INTRA-FAMILY-RECALL-9A874F35 | bpRNA B10-TR04 | intra-family Recall | official_board_comparable external_data_policy;inference_budget |
PROT-B10-BPRNA-INTRA-FAMILY-F1-EDFA8580 | bpRNA B10-TR04 | intra-family F1 | official_board_comparable external_data_policy;inference_budget |
PROT-B10-BPRNA-INTER-FAMILY-PRECISION-C19C4F65 | bpRNA B10-TR04 | inter-family Precision | official_board_comparable external_data_policy;inference_budget |
PROT-B10-BPRNA-INTER-FAMILY-RECALL-59F4E9D1 | bpRNA B10-TR04 | inter-family Recall | official_board_comparable external_data_policy;inference_budget |
PROT-B10-BPRNA-INTER-FAMILY-F1-49442E70 | bpRNA B10-TR04 | inter-family F1 | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-A-INTRA-FAMILY-PRECISION-C310A81C | Set A B10-TR04 | intra-family Precision | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-A-INTRA-FAMILY-RECALL-FE3E988F | Set A B10-TR04 | intra-family Recall | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-A-INTRA-FAMILY-F1-F1F4E6A7 | Set A B10-TR04 | intra-family F1 | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-A-INTER-FAMILY-PRECISION-A8315656 | Set A B10-TR04 | inter-family Precision | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-A-INTER-FAMILY-RECALL-03BC96AF | Set A B10-TR04 | inter-family Recall | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-A-INTER-FAMILY-F1-3BFF992C | Set A B10-TR04 | inter-family F1 | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-B-INTRA-FAMILY-PRECISION-A588C966 | Set B B10-TR04 | intra-family Precision | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-B-INTRA-FAMILY-RECALL-C3B400CE | Set B B10-TR04 | intra-family Recall | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-B-INTRA-FAMILY-F1-561486A7 | Set B B10-TR04 | intra-family F1 | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-B-INTER-FAMILY-PRECISION-02B088C1 | Set B B10-TR04 | inter-family Precision | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-B-INTER-FAMILY-RECALL-2E5C779E | Set B B10-TR04 | inter-family Recall | official_board_comparable external_data_policy;inference_budget |
PROT-B10-SET-B-INTER-FAMILY-F1-6C603852 | Set B B10-TR04 | inter-family F1 | official_board_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-1M-80-TEST-SET-OFFICIAL-TEST--7C329CF2-8DADB680 | bpRNA-1m (80) test set B34-TR01 | official test set Precision (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-1M-80-TEST-SET-OFFICIAL-TEST--4D546F87-9DD1358E | bpRNA-1m (80) test set B34-TR01 | official test set Recall (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-1M-80-TEST-SET-OFFICIAL-TEST--FD202093-2C6AE2DF | bpRNA-1m (80) test set B34-TR01 | official test set F1-Score (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-1M-80-TEST-SET-OFFICIAL-TEST--498F365C-A219241C | bpRNA-1m (80) test set B34-TR01 | official test set Precision (macro-avg) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-1M-80-TEST-SET-OFFICIAL-TEST--15AA5D6C-F536B1B7 | bpRNA-1m (80) test set B34-TR01 | official test set Recall (macro-avg) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-1M-80-TEST-SET-OFFICIAL-TEST--F7423224-26AC5174 | bpRNA-1m (80) test set B34-TR01 | official test set F1-Score (macro-avg) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-NEW-OFFICIAL-TEST-SET-PRECISION-BINARY-8F9A5827 | bpRNA-new B34-TR01 | official test set Precision (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-NEW-OFFICIAL-TEST-SET-RECALL-BINARY-AB4958C9 | bpRNA-new B34-TR01 | official test set Recall (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-BPRNA-NEW-OFFICIAL-TEST-SET-F1-SCORE-BINARY-ED989D1C | bpRNA-new B34-TR01 | official test set F1-Score (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-RNA3DB-2D-OFFICIAL-TEST-SET-PRECISION-BINARY-82CCCB31 | RNA3DB-2D B34-TR01 | official test set Precision (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-RNA3DB-2D-OFFICIAL-TEST-SET-RECALL-BINARY-BD144389 | RNA3DB-2D B34-TR01 | official test set Recall (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B34-RNA3DB-2D-OFFICIAL-TEST-SET-F1-SCORE-BINARY-A979C535 | RNA3DB-2D B34-TR01 | official test set F1-Score (binary) | same_table_comparable external_data_policy;inference_budget |
PROT-B38-ETERNABENCH-PACKAGE-EVALUATION-VIRA-F0CBD0BF-A25B18C8 | EternaBench package evaluation NR | Viral genomic RNA package Z-score | same_table_comparable external_data_policy;inference_budget |
PROT-B38-ETERNABENCH-PACKAGE-EVALUATION-SARS-5682CF9A-E8AF0C08 | EternaBench package evaluation NR | SARS-CoV-2 genomic RNA package Z-score | same_table_comparable external_data_policy;inference_budget |
PROT-B38-ETERNABENCH-PACKAGE-EVALUATION-MRNA-6E24C10C-2E3403F6 | EternaBench package evaluation NR | mRNA package Z-score | same_table_comparable external_data_policy;inference_budget |
PROT-B38-ETERNABENCH-PACKAGE-EVALUATION-SYNT-EFF3F19F-D7BBB321 | EternaBench package evaluation NR | Synthetic RNA package Z-score | same_table_comparable external_data_policy;inference_budget |
PROT-B38-ETERNABENCH-PACKAGE-EVALUATION-AVER-4BA1A84E-25FC6980 | EternaBench package evaluation NR | average across all 31 datasets package Z-score | same_table_comparable external_data_policy;inference_budget |
PROT-B38-ETERNABENCH-PACKAGE-EVALUATION-CHEM-A16AAD0F-8612873F | EternaBench package evaluation NR | ChemMapping Z-score mean(std) package Z-score | same_table_comparable external_data_policy;inference_budget |
PROT-B38-ETERNABENCH-PACKAGE-EVALUATION-RIBO-4FFDE52B-AAC482F3 | EternaBench package evaluation NR | Riboswitch Z-score mean(std) package Z-score | same_table_comparable external_data_policy;inference_budget |
PROT-B38-ETERNABENCH-PACKAGE-EVALUATION-COMB-8ABFDD22-947039D3 | EternaBench package evaluation NR | combined chemical-mapping and riboswitch datasets package Z-score | same_table_comparable external_data_policy;inference_budget |