RNA degradation and vaccine-stability prediction

Predict degradation-related measurements as in OpenVaccine.

Task definition

Input granularity: sequence plus structure/conditions
Biological target: degradation reactivity
Output representation: per-base continuous values
ML formulation: multi-target regression
Counting notes: NR

Benchmark coverage

2 benchmarks cover this task

B09Numeric results available

BEACON

Thirteen native tasks; some reuse OpenVaccine, Optimus and CRISPR datasets.

13 benchmark-wide protocols · 221 benchmark-wide rows (not a task subtotal)

B17Numeric results available

OpenVaccine

Same raw competition data is repackaged by several RNA benchmark suites.

9 benchmark-wide protocols · 15 benchmark-wide rows (not a task subtotal)

Evaluation protocols

10 protocol units

Protocol	Track	Split / subset	Comparability
`PROT-B09-VDP-OFFICIAL-TRAIN-VALIDATION-TEST-SPLIT-VDP-9F04A09B`	VDP B09-TR09	official train/validation/test split VDP	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-8A32171F39F6EF68`	public MCRMSE \| experimental_error_oracle B17-TR01	public test set public test set: 400 constructs / 27,200 nucleotides	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-59F75C9D0EA6E237`	private MCRMSE \| experimental_error_oracle B17-TR01	private test set private test set: 1,801 constructs / 162,316 nucleotides	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-5C7B202B4953F9F0`	public MCRMSE \| single_model_blind_table B17-TR01	public test set public test set: 400 constructs / 27,200 nucleotides	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-249AE8043F70A1C0`	private MCRMSE \| single_model_blind_table B17-TR01	private test set private test set: 1,801 constructs / 162,316 nucleotides	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-04E6956041EEA7BE`	public MCRMSE \| posthoc_ga_select_10_of_top100 B17-TR01	public test set public test set: 400 constructs / 27,200 nucleotides	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-9405A8938D48A946`	private MCRMSE \| posthoc_ga_select_10_of_top100 B17-TR01	private test set private test set: 1,801 constructs / 162,316 nucleotides	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-1C3010944FF312E8`	public MCRMSE \| posthoc_top2_ensemble B17-TR01	public test set public test set: 400 constructs / 27,200 nucleotides	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-E8DD04C56DB5CC06`	private MCRMSE \| posthoc_top2_ensemble B17-TR01	private test set private test set: 1,801 constructs / 162,316 nucleotides	same_table_comparable external_data_policy;inference_budget
`PROT-B17-OPENVACCINE-C20D3479EC64E037`	private MCRMSE \| posthoc_private_test_selected_ga B17-TR01	private test set private test set: 1,801 constructs / 162,316 nucleotides	same_table_comparable external_data_policy;inference_budget