BEACON
Thirteen native tasks; some reuse OpenVaccine, Optimus and CRISPR datasets.
13 个 benchmark 数值协议 · 221 条 benchmark 全局结果(非 task 小计)D3 · 功能、表达与分子表型
Predict degradation-related measurements as in OpenVaccine.
RNA degradation and vaccine-stability prediction
Benchmark coverage
Thirteen native tasks; some reuse OpenVaccine, Optimus and CRISPR datasets.
13 个 benchmark 数值协议 · 221 条 benchmark 全局结果(非 task 小计)Same raw competition data is repackaged by several RNA benchmark suites.
9 个 benchmark 数值协议 · 15 条 benchmark 全局结果(非 task 小计)评测协议
| Protocol | Track | Split / subset | 可比状态 |
|---|---|---|---|
PROT-B09-VDP-OFFICIAL-TRAIN-VALIDATION-TEST-SPLIT-VDP-9F04A09B | VDP B09-TR09 | official train/validation/test split VDP | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-8A32171F39F6EF68 | public MCRMSE | experimental_error_oracle B17-TR01 | public test set public test set: 400 constructs / 27,200 nucleotides | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-59F75C9D0EA6E237 | private MCRMSE | experimental_error_oracle B17-TR01 | private test set private test set: 1,801 constructs / 162,316 nucleotides | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-5C7B202B4953F9F0 | public MCRMSE | single_model_blind_table B17-TR01 | public test set public test set: 400 constructs / 27,200 nucleotides | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-249AE8043F70A1C0 | private MCRMSE | single_model_blind_table B17-TR01 | private test set private test set: 1,801 constructs / 162,316 nucleotides | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-04E6956041EEA7BE | public MCRMSE | posthoc_ga_select_10_of_top100 B17-TR01 | public test set public test set: 400 constructs / 27,200 nucleotides | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-9405A8938D48A946 | private MCRMSE | posthoc_ga_select_10_of_top100 B17-TR01 | private test set private test set: 1,801 constructs / 162,316 nucleotides | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-1C3010944FF312E8 | public MCRMSE | posthoc_top2_ensemble B17-TR01 | public test set public test set: 400 constructs / 27,200 nucleotides | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-E8DD04C56DB5CC06 | private MCRMSE | posthoc_top2_ensemble B17-TR01 | private test set private test set: 1,801 constructs / 162,316 nucleotides | same_table_comparable external_data_policy;inference_budget |
PROT-B17-OPENVACCINE-C20D3479EC64E037 | private MCRMSE | posthoc_private_test_selected_ga B17-TR01 | private test set private test set: 1,801 constructs / 162,316 nucleotides | same_table_comparable external_data_policy;inference_budget |