Scientific domain

Protein design

Designing or optimizing protein sequences

蛋白质设计

14 registered benchmarks and tracks

suite0 runs

AbBiBench

A framework using antibody–antigen complexes to evaluate affinity prediction and antibody redesign.

PredictionDesignGenerationOptimization
dataset0 runs

CaM benchmark

A multistate protein sequence-design benchmark spanning CaM conformations and binding modes.

DesignOptimization
suite0 runs

FLIP

A supervised protein sequence-to-fitness benchmark that turns three experimental landscapes into 15 biologically motivated dataset splits for testing generalization in protein engineering.

PredictionRegression
track7 runs

FLIP AAV

Seven supervised splits over sampled and machine-designed AAV2 VP-1 capsid variants, measuring generalization across mutation depth, fitness, and sampled-versus-designed pools.

PredictionRegression
track5 runs

FLIP GB1

Five supervised splits over a downsampled, highly epistatic four-site GB1 immunoglobulin-binding landscape, designed to test mutation-depth and low-to-high-fitness generalization.

PredictionRegression
track3 runs

FLIP Meltome Thermostability

Three supervised sequence-to-melting-temperature splits spanning all species, human proteins, and a single human cell line, with sequence-cluster-aware train/test separation.

PredictionRegression
agentic-eval1 runs

LifeSciBench

Expert-authored, artifact-rich free-response tasks that evaluate realistic research judgment across applied life-science workflows.

Evidence synthesisRetrievalDesignGeneration
dataset0 runs

PapD benchmark

A multistate protein sequence-design benchmark targeting the multispecific PapD binding interface.

DesignOptimization
suite0 runs

ProteinGym

Versioned deep-mutational-scanning and clinical-variant benchmarks for protein fitness prediction and design in zero-shot and supervised regimes.

PredictionRegressionClassificationDesign
track0 runs

ProteinGym DMS Indels

ProteinGym track for predicting experimental fitness measurements of insertion and deletion mutants across deep-mutational-scanning assays.

PredictionRegressionClassificationDesign
track1 runs

ProteinGym DMS Substitutions

ProteinGym track for predicting experimental fitness measurements of substitution mutants across deep-mutational-scanning assays.

PredictionRegressionClassificationDesign
dataset1 runs

ProteinLMBench

A creator-curated set of 944 protein-science multiple-choice questions with answer explanations, generated from research literature and released for evaluating text LLM protein understanding.

KnowledgeScientific reasoningPrediction
dataset0 runs

RfaH benchmark

A multistate protein sequence-design benchmark using the fold-switching conformations of RfaH.

DesignOptimization
suite1 runs

TAPE

A five-task benchmark for protein representation learning spanning secondary structure, residue contacts, remote homology, fluorescence, and stability.

PredictionClassificationRegression

Capability coverage

Registry records tagged Protein design, counted by capability.

CSV ↓
Accessible data table
CapabilityRecords
Knowledge1
Evidence synthesis1
Retrieval1
Prediction10
Classification4
Regression8
Design8
Generation2
Optimization8
Data analysis1
Experiment planning1
Troubleshooting1
Scientific reasoning2
Scientific communication1
Coverage-gap reading: zero counts indicate a gap in this registry, not proof that no benchmark exists. Propose a primary source through the contribution form.