Exact model identity

Claude 3.7 Sonnet 20250219 (SCIGYM)

Anthropic · version status: reported

Similar model names are never merged automatically. Evaluation membership and numeric result rows only reference the exact ID scigym-claude-3-7-sonnet-20250219.

Evaluation settings

Numeric results

BenchmarkWorkRun / groupMetricValue
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
Simulation Trajectory Error (STE)0.3615 SMAPE error
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS with modifiers — Precision0.178 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS with modifiers — Recall0.1698 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS with modifiers — F10.1688 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS without modifiers — Precision0.316 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS without modifiers — Recall0.317 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS without modifiers — F10.3047 score