Exact model identity

Gemini 2.5 Flash Preview 04-17 (SCIGYM)

Google · version status: reported

Similar model names are never merged automatically. Evaluation membership and numeric result rows only reference the exact ID scigym-gemini-2-5-flash-preview-04-17.

Evaluation settings

Numeric results

BenchmarkWorkRun / groupMetricValue
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
Simulation Trajectory Error (STE)0.4181 SMAPE error
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS with modifiers — Precision0.1527 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS with modifiers — Recall0.1071 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS with modifiers — F10.1217 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS without modifiers — Precision0.2399 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS without modifiers — Recall0.1839 score
SCIGYM SmallMeasuring Scientific Capabilities of Language Models with a Systems Biology Dry Labscigym-small-creator-paper
scigym-2025-small-react-initial-concentration-20step-3repeat
RMS without modifiers — F10.2005 score