Exact model identity

Claude 3.5 Sonnet 20241022

Anthropic · version status: reported

Similar model names are never merged automatically. Evaluation membership and numeric result rows only reference the exact ID bixbench-claude-3-5-sonnet-20241022.

Evaluation settings

BenchmarkWorkRun / groupScope
BixBenchBixBench v1.5 dataset and evaluation releasebixbench-v1-5-agentic-mcq-no-refusal-images
bixbench-v1-5-agentic-mcq-no-refusal-images-five-replicas
full · n=205
BixBenchBixBench v1.5 dataset and evaluation releasebixbench-v1-5-agentic-mcq-refusal-images
bixbench-v1-5-agentic-mcq-refusal-images-five-replicas
full · n=205
BixBenchBixBench v1.5 dataset and evaluation releasebixbench-v1-5-agentic-mcq-refusal-no-images
bixbench-v1-5-agentic-mcq-refusal-no-images-five-replicas
full · n=205
BixBenchBixBench v1.5 dataset and evaluation releasebixbench-v1-5-agentic-open-images
bixbench-v1-5-agentic-open-images-five-replicas
full · n=205

Numeric results

The source identifies this model or system, but no normalized numeric result is published for it yet.