track · audited · verified 2026-07-22
Anthropic Protein Understanding Eval
Private Anthropic protein-understanding evaluation direction reported only through a model-trend chart, without public tasks, counts, or protocol details.
Private/internal benchmark: tasks, counts, and core protocol are not public. This record is excluded from public and runnable coverage statistics. Exact labeled deltas remain inspectable, but are not converted into absolute scores or plotted as a ranking.
Benchmark definition
What is counted
- Version
- reported-2026-01-11
- Total
- Not reported (private protein understanding tasks)
- Task formats
- private protein understanding evaluation; exact format not reported
- Capabilities
KnowledgeScientific reasoning
Version history
| Version | Status | Release / as-of | Total | Formal tracks |
|---|
reported-2026-01-11
anthropic-protein-understanding-reported-2026-01-11 | current | 2026-01-11 | Not reported (private protein understanding tasks) | None registered |
Scientific Task Atlas
Scientific task classification
partial for reported-2026-01-11 · as of 2026-01-11. Protein understanding is an explicit private direction, but the source does not identify a sufficiently specific leaf task.
The source names only a broad direction; no more specific leaf task can be assigned without inference.
Scientific coverage notes
| Domain | Coverage | Count | Interpretation |
|---|
| Protein science | explicitly-in-scope | Not reported | The direction is explicit; task count and more specific protein task are not reported. |
Relationship registry
How works use this benchmark
Partial claims, non-evaluation uses, and third-party summaries stay visible without entering model comparisons.
Normalized evaluations
evaluation
anthropic-protein-understanding-evaluation
Internalunknown
Work: Advancing Claude in healthcare and the life sciences · source version anthropic-healthcare-life-sciences-2026-01-11
- Selection
- not reported
- Metrics
- Accuracy delta
Not reported / unresolved: task count; task data; grader; prompt; tools; repeats; absolute accuracy
Only the exact Opus 4.5 improvement annotation is normalized; plotted absolute values are not estimated.
Evidence
- figure: Evals for key life sciences tasks — Protein understanding (Shows Opus 4.1, Sonnet 4.5, Opus 4.5 and an exact +10.3% annotation.)
Supports: /benchmark_version, /relation_type, /status, /model_ids, /scope, /metric_labels, /evaluation_run_ids, /reporting_gaps, /notes
Evaluation registry
Works and run settings
A setting change—scope, prompt, tools, budget, grader, or repeats—creates a separate run. Charts never cross a comparability group.
anthropic-protein-understanding-deltavreported-2026-01-11
Evaluated models / systems: Claude Opus 4.1, Claude Opus 4.5, Claude Sonnet 4.5
Scopeunknown
ShotsNot reported
TurnsNot reported
System prompt publicNot reported
Reasoning / effortNot reported
BrowserNot reported
InternetNot reported
DatabasesNot reported
Code executionNot reported
ContainerNot reported
External toolsNot reported
Token budgetNot reported
Time / cost budgetNot reported
TemperatureNot reported
SeedNot reported
RepeatsNot reported
GraderNot reported
StatisticsNot reported
ContaminationNot reported
Metrics, results, and full protocol
Metrics
| Metric | Kind / baseline | Unit | Aggregation | Threshold / tolerance |
|---|
| Accuracy improvement from Claude Opus 4.1 to Claude Opus 4.5 | delta
baseline: Claude Opus 4.1 | percent delta as annotated | Not reported | Not reported |
Results
| Model | Metric | Value | n |
|---|
| Claude Opus 4.5 | Accuracy improvement from Claude Opus 4.1 to Claude Opus 4.5 | Δ 10.3 percent delta as annotated
Exact +10.3% chart annotation; no absolute accuracy or relative-versus-percentage-point interpretation is inferred. | Not reported |
Evidence
- figure: Evals for key life sciences tasks — Protein understanding (Labels Accuracy (%) and annotates +10.3% from Opus 4.1 to Opus 4.5.) — supports /benchmark_version, /model_ids, /scope, /protocol, /metrics, /results
Evidence and change history
Source locators remain visible; expand an item to inspect the exact Registry fields it supports.
Advancing Claude in healthcare and the life sciences · figure: Evals for key life sciences tasks — Protein understanding (Exact direction label and +10.3% Opus 4.5 annotation.) · Supports 28 fields
Open source →
/name/summary/kind/parent_id/organizations/release_date/latest_version/domains/capabilities/modalities/task_formats/task_counts/total/task_counts/basis/task_counts/subsets/coverage_notes/access/level/access/tasks/access/artifacts/access/grader/access/license/access/biosafety_notes/resources/implementations/versions/0/release_date/versions/0/as_of/versions/0/task_counts/total/versions/0/task_counts/basis/versions/0/task_counts/subsets
View source-level modification history on GitHub →