Cell-type annotation

Assign biological cell-type or state labels to single-cell profiles.

细胞类型注释

Definition and search aliases

Permanent ID: cell-type-annotation
Aliases: cell annotation
Deprecated aliases: None
Hierarchy: Leaf task under Omics and cellular analysis

Coverage

2 benchmark families cover this task

suitepartial

Single-cell Omics Arena

A benchmark for evaluating LLM cell-type annotation across scRNA-seq and single-cell multiomics data.

agentic-evalpartial

SpatialBench

A benchmark of deterministic, verifiable agentic problems derived from real spatial-transcriptomics workflows, testing whether agents can manipulate data and recover key biological results.

Evidence-backed count claims

Each row keeps its original unit and basis. Rows with different units or overlapping mappings are never added.

Benchmark	Mapped task	Coverage	Count	Version	Evidence
Single-cell Omics Arena root: single-cell-omics-arena-soar	Cell-type annotation official-taxonomy · high	explicitly-in-scope	1226 tasks Benchmark-wide cell-type annotation task total reported by the creator paper.	initial-release	`single-cell-omics-arena-soar-automated-task-1-evidence`
SpatialBench root: spatialbench	Cell-type annotation official-taxonomy · high	explicitly-in-scope	45 problems official category_results.json n_evals	repo-159-5042c4f as of 2026-06-10	`spatialbench-evidence-current-counts`

Official evaluations connected to these benchmarks

Runs are included only for benchmark records mapped here (and formal child tracks when a mapped suite is the root). A task mapping does not imply that every run isolates this task.

Work	Provider / class	Related runs
Single-cell Omics Arena repository result snapshot	University of California, Irvine benchmark_creator	`soar-e5d2b3e-rna-zero-shot` `soar-e5d2b3e-rna-zero-shot-cot`
SpatialBench: Can Agents Analyze Real-World Spatial Biology Data?	LatchBio benchmark_creator	`spatialbench-paper-v2-base` `spatialbench-paper-v2-claude-code` `spatialbench-paper-v2-latch`
SpatialBench 159-evaluation repository snapshot	LatchBio benchmark_creator	`spatialbench-repo-159-claude-code` `spatialbench-repo-159-mini-swe-agent` `spatialbench-repo-159-openai-codex` `spatialbench-repo-159-pi`