suite Provisional · medium · audited-with-caveats · verified 2026-08-06

Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing

A reusable benchmark for comparing differential transcript usage detection tools across simulated and real transcriptomics data.

Audited with caveats: 3 field(s) are marked provisional or conflicted. Warnings are shown next to affected values and these claims are excluded from unqualified comparisons.

Benchmark definition

What is counted

Version
initial-release
Total
Not reported (The reusable benchmark spans simulated and real transcriptomics settings; no single finite primary item inventory is reported.)
Task formats
unclassified
Capabilities
Data analysis
Modalities
Raw omics

Version history

VersionStatusRelease / as-ofTotalFormal tracks
initial-release
comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-initial-release-version
current2025-09-11Not reported (The reusable benchmark spans simulated and real transcriptomics settings; no single finite primary item inventory is reported.)None registered

Scientific Task Atlas

Scientific task classification

partial for initial-release. Candidate artifact-derived Scientific Task mappings lacked an official artifact-level locator and were omitted; task mapping remains pending a targeted official-artifact audit.

The source names only a broad direction; no more specific leaf task can be assigned without inference.

Relationship registry

How works use this benchmark

Partial claims, non-evaluation uses, and third-party summaries stay visible without entering model comparisons.

Partial evaluation claims

evaluation

comprehensive-benchmark-of-differential-transcript-usa-comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-2-use

Partialunknown

Work: Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · source version comprehensive-benchmark-of-differential-transcript-usa-final-published-version

Selection
not reported
Models
Not reported / not applicable
Metrics
Not reported / not applicable
Linked runs
None

Not reported / unresolved: The parameter matrix does not provide one uniform realized evaluation n.; Random seeds and versions of most evaluated DTU methods are not reported.; Unlabeled graphical scores were not estimated.; benchmark version; realized n/scope; metric; numeric result; prompt and tools; grader and repeats; exact model

Owner-reviewed conservative publication: the creator evaluation is retained only as a partial relationship; conflicted settings and outcomes are omitted pending manual reconciliation.

Evidence
  • section: Overall performance of DTU detection
    Supports: /relation_type
  • page: Article title
    Supports: /benchmark_id

evaluation

comprehensive-benchmark-of-differential-transcript-usa-comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-3-use

Partialunknown

Work: Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · source version comprehensive-benchmark-of-differential-transcript-usa-final-published-version

Selection
not reported
Models
Not reported / not applicable
Metrics
Not reported / not applicable
Linked runs
None

Not reported / unresolved: Simulation repeat count and random seed are not reported.; The varying balanced and unbalanced dataset sizes prevent one uniform realized n.; benchmark version; realized n/scope; metric; numeric result; prompt and tools; grader and repeats; exact model

Owner-reviewed conservative publication: the creator evaluation is retained only as a partial relationship; conflicted settings and outcomes are omitted pending manual reconciliation.

Evidence
  • section: Performance in single-cell data
    Supports: /relation_type
  • page: Article title
    Supports: /benchmark_id

evaluation

comprehensive-benchmark-of-differential-transcript-usa-comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-4-use

Partialunknown

Work: Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · source version comprehensive-benchmark-of-differential-transcript-usa-final-published-version

Selection
not reported
Models
Not reported / not applicable
Metrics
Not reported / not applicable
Linked runs
None

Not reported / unresolved: Simulation repeat count and random seed are not reported.; The unbalanced meta-cell evaluation has no single reported realized cell count.; benchmark version; realized n/scope; metric; numeric result; prompt and tools; grader and repeats; exact model

Owner-reviewed conservative publication: the creator evaluation is retained only as a partial relationship; conflicted settings and outcomes are omitted pending manual reconciliation.

Evidence
  • section: Performance in single-cell data
    Supports: /relation_type
  • page: Article title
    Supports: /benchmark_id

evaluation

comprehensive-benchmark-of-differential-transcript-usa-comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-5-use

Partialunknown

Work: Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · source version comprehensive-benchmark-of-differential-transcript-usa-final-published-version

Selection
not reported
Models
Not reported / not applicable
Metrics
Not reported / not applicable
Linked runs
None

Not reported / unresolved: The realized sample count after removing 10 matching samples is not explicitly reported.; The real dataset has no simulated ground truth.; F1 dots without printed numeric labels were not estimated.; benchmark version; realized n/scope; metric; numeric result; prompt and tools; grader and repeats; exact model

Owner-reviewed conservative publication: the creator evaluation is retained only as a partial relationship; conflicted settings and outcomes are omitted pending manual reconciliation.

Evidence
  • section: Benchmarking with a real transcriptome dataset
    Supports: /relation_type
  • page: Article title
    Supports: /benchmark_id

evaluation

comprehensive-benchmark-of-differential-transcript-usa-comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-6-use

Partialunknown

Work: Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · source version comprehensive-benchmark-of-differential-transcript-usa-final-published-version

Selection
not reported
Models
Not reported / not applicable
Metrics
Not reported / not applicable
Linked runs
None

Not reported / unresolved: The body and Figure 7 caption disagree about the evaluated method list.; No ground-truth performance metric is reported for the real time-series dataset.; Conflicted scope-n claim omitted after independent verification; the evaluation relationship is published conservatively.; Conflicted result claim omitted after independent verification; the evaluation relationship is published conservatively.; benchmark version; realized n/scope; metric; numeric result; prompt and tools; grader and repeats; exact model

Owner-reviewed conservative publication: the creator evaluation is retained only as a partial relationship; conflicted settings and outcomes are omitted pending manual reconciliation.

Evidence
  • section: Time series IS analysis
    Supports: /relation_type
  • page: Article title
    Supports: /benchmark_id

Creation, training, validation, or model-selection uses

benchmark creation

comprehensive-benchmark-of-differential-transcript-usa-comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-1-use

Non-evaluationunknown

Work: Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · source version comprehensive-benchmark-of-differential-transcript-usa-final-published-version

Selection
not applicable
Models
Not reported / not applicable
Metrics
Not reported / not applicable
Linked runs
None

Not reported / unresolved: No single finite primary item inventory is reported for the reusable benchmark matrix.; No benchmark version or separate release date is stated.; The paper does not explicitly assign a Registry access level.

AI-assisted double-pass extraction; values are limited to independently supported claims.

Evidence
  • section: Abstract
    Supports: /relation_type
  • page: Article title
    Supports: /benchmark_id

Evaluation registry

Works and run settings

A setting change—scope, prompt, tools, budget, grader, or repeats—creates a separate run. Charts never cross a comparability group.

No normalized evaluation run is published yet. Creator evidence is still attached below.

Evidence and change history

Source locators remain visible; expand an item to inspect the exact Registry fields it supports.

Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Data availability · Supports 2 fields

Open source →

  • /access/artifacts
  • /access/level
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Data availability · Supports 1 field

Open source →

  • /access/license
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Abstract · Supports 1 field

Open source →

  • /capabilities
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Abstract · Supports 1 field

Open source →

  • /domains
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Conclusion · Supports 1 field

Open source →

  • /kind
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Abstract · Supports 1 field

Open source →

  • /modalities
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · page: Article title · Supports 1 field

Open source →

  • /name
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · page: Author names, affiliation numbers, and affiliations 1–7 · Supports 1 field

Open source →

  • /organizations
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Abstract · Supports 1 field

Open source →

  • /summary
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · other: Crossref bibliographic metadata (Resolved from the canonical paper identifier during intake.) · Supports 1 field

Open source →

  • /release_date
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Abstract · Supports 4 fields

Open source →

  • /task_counts/total
  • /task_counts/basis
  • /versions/0/task_counts/total
  • /versions/0/task_counts/basis
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · section: Abstract · Supports 2 fields

Open source →

  • /task_counts/subsets
  • /versions/0/task_counts/subsets
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · other: Data availability, document pages 12–13 · Supports 3 fields

Open source →

  • /resources
  • /implementations
  • /access/level
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · page: Article DOI header · Supports 1 field

Open source →

  • /resources/0
Comprehensive benchmark of differential transcript usage analysis for bulk and single-cell RNA sequencing · page: Article DOI header · Supports 2 fields

Open source →

  • /latest_version
  • /versions/0

Unresolved field claims

  • /kindProvisional · medium — The creator source and independent verifier support the Registry suite mapping, but the extractor assigned medium confidence because the source describes a benchmarking analysis and workflow rather than using the controlled word suite.
    Evidence: comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-automated-metadata-5-evidence
  • /access/levelProvisional · medium — The official resource and source-located access descriptions are public, but fully-open is an Atlas-controlled classification rather than a label stated verbatim by the creator source.
    Evidence: comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-automated-metadata-1-evidence, comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-automated-resource-evidence
  • /task_counts/subsetsProvisional · high — The double-pass review did not establish an exhaustive formal-subset inventory; the empty list must not be interpreted as evidence that the benchmark has no subsets.
    Evidence: comprehensive-benchmark-of-differential-transcript-usage-analysis-for-bu-automated-subset-coverage-evidence

View source-level modification history on GitHub →