scImmuneBench

Single-cell immune repertoire benchmark spanning TCR/BCR repertoire embedding and immune cell annotation across 14 studies.

Composite
79.5
Experimental validation
Retrospective
Stages
Virtual CellDisease Modeling
Modalities
cell-therapy
Task types
cell-type-annotationt-cell-receptor-specificity
Size
cells: 4,200,000
tcrs: 1,700,000
License
CC-BY-4.0
First release
2025-06
Last updated
2026-03
Official site
→ project page
Leaderboard
→ leaderboard
Dataset
→ dataset
Code / GitHub
→ repository
HuggingFace
→ HF
Paper
scImmuneBench: Benchmarking single-cell immune foundation models · Zhang Y, et al. · 2025 · paper · doi:10.1038/s41587-025-02001-1 · 54 citations
Flags
none
Experts
Groups
Hosted by
Open Problems in Single-Cell Analysis
Related benchmarks
Open Problems: Perturbation Prediction, SAbDab

Rubric (7-criterion)

rigor
4
coverage
4
maintenance
4
adoption
3
quality
4
accessibility
5
industry_relevance
4

Notes

Useful for cell-therapy companies evaluating immune foundation models.

← Back to all benchmarks

Compare:
Open comparison →