scINTILLA: Single-Cell Integrated Inference, Labelling, and Landscape Analysis for Cell-Type Annotation Quality Assessment
Single-cell RNA sequencing has enabled the construction of comprehensive cell atlases, yet the quality and coherence of the cell-type annotations within these atlases remain largely unexamined. When a label is applied to a transcriptionally heterogeneous population, the downstream analyses that depend on it, and automated label transfer in particular, become unreliable. We present scINTILLA (Single-Cell Integrated Inference, Labelling, and Landscape Analysis), a computational framework that combines supervised and unsupervised machine learning to score the learnability and internal consistency of cell-type labels in single-cell datasets. The unsupervised arm benchmarks a broad panel of clustering algorithms and derives a neighbourhood confusion score for every cell, whilst the supervised arm trains up to twelve classifiers and extracts prediction agreement, entropy, and confidence. These signals are normalised and aggregated into a single composite score per cell type, where a low score flags label ambiguity or concealed heterogeneity. As a by-product, scIN-TILLA also reports which clustering and classification algorithms perform best on a given dataset, offering practical guidance for downstream label transfer. We applied it to five Human Cell Atlas datasets spanning the adult brain, lung, eye, and two organoid atlases, and recovered clear differences in the learnability and internal consistency of annotations across atlases that were not driven by the number of annotated cell types. Focused re-analysis of lowscoring populations in the lung and endoderm-organoid atlases resolved biologically coherent sub-populations, in some cases with context-specific enrichment, much of it recovered from cells that had been assigned broad or catch-all labels. scINTILLA is advisory rather than prescriptive, guiding principled, data-driven re-annotation at atlas scale.