PhenoMe: An interactive AI framework for interpretable, microscopy-driven phenotyping
Extracting meaningful biological patterns from microscopy image datasets requires tools that quantitatively connect visual similarities and experimental context. Deep learning models, and in particular novel foundation models, have the capacity to translate images into high-dimensional embeddings that can better represent complex visual patterns. Using these complex representations analytically and linking them to experimental information, it is possible to build advanced exploratory and phenotyping capabilities. Here, we present PhenoMe, an open-source, model-agnostic framework to handle pretrained foundation model-derived image representations alongside quantitative image properties and experimental metadata. PhenoMe integrates multiple scriptable and interactive workflows for embedding space visualisation, dimensionality reduction and clustering, similarity-based comparison and retrieval of representative images for each phenotype, among others. It also supports correlation analyses that link the embedding structure to interpretable image properties. We demonstrate PhenoMe's capabilities on seven public microscopy datasets, ranging from cell painting assays, nanoscale synaptic images, drug-response analyses and dynamic cell-phenotyping. These case studies show how readily available image representations can support data contextualisation, curation and analysis. Through guided notebooks, reproducible configurations, extensible model wrappers and a napari plugin, PhenoMe makes representation-based microscopy exploration accessible to researchers without dedicated technical expertise. PhenoMe lays the groundwork for applying foundation models and representation learning to microscopy data analysis.