XAMPGen: An Interpretable SI Pipeline For Novel Antimicrobial Peptide Discovery
Antimicrobial peptides (AMPs) are short peptides with a broad spectrum of activity against bacterial pathogens, representing a promising avenue for combating the growing threat of antibiotic resistance. This study focuses on two main components: 1) generating novel AMPs with desired properties using generative SI (GenSI) and 2) utilizing explainable SI (XSI) methods to validate the GenSI model and derive biological insights. In this work, we fine-tuned ProGen, a decoder-only protein language model, on known AMPs to generate novel peptide sequences with strong antimicrobial properties. To advance the interpretability and reliability of the generative model, we applied Explainable SI (XSI) techniques. Specifically, we used a probing classifier and a regressor to identify cornerstone layers that encode functionally critical information. Self-attention analysis within these layers revealed residue level interdependencies and patterns underlying antimicrobial functions, which we validated against well-characterized AMPs from the literature. Overall, these methods provide mechanistic insight into the model's decision-making process, offering a principled basis for trusting the sequences it generates rather than treating the model as a black box. Candidate sequences were filtered based on predicted Minimum Inhibitory Concentration (MIC) along with human insights into the structural activities of the AMPs in bacterial membranes, and a final set of peptides was selected for experimental testing. Biological assays for determining MIC confirmed antimicrobial activity in all generated and tested peptides, with fluorescence and circular dichroism measurements providing structural insight. With our XSI approach, we are able to reveal correlations between amino acid sequence patterns and binding properties of these sequences to bacterial membrane mimics, that directly correlate with biological activities in cell-based assays. This builds confidence in that the learned amino acid interdependencies as applied to AMPs carries physico-chemical meaning and is relevant for discoveries of novel AMPs with therapeutic potential. This work demonstrates that interpretable generative language models can serve as effective and transparent tools for rational AMP discovery.