Search bioRxiv⌕ Search

Biology subjects

Alexandari, A. M.

Publications and source records attributed to Alexandari, A. M..

3 recordsLinked to original sources

De novo distillation of thermodynamic affinity from deep learning regulatory sequence models of in vivo protein-DNA binding

Transcription factors (TF) are proteins that bind DNA in a sequence-specific manner to regulate gene transcription. Despite their unique intrinsic sequence preferences, in vivo genomic occupancy profiles of TFs differ across cellular contexts. Hence, deciphering the sequence determinants of TF binding, both intrinsic and context-specific, is essential to understand gene regulation and the impact of regulatory, non-coding genetic variation. Biophysical models trained on in vitro TF binding assays can estimate intrinsic affinity landscapes and predict occupancy based on TF concentration and affinity. However, these models cannot adequately explain context-specific, in vivo binding profiles. Conversely, deep learning models, trained on in vivo TF binding assays, effectively predict and explain genomic occupancy profiles as a function of complex regulatory sequence syntax, albeit without a clear biophysical interpretation. To reconcile these complementary models of in vitro and in vivo TF binding, we developed Affinity Distillation (AD), a method that extracts thermodynamic affinities de-novo from deep learning models of TF chromatin immunoprecipitation (ChIP) experiments by marginalizing away the influence of genomic sequence context. Applied to neural networks modeling diverse classes of yeast and mammalian TFs, AD predicts energetic impacts of sequence variation within and surrounding motifs on TF binding as measured by diverse in vitro assays with superior dynamic range and accuracy compared to motif-based methods. Furthermore, AD can accurately discern affinities of TF paralogs. Our results highlight thermodynamic affinity as a key determinant of in vivo binding, suggest that deep learning models of in vivo binding implicitly learn high-resolution affinity landscapes, and show that these affinities can be successfully distilled using AD. This new biophysical interpretation of deep learning models enables high-throughput in silico experiments to explore the influence of sequence context and variation on both intrinsic affinity and in vivo occupancy.

genomics↗

Short tandem repeats bind transcription factors to tune eukaryotic gene expression

Short tandem repeats (STRs) are enriched in eukaryotic cis-regulatory elements and their polymorphisms alter gene expression, yet how they regulate transcription remains unknown. We find that STRs can modulate transcription factor (TF)-DNA affinities and on rates by up to 70-fold by directly binding TF DNA-binding domains, with energetic impacts approaching or exceeding mutations to consensus sites. STRs maximize the number of weakly preferred microstates near target sites, thereby increasing TF density near motifs to speed target search. Confirming that STRs also impact TF binding in cells, neural networks trained only on in vivo occupancies predict identical effects to those observed in vitro. Approximately 90% of TFs preferentially bind STRs that need not resemble known motifs, providing a novel cis-regulatory mechanism to target TFs to cognate sites.

biophysics↗

Separable Fully Connected Layers Improve Deep Learning Models For Genomics

Convolutional neural networks are rapidly gaining popularity in regulatory genomics. Typically, these networks have a stack of convolutional and pooling layers, followed by one or more fully connected layers. In genomics, the same positional patterns are often present across multiple convolutional channels. Therefore, in current state-of-the-art networks, there exists significant redundancy in the representations learned by standard fully connected layers. We present a new separable fully connected layer that learns a weights tensor that is the outer product of positional weights and cross-channel weights, thereby allowing the same positional patterns to be applied across multiple convolutional channels. Decomposing positional and cross-channel weights further enables us to readily impose biologically-inspired constraints on positional weights, such as symmetry. We also propose a novel regularizer and constraint that act on curvature in the positional weights. Using experiments on simulated and in vivo datasets, we show that networks that incorporate our separable fully connected layer outperform conventional models with analogous architectures and the same number of parameters. Additionally, our networks are more robust to hyperparameter tuning, have more informative gradients, and produce importance scores that are more consistent with known biology than conventional deep neural networks.\n\nAvailabilityImplementation: https://github.com/kundajelab/keras/tree/keras_1\n\nA gist illustrating model setup is at: goo.gl/gYooaa

bioinformatics↗