Search bioRxiv⌕ Search

Biology subjects

Ofer, D.

Publications and source records attributed to Ofer, D..

3 recordsLinked to original sources

Detecting Anomalous Proteins Using Deep Representations

Many advances in biomedicine can be attributed to identifying unusual proteins and genes. Many of these proteins unique properties were discovered by manual inspection, which is becoming infeasible at the scale of modern protein datasets. Here, we propose to tackle this challenge using anomaly detection methods that automatically identify unexpected properties. We adopt a state-of-the-art anomaly detection paradigm from computer vision, to highlight unusual proteins. We generate meaningful representations without labeled inputs, using pretrained deep neural network models. We apply these protein language models (pLM) to detect anomalies in function, phylogenetic families, and segmentation tasks. We compute protein anomaly scores to highlight human prion-like proteins, distinguish viral proteins from their host proteome, and mark non-classical ion/metal binding proteins and enzymes. Other tasks concern segmentation of protein sequences into folded and unstructured regions. We provide candidates for rare functionality (e.g., prion proteins). Additionally, we show the anomaly score is useful in 3D folding-related segmentation. Our novel method shows improved performance over strong baselines and has objectively high performance across a variety of tasks. We conclude that the combination of pLM and anomaly detection techniques is a valid method for discovering a range of global and local protein characteristics.

bioinformatics↗

Inferring microRNA regulation: A proteome perspective

Post-transcriptional regulation in multicellular organisms is mediated by microRNAs. However, the mechanisms that determine if a gene is regulated by miRNAs are poorly understood. Previous works focused mostly on miRNA seed matches and other features of the 3-UTR of transcripts. These common approaches relied on knowledge of the miRNA families, and computational approaches still yield poor, inconsistent results, with many false positives. In this work, we present a different paradigm for predicting miRNA-regulated genes based on proteins. In a novel, automated machine learning framework, we use sequence as well as diverse functional annotations to train models on multiple organisms using experimentally validated data. We present insights from tens of millions of features extracted and ranked from different modalities. We show high predictive performance per organism and in generalization across species. We provide a list of novel predictions for Danio rerio (zebrafish) and Arabidopsis thaliana (mouse-ear cress). We compare genomic models, and observe that our protein model outperforms genomics, while a unified model improves on both. While most membranous and disease related proteins are regulated by miRNAs, we observe the G-protein coupled receptor (GPCR) family is an exception, being mostly unregulated by miRNAs, and we raise possible explanations for this. We further show that the evolutionary conservation among duplicated genes does not imply a coherence in miRNA regulation. We conclude that duplicated genes diverge in their tendency to be miRNA regulated. However, protein function is informative across species in predicting post-transcriptional miRNA regulation in living cells.

bioinformatics↗

ProteinBERT: A universal deep-learning model of protein sequence and function

Self-supervised deep language modeling has shown unprecedented success across natural language tasks, and has recently been repurposed to biological sequences. However, existing models and pretraining methods are designed and optimized for text analysis. We introduce ProteinBERT, a deep language model specifically designed for proteins. Our pretraining scheme consists of masked language modeling combined with a novel task of Gene Ontology (GO) annotation prediction. We introduce novel architectural elements that make the model highly efficient and flexible to very large sequence lengths. The architecture of ProteinBERT consists of both local and global representations, allowing end-to-end processing of these types of inputs and outputs. ProteinBERT obtains state-of-the-art performance on multiple benchmarks covering diverse protein properties (including protein structure, post translational modifications and biophysical attributes), despite using a far smaller model than competing deep-learning methods. Overall, ProteinBERT provides an efficient framework for rapidly training protein predictors, even with limited labeled data. Code and pretrained model weights are available at https://github.com/nadavbra/protein_bert.

bioinformatics↗