Search bioRxiv⌕ Search

Biology subjects

Martinek, V.

Publications and source records attributed to Martinek, V..

2 recordsLinked to original sources

Genomic Benchmarks: A Collection of Datasets for Genomic Sequence Classification

In this paper, we propose a collection of curated and easily accessible sequence classification datasets in the field of genomics. The proposed collection is based on a combination of novel datasets constructed from the mining of publicly available databases and existing datasets obtained from published articles. The main aim of this effort is to create a repository for shared datasets that will make machine learning for genomics more comparable and reproducible while reducing the over-head of researchers that want to enter the field. The collection currently contains eight datasets that focus on regulatory elements (promoters, enhancers, open chromatin region) from three model organisms: human, mouse, and roundworm. A simple convolution neural network is also included in a repository and can be used as a baseline model. Benchmarks and the baseline model are distributed as the Python package genomic-benchmarks, and the code is available at https://github.com/ML-Bioinfo-CEITEC/genomic_benchmarks.

bioinformatics↗

Fine-Tuning Transformers For Genomic Tasks

Transformers are a type of neural network architecture that has been successfully used to achieve state-of-the-art performance in numerous natural language processing tasks. However, what about DNA, the language life written in the four-letter alphabet? In this paper, we review the current state of Transformers usage in genomics and molecular biology in general, introduce a collection of benchmark datasets for the classification of genomic sequences, and compare the performance of several model architectures on those benchmarks, including a BERT-like model for DNA sequences DNABERT as implemented in HuggingFace (armheb/DNA_bert_6 model). In particular, we explore the effect of pre-training on a large DNA corpus vs training from scratch (with randomized weights). The results presented here can be used for identification of functional elements in human and other genomes.

bioinformatics↗