DeepCAC: a deep learning approach on DNA transcription factors classification based on multi-head self-attention and concatenate convolutional neural network
Loading...
Date
2023-09-18
Open Access Location
Journal Title
Journal ISSN
Volume Title
Publisher
BioMed Central Ltd
Rights
(c) 2023 The Author/s
CC BY 4.0
CC BY 4.0
Abstract
Understanding gene expression processes necessitates the accurate classification and identification of transcription factors, which is supported by high-throughput sequencing technologies. However, these techniques suffer from inherent limitations such as time consumption and high costs. To address these challenges, the field of bioinformatics has increasingly turned to deep learning technologies for analyzing gene sequences. Nevertheless, the pursuit of improved experimental results has led to the inclusion of numerous complex analysis function modules, resulting in models with a growing number of parameters. To overcome these limitations, it is proposed a novel approach for analyzing DNA transcription factor sequences, which is named as DeepCAC. This method leverages deep convolutional neural networks with a multi-head self-attention mechanism. By employing convolutional neural networks, it can effectively capture local hidden features in the sequences. Simultaneously, the multi-head self-attention mechanism enhances the identification of hidden features with long-distant dependencies. This approach reduces the overall number of parameters in the model while harnessing the computational power of sequence data from multi-head self-attention. Through training with labeled data, experiments demonstrate that this approach significantly improves performance while requiring fewer parameters compared to existing methods. Additionally, the effectiveness of our approach is validated in accurately predicting DNA transcription factor sequences.
Description
Keywords
Attention mechanism, Bioinformatics, Convolutional neural networks, DNA transcription factors sequence, Transcription Factors, Deep Learning, DNA, Computational Biology, Neural Networks, Computer
Citation
Zhang J, Liu B, Wu J, Wang Z, Li J. (2023). DeepCAC: a deep learning approach on DNA transcription factors classification based on multi-head self-attention and concatenate convolutional neural network.. BMC Bioinformatics. 24. 1. (pp. 345-).