Accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networks

Abstract Background Plant pathogens cause billions of dollars of crop loss every year and are a major threat to global food security. Effector proteins are the tools such pathogens use to infect the cell, predicting effectors de novo from sequence is difficult because of the heterogeneity of the seq...

Full description

Bibliographic Details
Main Authors: Ruth Kristianingsih, Dan MacLean
Format: Article
Language:English
Published: BMC 2021-07-01
Series:BMC Bioinformatics
Subjects:
AI
Online Access:https://doi.org/10.1186/s12859-021-04293-3
id doaj-6c40b634b2fd494a9652d64de03b7a9e
record_format Article
spelling doaj-6c40b634b2fd494a9652d64de03b7a9e2021-07-18T11:13:47ZengBMCBMC Bioinformatics1471-21052021-07-0122112210.1186/s12859-021-04293-3Accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networksRuth Kristianingsih0Dan MacLean1The Sainsbury Laboratory, University of East AngliaThe Sainsbury Laboratory, University of East AngliaAbstract Background Plant pathogens cause billions of dollars of crop loss every year and are a major threat to global food security. Effector proteins are the tools such pathogens use to infect the cell, predicting effectors de novo from sequence is difficult because of the heterogeneity of the sequences. We hypothesised that deep learning classifiers based on Convolutional Neural Networks would be able to identify effectors and deliver new insights. Results We created a training set of manually curated effector sequences from PHI-Base and used these to train a range of model architectures for classifying bacteria, fungal and oomycete sequences. The best performing classifiers had accuracies from 93 to 84%. The models were tested against popular effector detection software on our own test data and data provided with those models. We observed better performance from our models. Specifically our models showed greater accuracy and lower tendencies to call false positives on a secreted protein negative test set and a greater generalisability. We used GRAD-CAM activation map analysis to identify the sequences that activated our CNN-LSTM models and found short but distinct N-terminal regions in each taxon that was indicative of effector sequences. No motifs could be observed in these regions but an analysis of amino acid types indicated differing patterns of enrichment and depletion that varied between taxa. Conclusions Small training sets can be used effectively to train highly accurate and sensitive deep learning models without need for the operator to know anything other than sequence and without arbitrary decisions made about what sequence features or physico-chemical properties are important. Biological insight on subsequences important for classification can be achieved by examining the activations in the modelhttps://doi.org/10.1186/s12859-021-04293-3AIDeep learningEffector protein
collection DOAJ
language English
format Article
sources DOAJ
author Ruth Kristianingsih
Dan MacLean
spellingShingle Ruth Kristianingsih
Dan MacLean
Accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networks
BMC Bioinformatics
AI
Deep learning
Effector protein
author_facet Ruth Kristianingsih
Dan MacLean
author_sort Ruth Kristianingsih
title Accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networks
title_short Accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networks
title_full Accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networks
title_fullStr Accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networks
title_full_unstemmed Accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networks
title_sort accurate plant pathogen effector protein classification ab initio with deepredeff: an ensemble of convolutional neural networks
publisher BMC
series BMC Bioinformatics
issn 1471-2105
publishDate 2021-07-01
description Abstract Background Plant pathogens cause billions of dollars of crop loss every year and are a major threat to global food security. Effector proteins are the tools such pathogens use to infect the cell, predicting effectors de novo from sequence is difficult because of the heterogeneity of the sequences. We hypothesised that deep learning classifiers based on Convolutional Neural Networks would be able to identify effectors and deliver new insights. Results We created a training set of manually curated effector sequences from PHI-Base and used these to train a range of model architectures for classifying bacteria, fungal and oomycete sequences. The best performing classifiers had accuracies from 93 to 84%. The models were tested against popular effector detection software on our own test data and data provided with those models. We observed better performance from our models. Specifically our models showed greater accuracy and lower tendencies to call false positives on a secreted protein negative test set and a greater generalisability. We used GRAD-CAM activation map analysis to identify the sequences that activated our CNN-LSTM models and found short but distinct N-terminal regions in each taxon that was indicative of effector sequences. No motifs could be observed in these regions but an analysis of amino acid types indicated differing patterns of enrichment and depletion that varied between taxa. Conclusions Small training sets can be used effectively to train highly accurate and sensitive deep learning models without need for the operator to know anything other than sequence and without arbitrary decisions made about what sequence features or physico-chemical properties are important. Biological insight on subsequences important for classification can be achieved by examining the activations in the model
topic AI
Deep learning
Effector protein
url https://doi.org/10.1186/s12859-021-04293-3
work_keys_str_mv AT ruthkristianingsih accurateplantpathogeneffectorproteinclassificationabinitiowithdeepredeffanensembleofconvolutionalneuralnetworks
AT danmaclean accurateplantpathogeneffectorproteinclassificationabinitiowithdeepredeffanensembleofconvolutionalneuralnetworks
_version_ 1721296342423175168