Comparison of In Silico Tools for Splice-Altering Variant Prediction Using Established Spliceogenic Variants: An End-User’s Point of View

Assessing the impact of variants of unknown significance on splicing has become a critical issue and a bottleneck, especially with the widespread implementation of whole-genome or exome sequencing. Although multiple in silico tools are available, the interpretation and application of these tools are...

Full description

Saved in:
Bibliographic Details
Main Authors: Woori Jang, Joonhong Park, Hyojin Chae, Myungshin Kim
Format: Article
Language:English
Published: Wiley 2022-01-01
Series:International Journal of Genomics
Online Access:http://dx.doi.org/10.1155/2022/5265686
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832549050427113472
author Woori Jang
Joonhong Park
Hyojin Chae
Myungshin Kim
author_facet Woori Jang
Joonhong Park
Hyojin Chae
Myungshin Kim
author_sort Woori Jang
collection DOAJ
description Assessing the impact of variants of unknown significance on splicing has become a critical issue and a bottleneck, especially with the widespread implementation of whole-genome or exome sequencing. Although multiple in silico tools are available, the interpretation and application of these tools are difficult and practical guidelines are still lacking. A streamlined decision-making process can facilitate the downstream RNA analysis in a more efficient manner. Therefore, we evaluated the performance of 8 in silico tools (Splice Site Finder, MaxEntScan, Splice-site prediction by neural network, GeneSplicer, Human Splicing Finder, SpliceAI, Splicing Predictions in Consensus Elements, and SpliceRover) using 114 NF1 spliceogenic variants, experimentally validated at the mRNA level. The change in the predicted score incurred by the variant of the nearest wild-type splice site was analyzed, and for type II, III, and IV splice variants, the change in the prediction score of de novo or cryptic splice site was also analyzed. SpliceAI and SpliceRover, tools based on deep learning, outperformed all other tools, with AUCs of 0.972 and 0.924, respectively. For de novo and cryptic splice sites, SpliceAI outperformed all other tools and showed a sensitivity of 95.7% at an optimal cut-off of 0.02 score change. Our results show that deep learning algorithms, especially those of SpliceAI, are validated at a significantly higher rate than other in silico tools for clinically relevant NF1 variants. This suggests that deep learning algorithms outperform traditional probabilistic approaches and classical machine learning tools in predicting the de novo and cryptic splice sites.
format Article
id doaj-art-99de6891a8084b8ca2afda4dff019df2
institution Kabale University
issn 2314-4378
language English
publishDate 2022-01-01
publisher Wiley
record_format Article
series International Journal of Genomics
spelling doaj-art-99de6891a8084b8ca2afda4dff019df22025-02-03T06:12:26ZengWileyInternational Journal of Genomics2314-43782022-01-01202210.1155/2022/5265686Comparison of In Silico Tools for Splice-Altering Variant Prediction Using Established Spliceogenic Variants: An End-User’s Point of ViewWoori Jang0Joonhong Park1Hyojin Chae2Myungshin Kim3Department of Laboratory MedicineDepartment of Laboratory MedicineDepartment of Laboratory MedicineDepartment of Laboratory MedicineAssessing the impact of variants of unknown significance on splicing has become a critical issue and a bottleneck, especially with the widespread implementation of whole-genome or exome sequencing. Although multiple in silico tools are available, the interpretation and application of these tools are difficult and practical guidelines are still lacking. A streamlined decision-making process can facilitate the downstream RNA analysis in a more efficient manner. Therefore, we evaluated the performance of 8 in silico tools (Splice Site Finder, MaxEntScan, Splice-site prediction by neural network, GeneSplicer, Human Splicing Finder, SpliceAI, Splicing Predictions in Consensus Elements, and SpliceRover) using 114 NF1 spliceogenic variants, experimentally validated at the mRNA level. The change in the predicted score incurred by the variant of the nearest wild-type splice site was analyzed, and for type II, III, and IV splice variants, the change in the prediction score of de novo or cryptic splice site was also analyzed. SpliceAI and SpliceRover, tools based on deep learning, outperformed all other tools, with AUCs of 0.972 and 0.924, respectively. For de novo and cryptic splice sites, SpliceAI outperformed all other tools and showed a sensitivity of 95.7% at an optimal cut-off of 0.02 score change. Our results show that deep learning algorithms, especially those of SpliceAI, are validated at a significantly higher rate than other in silico tools for clinically relevant NF1 variants. This suggests that deep learning algorithms outperform traditional probabilistic approaches and classical machine learning tools in predicting the de novo and cryptic splice sites.http://dx.doi.org/10.1155/2022/5265686
spellingShingle Woori Jang
Joonhong Park
Hyojin Chae
Myungshin Kim
Comparison of In Silico Tools for Splice-Altering Variant Prediction Using Established Spliceogenic Variants: An End-User’s Point of View
International Journal of Genomics
title Comparison of In Silico Tools for Splice-Altering Variant Prediction Using Established Spliceogenic Variants: An End-User’s Point of View
title_full Comparison of In Silico Tools for Splice-Altering Variant Prediction Using Established Spliceogenic Variants: An End-User’s Point of View
title_fullStr Comparison of In Silico Tools for Splice-Altering Variant Prediction Using Established Spliceogenic Variants: An End-User’s Point of View
title_full_unstemmed Comparison of In Silico Tools for Splice-Altering Variant Prediction Using Established Spliceogenic Variants: An End-User’s Point of View
title_short Comparison of In Silico Tools for Splice-Altering Variant Prediction Using Established Spliceogenic Variants: An End-User’s Point of View
title_sort comparison of in silico tools for splice altering variant prediction using established spliceogenic variants an end user s point of view
url http://dx.doi.org/10.1155/2022/5265686
work_keys_str_mv AT woorijang comparisonofinsilicotoolsforsplicealteringvariantpredictionusingestablishedspliceogenicvariantsanenduserspointofview
AT joonhongpark comparisonofinsilicotoolsforsplicealteringvariantpredictionusingestablishedspliceogenicvariantsanenduserspointofview
AT hyojinchae comparisonofinsilicotoolsforsplicealteringvariantpredictionusingestablishedspliceogenicvariantsanenduserspointofview
AT myungshinkim comparisonofinsilicotoolsforsplicealteringvariantpredictionusingestablishedspliceogenicvariantsanenduserspointofview