A novel approach to analyzing the evolution of SARS-CoV-2 based on visualization and clustering of large genetic data compactly represented in operative memory
SARS-CoV-2 is a virus for which an outstanding number of genome variants were collected, sequenced and stored from sources all around the world. Raw data in FASTA format include 16.8 million genomes, each ≈29,900 nt (nucleotides), with a total size of ≈500 ∙ 109 nt, or 465 Gb. We suggest an approac...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Siberian Branch of the Russian Academy of Sciences, Federal Research Center Institute of Cytology and Genetics, The Vavilov Society of Geneticists and Breeders
2025-01-01
|
| Series: | Вавиловский журнал генетики и селекции |
| Subjects: | |
| Online Access: | https://vavilov.elpub.ru/jour/article/view/4406 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832575041734180864 |
|---|---|
| author | A. Yu. Palyanov N. V. Palyanova |
| author_facet | A. Yu. Palyanov N. V. Palyanova |
| author_sort | A. Yu. Palyanov |
| collection | DOAJ |
| description | SARS-CoV-2 is a virus for which an outstanding number of genome variants were collected, sequenced and stored from sources all around the world. Raw data in FASTA format include 16.8 million genomes, each ≈29,900 nt (nucleotides), with a total size of ≈500 ∙ 109 nt, or 465 Gb. We suggest an approach to data representation and organization, with which all this can be stored losslessly in the operative memory (RAM) of a common PC. Moreover, just ≈330 Mb will be enough. Aligning all genomes versus the initial Wuhan-Hu-1 reference sequence allows each to be represented as a data structure containing lists of point mutations, deletions and insertions. Our implementation of such data representation resulted in a 1:1500 compression ratio (for comparison, compression of the same data with the popular WinRAR archiver gives only 1:62) and fast access to genomes (and their metadata) and comparisons between different genome variants. With this approach implemented as a C++ program, we performed an analysis of various properties of the set of SARS-CoV-2 genomes available in NCBI Genbank (within a period from 24.12.2019 to 24.06.2024). We calculated the distribution of the number of genomes with undetermined nucleotides, ‘N’s, vs the number of such nucleotides in them, the number of unique genomes and clusters of identical genomes, and the distribution of clusters by size (the number of identical genomes) and duration (the time interval between each cluster’s first and last genome). Finally, the evolution of distributions of the number of changes (editing distance between each genome and reference sequence) caused by substitutions, deletions and insertions was visualized as 3D surfaces, which clearly show the process of viral evolution over 4.5 years, with a time step = 1 week. It is in good correspondence with phylogenetic trees (usually based on 3–4 thousand of genome variant representatives), but is built over millions of genomes, shows more details and is independent of the type of lineage/clade classification. |
| format | Article |
| id | doaj-art-bdb1f7a4383c408b8fef2b17f444b642 |
| institution | Kabale University |
| issn | 2500-3259 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Siberian Branch of the Russian Academy of Sciences, Federal Research Center Institute of Cytology and Genetics, The Vavilov Society of Geneticists and Breeders |
| record_format | Article |
| series | Вавиловский журнал генетики и селекции |
| spelling | doaj-art-bdb1f7a4383c408b8fef2b17f444b6422025-02-01T09:58:14ZengSiberian Branch of the Russian Academy of Sciences, Federal Research Center Institute of Cytology and Genetics, The Vavilov Society of Geneticists and BreedersВавиловский журнал генетики и селекции2500-32592025-01-0128884385310.18699/vjgb-24-921519A novel approach to analyzing the evolution of SARS-CoV-2 based on visualization and clustering of large genetic data compactly represented in operative memoryA. Yu. Palyanov0N. V. Palyanova1A.P. Ershov Institute of Informatics Systems of the Siberian Branch of the Russian Academy of Sciences; Research Institute of Virology, Federal Research Center of Fundamental and Translational Medicine; Novosibirsk State UniversityResearch Institute of Virology, Federal Research Center of Fundamental and Translational MedicineSARS-CoV-2 is a virus for which an outstanding number of genome variants were collected, sequenced and stored from sources all around the world. Raw data in FASTA format include 16.8 million genomes, each ≈29,900 nt (nucleotides), with a total size of ≈500 ∙ 109 nt, or 465 Gb. We suggest an approach to data representation and organization, with which all this can be stored losslessly in the operative memory (RAM) of a common PC. Moreover, just ≈330 Mb will be enough. Aligning all genomes versus the initial Wuhan-Hu-1 reference sequence allows each to be represented as a data structure containing lists of point mutations, deletions and insertions. Our implementation of such data representation resulted in a 1:1500 compression ratio (for comparison, compression of the same data with the popular WinRAR archiver gives only 1:62) and fast access to genomes (and their metadata) and comparisons between different genome variants. With this approach implemented as a C++ program, we performed an analysis of various properties of the set of SARS-CoV-2 genomes available in NCBI Genbank (within a period from 24.12.2019 to 24.06.2024). We calculated the distribution of the number of genomes with undetermined nucleotides, ‘N’s, vs the number of such nucleotides in them, the number of unique genomes and clusters of identical genomes, and the distribution of clusters by size (the number of identical genomes) and duration (the time interval between each cluster’s first and last genome). Finally, the evolution of distributions of the number of changes (editing distance between each genome and reference sequence) caused by substitutions, deletions and insertions was visualized as 3D surfaces, which clearly show the process of viral evolution over 4.5 years, with a time step = 1 week. It is in good correspondence with phylogenetic trees (usually based on 3–4 thousand of genome variant representatives), but is built over millions of genomes, shows more details and is independent of the type of lineage/clade classification.https://vavilov.elpub.ru/jour/article/view/4406coronavirussars-cov-2genomevariantsevolutionsoftware systembig datacompact representation of dataanalysisvisualization |
| spellingShingle | A. Yu. Palyanov N. V. Palyanova A novel approach to analyzing the evolution of SARS-CoV-2 based on visualization and clustering of large genetic data compactly represented in operative memory Вавиловский журнал генетики и селекции coronavirus sars-cov-2 genome variants evolution software system big data compact representation of data analysis visualization |
| title | A novel approach to analyzing the evolution of SARS-CoV-2 based on visualization and clustering of large genetic data compactly represented in operative memory |
| title_full | A novel approach to analyzing the evolution of SARS-CoV-2 based on visualization and clustering of large genetic data compactly represented in operative memory |
| title_fullStr | A novel approach to analyzing the evolution of SARS-CoV-2 based on visualization and clustering of large genetic data compactly represented in operative memory |
| title_full_unstemmed | A novel approach to analyzing the evolution of SARS-CoV-2 based on visualization and clustering of large genetic data compactly represented in operative memory |
| title_short | A novel approach to analyzing the evolution of SARS-CoV-2 based on visualization and clustering of large genetic data compactly represented in operative memory |
| title_sort | novel approach to analyzing the evolution of sars cov 2 based on visualization and clustering of large genetic data compactly represented in operative memory |
| topic | coronavirus sars-cov-2 genome variants evolution software system big data compact representation of data analysis visualization |
| url | https://vavilov.elpub.ru/jour/article/view/4406 |
| work_keys_str_mv | AT ayupalyanov anovelapproachtoanalyzingtheevolutionofsarscov2basedonvisualizationandclusteringoflargegeneticdatacompactlyrepresentedinoperativememory AT nvpalyanova anovelapproachtoanalyzingtheevolutionofsarscov2basedonvisualizationandclusteringoflargegeneticdatacompactlyrepresentedinoperativememory AT ayupalyanov novelapproachtoanalyzingtheevolutionofsarscov2basedonvisualizationandclusteringoflargegeneticdatacompactlyrepresentedinoperativememory AT nvpalyanova novelapproachtoanalyzingtheevolutionofsarscov2basedonvisualizationandclusteringoflargegeneticdatacompactlyrepresentedinoperativememory |