Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Computer Science > Data Structures and Algorithms

arXiv:1503.01624 (cs)
[Submitted on 5 Mar 2015]

Title:GDC 2: Compression of large collections of genomes

Authors:Sebastian Deorowicz, Agnieszka Danek, Marcin Niemiec
View PDF
Abstract:The fall of prices of the high-throughput genome sequencing changes the landscape of modern genomics. A number of large scale projects aimed at sequencing many human genomes are in progress. Genome sequencing also becomes an important aid in the personalized medicine. One of the significant side effects of this change is a necessity of storage and transfer of huge amounts of genomic data. In this paper we deal with the problem of compression of large collections of complete genomic sequences. We propose an algorithm that is able to compress the collection of 1092 human diploid genomes about 9,500 times. This result is about 4 times better than what is offered by the other existing compressors. Moreover, our algorithm is very fast as it processes the data with speed 200MB/s on a modern workstation. In a consequence the proposed algorithm allows storing the complete genomic collections at low cost, e.g., the examined collection of 1092 human genomes needs only about 700MB when compressed, what can be compared to about 6.7 TB of uncompressed FASTA files. The source code is available at this http URL.
Subjects: Data Structures and Algorithms (cs.DS); Computational Engineering, Finance, and Science (cs.CE); Genomics (q-bio.GN)
Cite as: arXiv:1503.01624 [cs.DS]
  (or arXiv:1503.01624v1 [cs.DS] for this version)
  https://doi.org/10.48550/arXiv.1503.01624
Journal reference: Scientific Reports, Article no. 11565 (2015)
Related DOI: https://doi.org/10.1038/srep11565

Submission history

From: Sebastian Deorowicz [view email]
[v1] Thu, 5 Mar 2015 12:38:32 UTC (297 KB)
Full-text links:

Access Paper:

  • View PDF
  • TeX Source
  • Other Formats
view license
Current browse context:
cs
< prev   |   next >
new | recent | 2015-03
Change to browse by:
cs.CE
cs.DS
q-bio
q-bio.GN

References & Citations

DBLP - CS Bibliography

listing | bibtex
Sebastian Deorowicz
Agnieszka Danek
Marcin Niemiec
export BibTeX citation

Bookmark

BibSonomy logo Reddit logo

Bibliographic and Citation Tools

Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)

Code, Data and Media Associated with this Article

alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)

Demos

Replicate (What is Replicate?)
Hugging Face Spaces (What is Spaces?)
TXYZ.AI (What is TXYZ.AI?)

Recommenders and Search Tools

Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)