For pure compression speed, we have pigz level 1 to 4 or zstd level -4 to 2 which are all above 200MB/s compression speed.For compression ratios above pbzip2's level 9, 3.878 compression ratio, we have the following options in order of fastest compression to slowest: plzip level 4, pxz level 4 and zstd level 18 and zstd -format=xz level 4.Or lower pbzip2 compression level to 1 to 4. However, if you need better compression ratio than gzip/pigz but faster than pbzip2 speed, zstd at level 3 to 6 are the sweet spot. Pbzip2 level 9 compression can be done at 50.03MB/s with decompression at 132.11MB/s with compression ratio of 3.878 and only using max of 73,608 bytes of memory. For compression ratios better than gzip/pigz, multithreaded bzip2 via pbzip2 seems to have the best balance of compression and decompression speed and memory usage for compression ratios between 3.499 to 3.878.While pigz compression ratio at 3.060 is just behind zstd at 3.172. Multithreaded gzip via pigz default compression level 6 just edges out zstd default compression level 3 in terms of compression speed 143.36MB/s vs 122.50MB/s and is much faster for decompression at 284.70MB/s vs 90.24MB/s.For zstd compression with default level 3 compression had 122.50MB/s compression speed and 90.24MB/s decompression speed with compression ratio = 3.172 for original to compressed ratio size.Plzip default level 6 compression had 11.51MB/s compression speed and 206.26MB/s decompression speed with compression ratio = 4.225 for original to compressed ratio size. For lzip compression, multithreaded lzip via plzip was fastest. Pxz default level 6 compression had 9.45MB/s compression speed and 70.43MB/s decompression speed with compression ratio = 4.277 for original to compressed ratio size. For xz compression, multithreaded xz via pxz was fastest. Pbzip2 default level 6 compression had 62.77MB/s compression speed and 172.76MB/s decompression speed with compression ratio = 3.792 for original to compressed ratio size.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |