news.volyx.in

bzip3 (github.com)

427 points by tosh · 35 days ago · 121 comments on HN

Article summary

Bzip3 is a compression algorithm that claims to be a spiritual successor to BZip2, offering higher compression ratios and better performance. It uses a combination of techniques, including a Burrows-Wheeler transform and a RLE with Lempel Ziv+Prediction pass. The algorithm has been benchmarked against other compression algorithms, including zstd, and has shown promising results. However, some users have raised concerns about the benchmarking methodology and the algorithm's decompression performance.

Main themes

  • compression algorithms
  • benchmarking methodology
  • decompression performance
  • memory usage
  • compression ratios
  • algorithm comparison
  • use case scenarios
  • archive formats

What commenters say

  • The benchmarking methodology used to compare bzip3 to other compression algorithms is flawed and misleading.
  • Bzip3's decompression performance is significantly slower than other algorithms, making it less suitable for certain use cases.
  • The choice of compression algorithm and parameters depends on the specific use case and requirements, and bzip3 may be a good choice for certain scenarios.
  • The comparison between bzip3 and zstd is not fair due to the different default settings and parameters used.
  • Bzip3's high memory usage during compression and decompression may be a concern for some users.
  • The algorithm's performance and compression ratio make it a viable alternative to other compression algorithms, despite some drawbacks.
  • The development of a multi-stream archive format could potentially make use of bzip3's strengths and mitigate its weaknesses.
  • The benchmarking results are cherry-picked and do not accurately represent the performance of bzip3 in real-world scenarios.