LZ4 - Extremely fast compression

LZ4 is lossless compression algorithm, providing compression speed at 400 MB/s per core, scalable with multi-cores CPU. It also features an extremely fast decoder, with speed in multiple GB/s per core, typically reaching RAM speed limits on multi-core systems. A high compression derivative, called LZ4_HC, is also provided. It trades CPU time for compression ratio.

BranchStatus
masterBuild Status
devBuild Status

Branch Policy:

  • The “master” branch is considered stable, at all times.
  • The “dev” branch is the one where all contributions must be merged before being promoted to master.
  • If you plan to propose a patch, please commit into the “dev” branch. Direct commit to “master” are not permitted.
  • Feature branches can also exist, for dedicated testing of larger modifications before merge into “dev” branch.

Benchmarks

The benchmark uses the Open-Source Benchmark program by m^2 (v0.14.2) compiled with GCC v4.6.1 on Linux Ubuntu 64-bits v11.10, The reference system uses a Core i5-3340M @2.7GHz. Benchmark evaluates the compression of reference Silesia Corpus in single-thread mode.

The LZ4 block compression format is detailed within lz4_block_format.txt.

For streaming unknown amount of data and compress files of any size, a frame format has been published, and can be consulted within the file LZ4_Frame_Format.html .