Zhuff - fast compression => x2.58 @ 147 MB/s

View previous topic View next topic Go down

Zhuff - fast compression => x2.58 @ 147 MB/s

Post  Yann on Sun 13 Dec - 3:43

Note : New Zhuff HomePage is hosted here : http://fastcompression.blogspot.com/p/zhuff.html

Zhuff is a compression software designed for speed.
It is based around LZSS & Huffman mechanisms, similar in principles to Zip.
Schematically, it consists of LZ4 & Huff0 merged together.

Zhuff is typically 4 to 5 times faster per core than Zip's fastest mode.

ZhuffHC is a derivative of Zhuff, using MMC match search algorithm.


Download :
v0.8 : Zhuff (portable binary)
- New : All compression levels into a single binary
- New : Pipe mode support
- New : New benchmark mode with multiple files


Compression evaluation :
File sample totalizing about 4GB.
In-memory benchmark results (-b command), excluding I/O considerations (such as hard drive).
Benchmark platform : Core 2 Duo E8400 (3GHz), Window Seven 32-bits

version
threads
Compression Ratio
Speed
Decoding
Zhuff0.7
-t1
2.584
147 MB/s
278 MB/s
Zhuff0.7
-t2
2.584
285 MB/s
550 MB/s
ZhuffHC
0.1
-t1
2.781
28.3 MB/s
312 MB/s
ZhuffHC
0.1
-t2
2.781
55.6 MB/s
618 MB/s

.


Last edited by Yann on Mon 28 Nov - 23:18; edited 50 times in total

Yann
Admin

Number of posts: 174
Registration date: 2008-05-01

http://phantasie.tonempire.net

Back to top Go down

Previous Releases

Post  Yann on Sun 13 Dec - 3:43

v0.8 : Zhuff (win32)
- All compression levels into a single binary
- Pipe mode support
- New benchmark mode with multiple files

v0.7 : Zhuff (win32)
- Multi-threaded compression and decoding (max 32 parallel threads)
- Automatically detects system's nb of cores

v0.6 : Zhuff (win32)
- Improved compression ratio (better sampling)

v0.5 : Zhuff (win32)
- Improved I/O code : faster speed for Windows XP 32/64

v0.4 : Zhuff (win32)
- good compression speed improvement
- small compression ratio improvement

v0.3 : Zhuff (win32)
- small speed improvement

v0.2 : Zhuff (win32)
- in-memory benchmark option available

v0.1 : Zhuff (win32)
- Initial release

"High Compression" version :
v0.1 : ZhuffHC - using MMC search algorithm
- New : Initial release, merging MMC with Zhuff


Last edited by Yann on Mon 28 Nov - 23:04; edited 12 times in total

Yann
Admin

Number of posts: 174
Registration date: 2008-05-01

http://phantasie.tonempire.net

Back to top Go down

Benchmarks

Post  Yann on Sun 13 Dec - 3:44

1) Zhuff tested on Matt Mahoney's LTCB (Large Text Compression Benchmark) : Pareto Frontier ! (Best Compression for the speed)

2) Zhuff tested on Monster of Compression Benchmark (thanks Nania)

3) Zhuff multi-threaded tests on encode.ru (thanks Sportman!)

4) Zhuff tested on MaximumCompression.com : Pareto Frontier (Best compression for a given speed)

5) Zhuff tested on SqueezeChart (thanks Stephan) : Speed Record

6) Zhuff tested on CompressionRatings.com (thanks Sami) : Best Speed-Oriented Compression program

7) Graphical comparison of Fast compressors (outdated) :
http://phantasie.tonempire.net/pc-compression-f2/compression-benchmark-t96.htm#149

8 ) Reports, using in-memory benchmark (-b option) :

Intrinsic's rig : Core 2 Duo 3.3 GHz (2 cores), 4 GB RAM (DDR2, CL 5) :
Zhuff v0.7, file 'Oblivion - Sounds.bsa' - Compressed at 315.8 MB/s. Decompressed at 466.5 MB/s.

Szymon's rig : PhenomII x6 1075T (3.0 GHz, 6 cores), 8 GB RAM (DDR3, 1333MHz, CL 7.0), 64-bit Win7:
Zhuff v0.7, file 'enwik9' - Compressed at 575.0 MB/s. Decompressed at 1358.3 MB/s.

Bruno's rig : 2x Xeon QuadCore (8 cores) with Hyperthreading, 12 GB RAM, 64-bit Win7:
Zhuff v0.7, file 'enwik9' - Compressed at 1150 MB/s. Decompressed at 2200 MB/s.

- Reports, using file i/o interface:

Shelwien's rig : Core 2 QuadCore Q9450 @ 3.52ghz, ramdrive
Zhuff v0.7, file 'enwik9' - Compressed at 430 MB/s. Decompressed at 560 MB/s.

Sportman's rig : 2 x 4 core 2.4 GHz Xeon and 6 x 7200 rpm RAID5 disks
Zhuff v0.7, file 'html/text' - Compressed at 1122 MB/s.

Yann
Admin

Number of posts: 174
Registration date: 2008-05-01

http://phantasie.tonempire.net

Back to top Go down

View previous topic View next topic Back to top

- Similar topics

Permissions in this forum:
You cannot reply to topics in this forum