0

I uses RAR since it was released a decade ago perhaps. However it is good for desktop applications I just found that on server where I need to compress a lot of text files every weekend it takes ages.

I looked into CPU usage and RAR takes around 15% of total CPU time. Nothing else is running alongside.

I have Xeon 8 threads (4 HT cores) and Windows 2008 R2.

Is there a compression software which zips no worse than RAR with option Best and takes advantage of all cores and HT ?

Thanks

P.S. Also has to have x64 version

Boppity Bop
  • 752
  • 3
  • 11
  • 34
  • Product recommendations are off-topic per the [FAQ](http://serverfault.com/faq). – sysadmin1138 Apr 14 '13 at 02:07
  • Okay, I know that this post is really outdated. But for people who still want to know. It is not as simple as it looks. There are a few extra factors you need to take a look at. 1. The Hard drive speed (You cant write files faster than a standard speed so there would be no use for a quicker decompression. 2. A processor is designed for a special job. That's why CPU's suck at the GPU job. Some processors are simply not designed for decompressing. 3. You also need to look at how big the file is. And how big it is when it's compressed. The bigger it is compressed the more work the processor will –  Apr 13 '13 at 23:28

2 Answers2

1

On a single server, pigz is gzip compatible, which makes for trivial portability. It will use as many cores as you have, to compress file(s). I've found it quite useful, and significantly speeds up compression of a number of files. Usefully, pigz is installable directly from apt in Ubuntu 10.4.

Something else at a higher level that I have just seen today is Gnu Parallel that will run a program/script against multiple files either multiple times concurrently, and/or even more interestingly, on multiple machines. http://www.youtube.com/watch?v=OpaiGYxkSuQ is a video demo (part 1) of its use.

These are both unfortunately primarily *nix based tools, though they may also be available via Cygwin.

Alister Bulman
  • 1,624
  • 13
  • 13
  • Alister it is a little too bold to install whole Unix add-on to run someone's favorite tools which used 20 min out of 24*7. – Boppity Bop Jul 24 '10 at 16:06
0

Ok. I found the benchmark for many formats. It seems Winrar beats 7Zip on Best. And 7Zip with LZMA2 beats Winrar on Default...

So I am going to install 7Zip and compare it to Winrar side-by-side.

http://www.tomshardware.co.uk/archive-zip-compression,review-31831-8.html

Boppity Bop
  • 752
  • 3
  • 11
  • 34
  • 7Zip beats them all, you can use Ultra Compression and use the zip format. Or if your bizz accepts it you can use .7z format, like microsoft uses to decompress silverlight and make its download smaller. – Gabriel Guimarães Nov 09 '10 at 12:26