Questions tagged [compression]

Decrease the size of data, typically to preserve space or reduce network bandwidth required while transmitting files. It can be applied to files, folders, disks, etc.

418 questions
8
votes
5 answers

Does ZFS cache Compressed or Uncompressed data in a ZFS file-system with compression turned on?

ZFS supports file-system compression and it also caches frequently or recently accessed data. If a system has lots of CPU but the underlying data storage system is slow. It is possible that ZFS would perform better with compression turned on. This…
700 Software
  • 2,233
  • 10
  • 49
  • 77
7
votes
3 answers

ssh can't set compression level to more, than 6

When I do (I've tried various ways): ssh -v -C -o CompressionLevel=9 user@ip ssh -v -C -o 'CompressionLevel=9' user@ip ssh -v -o 'Compression=yes' -o 'CompressionLevel=9' user@ip ssh -v -o 'CompressionLevel=9' -o 'Compression=yes' user@ip ssh -v -C…
igoryonya
  • 195
  • 1
  • 3
  • 14
7
votes
1 answer

Risks of setting noCompressionForHttp10 and noCompressionForProxies to false

We recently switched to Amazon Cloudfront for static content. It seems that Cloudfront does HTTP 1.0 requests to the origin server (IIS 7.0) using the Via header. By default IIS 7.0 disables file compression for both these options (HTTP 1.0 and…
dotarj
  • 171
  • 3
7
votes
4 answers

backup files with many duplicated files

I frequently need to do a backup of a group of files, with many subfolders which contain several large, identical files. Is there a compression scheme (.zip, .7z, etc) which can automatically detect this and not store identical files more than once?
Warpin
  • 173
  • 1
  • 3
7
votes
3 answers

how to make rsync not uncompressing files?

I'm using rsync to copy files between servers, I'm using -z option what compresses data only for the network transfer stage. But I would like to leave compressed files on remote machine and I have not found this option in rsync. Is this possible…
wlk
  • 1,713
  • 3
  • 14
  • 19
7
votes
1 answer

Apache deflates .xml.gz files

I noticed an error in google webmaster tools regarding a gzipped version of a sitemap. Turns out the sitemap.xml.gz file is gzipped twice: one upon creation (as it should be) and another time when being served. The .htaccess file has this…
Matteo Riva
  • 297
  • 3
  • 14
7
votes
10 answers

Can I compress an encrypted file?

I have an encrypted file (AES Symmetric encryption).For backup purposes and to save disk space, Can I compress (lossless) the file without worrying about messing up the decryption? If so, can you recommend some good compression programs for this…
BlueGene
  • 2,241
  • 9
  • 30
  • 33
7
votes
5 answers

How can I recursively bzip2 all files that aren't bzipped?

How can I recursively bzip2 all files that do not end with the .bz2 extension in Linux?
Alon Gubkin
  • 666
  • 3
  • 7
  • 12
7
votes
3 answers

Faster zlib alternatives

I wonder, if there are any faster builds of zlib around with more advanced optimizations? If it's possible to optimize it using SSE instructions or Intel C++ compiller, or some trick which were patented earlier (I know patents were a serious…
BarsMonster
  • 724
  • 4
  • 12
  • 26
7
votes
4 answers

silent 7za compression

Without doing stdout redirection. Is it possible to have a silent run of 7za?
romant
  • 526
  • 5
  • 21
6
votes
7 answers

How to "really" reduce the size of KVM VMs images?

I've spent many hours searching the web about how to shrink KVM virtual disk images, especially for Windows guests, with no luck. All I've found is to zeroize the VM free space, defrag the virtual disk (from Windows), and then run qemu-img convert…
romu
  • 303
  • 1
  • 5
  • 11
6
votes
1 answer

How well does elasticsearch compress data?

I am looking to scope the servers required for an elasticsearch proof-of-concept. Ultimately, my question is this: Given 1GB of json text indexed by elasticsearch, how much can I expect to be occupied on disk by elasticsearch? Obviously there are…
cmonkey
  • 163
  • 1
  • 5
6
votes
1 answer

Verify if the files can be unzipped successfully from 7Zip archive

We want to 7zip many database files (mysql, Oracle, and SQL Server dumps), various standard files (excel, word, etc), but we are afraid that once we 7Zip them and delete the originals it can happen that archive is corrupted or it has some error and…
6
votes
4 answers

Packeteer Alternative

I have been tasked with starting to monitor and restrict our companies internet access. We have considered a Squid Proxy server but have decided we need something more robust then that. We would like many of the features commonly available on…
Xap
  • 411
  • 1
  • 6
  • 12
6
votes
1 answer

stuffit compression on linux?

I have a stuffit archive (.bin). I only have access to linux, how do I uncompress it? File Roller claims the ability to uncompress the archive, but it is unable. Wikipedia lists two resources to compress unstuff it on linux but one of the resources…
Ethan Heilman
  • 741
  • 2
  • 8
  • 10