Stack Overflow
Stack Overflow

Questions tagged [xz]

xz is a lossless data compression program and file format which incorporates the LZMA/LZMA2 compression algorithms

XZ Utils (previously LZMA Utils) is a set of free command-line lossless data compressors, including LZMA and xz, for Unix-like operating systems and, from version 5.0 onwards, Microsoft Windows.

105 questions
1
vote
1 answer

Read .xz file from S3 in C#

I am trying to read file from S3 using below code: var dir = new S3DirectoryInfo(_amazonS3Client, bucketName, folderName); IS3FileSystemInfo[] files = dir.GetFileSystemInfos(); if(files.Length > 0) { …
Mukesh Rawat
  • 2,047
  • 16
  • 30
1
vote
1 answer

man source code and configuration to use xz instead of gzip

I'm wondering a few things about man pages and man utility. man seems to be implemented as a pipeline of basic commands, such as (over-simplified): zcat /path/to/man/page.3.gz | groff -man | less However, there is some logic implemented: reading…
randruc
  • 11
  • 1
1
vote
0 answers

How can I compress many files in a solid archive, but quickly extract only one?

I have 14,000 25 MB files that I am trying to compress to minimum size for storage. At runtime, I will only need to decompress one or two of the files. There is sufficient intra-file redundancy that they compress reasonably well, but there is also…
Andrew Reiter
  • 11
  • 1
1
vote
2 answers

How to redirect xz's normal stdout when do tar | xz?

I need to use a compressor like xz to compress huge tar archives. I am fully aware of previous questions like Create a tar.xz in one command and Utilizing multi core for tar+gzip/bzip compression/decompression From them, I have found that…
HaroldFinch
  • 762
  • 1
  • 6
  • 17
1
vote
1 answer

Locate the end of an XZ stream

I am currently trying to extract the inital RAM filesystem that is embedded in a kernel image, modify it, and repack the kernel image with it. You can search GitHub and find several projects that do this here. My problem with those scripts is that…
Melab
  • 2,594
  • 7
  • 30
  • 51
1
vote
0 answers

Rsync with .dd.xz files

I am trying different ways to update/write an image on a linux device and using rsync for this. For file system synchronization rsync checks and only transfers missing /changed files reducing the bandwidth. In similar way I created a binary file of…
user2500239
  • 43
  • 1
  • 7
1
vote
1 answer

How to compress warc records with lzma (*.warc.xz) in python3?

I have a list of warc records. Every single item in list is created like this: header = warc.WARCHeader({ "WARC-Type": "response", "WARC-Target-URI": "www.somelink.com", }, defaults=True) data = "Some string" record =…
Tehryn
  • 57
  • 1
  • 10
1
vote
1 answer

ImageMagick unable to start because of incompatible version of liblzma

I'm trying to setup a server to serve a Ruby app that uses ImageMagick and the RMagick gem. The server is running OS X 10.10. I have another server that is running the same versions of everything (OS, ImageMagick, xz, and the RMagick gem) that is…
tecz
  • 31
  • 6
1
vote
1 answer

Reading compressed (.xz) file in Apache pig

I am trying to read .xz file compressed using hadoop-xz codec using pig script. The sample code i tried is, REGISTER hadoop-xz-1.4.jar SET output.compression.enabled true; SET output.compression.codec io.sensesecure.hadoop.xz.XZCodec; msg = LOAD…
Nikhil
  • 2,857
  • 9
  • 34
  • 58
1
vote
2 answers

Why can a textual representation of pi be compressed?

A random string should be incompressible. pi = "31415..." pi.size # => 10000 XZ.compress(pi).size # => 4540 A random hex string also gets significantly compressed. A random byte string, however, does not get compressed. The string of pi only…
Kappie001
  • 898
  • 2
  • 10
  • 20
1
vote
3 answers

In this makefile, why is the prerequisite for the target "bunzip2/data2.tar" always being remade?

I have a make file that is always re-running a rule despite the prerequisite being up-to-date: data.tar.bz2: data.tar bzip2 --keep data.tar # The following rule always runs the rule for its prerequisite # even if it is up-to-date. Note that it…
SO Stinks
  • 3,258
  • 4
  • 32
  • 37
1
vote
1 answer

Get percentage of extraction with XZ Java for android

I am using the XZ Java library to extract a .xz file on Android of size around 16MB. I am running the extraction/decompression code as an AsyncTask and so, I would like to see the percentage of extraction via the onProgressUpdate(Integer ... values)…
Vignesh PT
  • 624
  • 12
  • 28
1
vote
1 answer

Is .xz file format description telling it all?

I've been reading the description of xz file format ( http://tukaani.org/xz/xz-file-format.txt ). But when I try to look into an xz file with binary editor, it doesn't seem to follow the structure defined in the description. What am I missing? I…
Pnog is not Pong
  • 175
  • 1
  • 1
  • 8
1
vote
1 answer

Is it possible to pipe `script` to, for example, `xz` for on-the-fly compressing instead of a file or a device?

The title is the question. As root, I tried script -a - | nice_xzfull file.xz where nice_xzfull=ionice -c 3 nice -n 20 xz -vvz9e --lzma2=dict=64MiB,mf=bt4,nice=273 --threads=3 (notice the last space) but instead script started and stopped, xz…
rautamiekka
  • 251
  • 2
  • 14
1
vote
1 answer

How do I process Protocol Buffer files in Hadoop Map/Reduce using compression other than LZO?

I would like to use Hadoop Map/Reduce to process delimited Protocol Buffer files that are compressed using something other than LZO, e.g. xz or gzip. Twitter's elephant-bird library seems to mainly support reading protobuf files that are LZO…
Josh Hansen
  • 1,408
  • 2
  • 17
  • 20
1 2 3
4
5 6 7