Questions tagged [bzip2]

bzip2 is a Unix command used for compression and decompression of files. The main advantage of bzip2 is that it has a high compression ratio with reasonable speed.

bzip2 one of the most widely used free compression programs for the terminal.

It typically compresses files to within 10% to 15% of the best available techniques, whilst being around twice as fast at compression and six times faster at decompression.

The current version is 1.0.6, released 20 Sept 2010.

327 questions
3
votes
0 answers

new version bzip2 ignored while installing R 3.4.0 in home directory in CentOS

I do not have enough permissions, so I need to install R3.4.0 in my home directory. A newer version of bzip2 is required (>= 1.0.6) The current version is v1.0.5 I've build bzip2 v1.0.6 in my home directory. There are 4 directories in the build…
Sergio.pv
  • 1,380
  • 4
  • 14
  • 23
3
votes
1 answer

Operation not permitted when decompressing bz2 file into azure storage

I am trying to decompress a bz2 file into a azure storage with the following command: $ bzip2 -d huge-file.xml.bz2 After a while, say around 40 minutes. I have this message: bzip2: I/O or other error, bailing out. Possible reason follows. bzip2:…
Montenegrodr
  • 1,597
  • 1
  • 16
  • 30
3
votes
1 answer

How do I extract all the data from a bzip2 archive with C?

I have a concatenated file made up of some number of bzip2 archives. I also know the sizes of the individual bzip2 chunks in that file. I would like to decompress a bzip2 stream from an individual bzip2 data chunk, and write the output to standard…
Alex Reynolds
  • 95,983
  • 54
  • 240
  • 345
3
votes
1 answer

How to capture tcpdump to a compress file in linux

I have a DNS server and I want to capture DNS traffic to get all the IPs which use my DNS server. For this I start using following tcpdump command and capture them to a file: tcpdump -n -i eth0 dst port 53 >> dns_data.log But the file size is high…
Yasiru G
  • 6,886
  • 6
  • 23
  • 43
3
votes
2 answers

Fast memmove for x86 and +1 shift (for Move-to-front transform)

For fast MTF ( http://en.wikipedia.org/wiki/Move-to-front_transform ) i need faster version of moving a char from inside the array into the front of it: char mtfSymbol[256], front; char i; for(;;) { \\ a very big loop ... i=get_i(); \\ i…
osgx
  • 90,338
  • 53
  • 357
  • 513
3
votes
2 answers

Organizing files in tar bz2 file with python

I have about 200,000 text files that are placed in a bz2 file. The issue I have is that when I scan the bz2 file to extract the data I need, it goes extremely slow. It has to look through the entire bz2 file to fine the single file I am looking for.…
xZel
  • 65
  • 1
  • 1
  • 7
3
votes
0 answers

How to extarct contents of bz2 files - Hadoop

I have a tar archive (about 40 GB) which has many subfolders within which my data resides. The structure is : Folders -> Sub Folders -> json.bz2 files. TAR file: Total size: ~ 40GB Number of inner .bz2 files (arranged in folders): 50,000 Size of one…
3
votes
3 answers

Python BZ2 IOError: invalid data stream

Traceback (most recent call last): File "TTRC_main.py", line 309, in updater.start() File "TTRC_main.py", line 36, in start newFileData = bz2.BZ2File("C:/Program Files (x86)/Toontown Rewritten/temp/phase_7.mf.bz2","…
Crazy Clyde
  • 57
  • 1
  • 2
  • 7
3
votes
1 answer

bunzip / bzip2 an entire directory instead of individual files in the directory

With gunzip its simply zip -r archive.zip my_dir/. Am failing to find an equivalent command for bunzip. Some if found are zipping individual files inside of a directory, but i want one .bzip2 archive.
Pratik Khadloya
  • 12,509
  • 11
  • 81
  • 106
3
votes
1 answer

How to extract .tar.bz2 in node.js using streams?

I'm trying to extract some .tar.bz2 files in node.js. I'm searching here, in npm, github and teh google for this but there is no ready solution. My files are ~25mb each so I think the best way would be in a piped stream with the tar module (similar…
Bartvds
  • 3,340
  • 5
  • 30
  • 42
3
votes
1 answer

Importing bz2 compressed binary file as numpy array

I have a bz2 compressed binary (big endian) file containing an array of data. Uncompressing it with external tools and then reading the file in to Numpy works: import numpy as np dim = 3 rows = 1000 cols = 2000 mydata =…
HyperCube
  • 3,870
  • 9
  • 41
  • 53
3
votes
1 answer

Handle gzipped or bzip2ed downloads without keeping compressed data

I'd like to download a compressed file (either in gzip or bzip2), decompress it and analyze its contents (it's a CSV-like file with lots of data, I calculate sums, averages and such for certain columns) while the download happens (so that I can show…
liori
  • 40,917
  • 13
  • 78
  • 105
3
votes
1 answer

installing bzip2 for php

I have a server with CentOs and PHP 5.3.16 and I want to enable bzip2 to use with php.. I downloaded and installed bzip2 from its original site in /usr/local/bin and edited the configuration.php5 file and inclueded --with-bz2=/usr/local/bin in…
Exlord
  • 5,009
  • 4
  • 31
  • 51
3
votes
2 answers

bz2 issue when installing Python 2.6.6 on Cent OS 5.8

I installed bzip2, bzip2-devel & bzip2-libs using the following command: yum install bzip2 bzip2-devel bzip2-libs Installation proceeded with to warning or error. After this step, I installed Python 2.6.6 using the following commands (note: I must…
Bruno
  • 189
  • 1
  • 4
  • 15
2
votes
1 answer

Python BZ2 Compressor - compress() not returning anything

I am trying to compress a data stream using pythons bz2compressor class. The documentation says bz2compressor.compress() should return chunks of compressed data "whenever possible" but I don't get anything I get ALL my compressed data when I…