Python zipfile large file hangs forevers

Question

python -m zipfile -c ~/testbig.zip ~/verylarge4gbfile.zip

It hangs forever.

Is there a better python library I can use?

I'm using the command as a POC that the library doesn't seem to work for large files, so I need another python library option, although I suppose I could also use a system command and call it through python, but I'd prefer to handle progress of zipping the file[s].

EDIT: I ran it again, and after 30 minutes it finished. I suppose I just need a way to monitor progress, or chunk the zipping process.

gzip should work I believe – Chetan_Vasudevan Oct 13 '17 at 18:40 — Chetan_Vasudevan, Oct 13 '17 at 18:40
What version of Python are you using? – Robᵩ Oct 13 '17 at 20:39 — Robᵩ, Oct 13 '17 at 20:39
gzip worked wonders! – Sophie McCarrell Oct 13 '17 at 23:11 — Sophie McCarrell, Oct 13 '17 at 23:11
FYI I was using 2.7 – Sophie McCarrell Oct 14 '17 at 21:37 — Sophie McCarrell, Oct 14 '17 at 21:37

score 0 · Accepted Answer · answered Oct 13 '17 at 23:12

0

Just use GZip. It's iteratable, so you can for loop through the data to watch for progress.

answered Oct 13 '17 at 23:12

Sophie McCarrell

2,831
8
31
64

Python zipfile large file hangs forevers

1 Answers1