Stack Overflow
Stack Overflow

Questions tagged [text-compression]

29 questions
0
votes
1 answer

How can i save Scrapy logs in gzip after scrapping without using scripts in bash?

Are there any ways to compress logs? I need to store them for some time for later debugging and it would be cool to find a way to reduce their size. If there is no such a method, then how to organize the compression process more efficiently?
Aleks Kisel
  • 78
  • 5
0
votes
1 answer

Issues with a Reference Code for Running Canonical Huffman Code on Java

I am running the Java program shown here to generate canonical Huffman codes, https://www.geeksforgeeks.org/canonical-huffman-coding/ Although the code gives the correct canonical Huffman codes with the shown input, for other cases I don't find the…
beginner
  • 411
  • 4
  • 14
0
votes
0 answers

compress the text text file full of integer[python]

My python code generates a list of list of integers like this [[1, 311 ,8], [5, 3, 23]]. however it has thousands of hundreds of integer and i have to run the code a hundred times. I have to store these results. I keep them in a file where each list…
Mohsen Fazaeli
  • 123
  • 1
  • 12
0
votes
1 answer

Compress Data in JavaScript and send it to Flask Server

So my team has made a small tool to perform Image Annotation and Labeling. And we were trying to optimize our code. We were able to compress data from the server, but we have been trying to perform compression on data that is being sent from client…
user11094747
  • 1
0
votes
1 answer

Compression of XML containing base64 data

I have an XML file which contains long base64 string data. The size of the XML is roughly 6KB, I want to reduce the size of the XML to somewhere about 1.5 to 2KB. The text compression I am looking for should be lossless. I have tried to use a lot of…
harshkumar
  • 23
  • 5
0
votes
0 answers

Text compressing - Assembly Language

My mission is to basically compress a file, compress data (just alphabet letters without even space) in assembly. What I've done so far: *Received all the data from the txt file *Put it in an array in the following order: the letter with the most…
linuxproblemoz
  • 1
  • 1
0
votes
1 answer

log module with pre-allocated memory

I am writing a logging mechanism that will be used by the rest of the code to log alphanumeric data to file. Every other module in the system will be sending alphanumeric sentences (a couple of words at max) to be written to file continuously. The…
user827088
  • 13
  • 3
0
votes
1 answer

Canonical Huffman Encoder : Contents of Encoded Bitstream

Let's say we have the following canonical Huffman code table. Symbol Code-length Codeword A 2 00 B 2 01 C 2 10 D 2 11 Now, we read the symbols from a input…
beginner
  • 411
  • 4
  • 14
0
votes
2 answers

Old ASCII Protocol Avatar Question

For anyone that remembers the protocol Avatar, (I'm pretty sure this was it's name) I'm trying to find information on it. All I've found so far, is that it's an ANSI style compression protocol, done by compressing common ANSI escape sequences. But,…
LarryF
  • 4,925
  • 4
  • 32
  • 40
0
votes
1 answer

Encode/Decode a given string on a shared given (non standard) charset in a minimal byte array

I'm looking for a generic algorithm which encode / decode a given string on a defined chars set to / from a byte array. It must use minimal space. I started developping mine which is a kind of Base'n' to Base 2 algorithm, but I think something like…
Jeremy D
  • 465
  • 5
  • 21
0
votes
1 answer

How to compress / decompress string with using SevenZip - 7Zip

There is so poor documentation so i am struggling to make this run I added dll files and proper references Finally it compresses string but giving error when i de-compress Can you tell me error is where ? public static string…
Furkan Gözükara
  • 22,964
  • 77
  • 205
  • 342
0
votes
1 answer

Most effective way of compressing HTML source , saving at the database and fetching back

I am writing a crawler atm and i am saving crawled pages source data at the database as a nvarchar(max) As you can guess this is taking huge space so i believe it would be better apporach for me to compress HTML source at the C# - then save it at…
Furkan Gözükara
  • 22,964
  • 77
  • 205
  • 342
-3
votes
1 answer

How are LSTMs used for data compression?

The following link shows the best performing ML architectures for text compression of the dataset Text8. What does the output mean (BPC)? And, how can an LSTM compress data?
vc00174
  • 7
  • 3
-5
votes
1 answer

What compression is used in txt file

Hello what type of compression is used in this txt file https://mega.nz/#!AEgwXZ7L!6pJEhKvOUKnWzqfmewNMtxb0uOn_qK_CTmW6TB6z3B0 want to convert it but don't know how is compressed this
yobro
  • 1
1
2