1. In memory management, chunking refers to strategies for improving performance by aggregating related memory-allocation requests. 2. In HTTP message transmission, it refers to a facility that allows inconveniently large messages to be broken into conveniently-sized smaller "chunks." 3. In parallel computing, it refers to the amount of data to assign to each task.
Questions tagged [chunking]
369 questions
6
votes
1 answer
Slow chunk response in Play 2.2
In my play-framework-based web application users can download all the rows of different database tables in csv or json format. Tables are relatively large (100k+ rows) and I am trying to stream back the result using chunking in Play 2.2.
However…
p00ya00
- 796
- 1
- 10
- 20
6
votes
0 answers
upload large video using chunks via http post
I want to upload a large video from iPhone to a web server. I tried with below code. It's working for small files but when I try to upload large file it gets crashed.
Code:
NSMutableURLRequest *request = [NSMutableURLRequest
…
Kirti Nikam
- 2,166
- 2
- 22
- 43
6
votes
1 answer
laziness does not work as expected
(defn seq-trial
[]
(map #(do (println "hello " %) (inc %)) (range 10)))
(take 3 (seq-trial))
The code snippt above when evaluated prints out the following -
(hello 0
hello 1
hello 2
hello 3
hello 4
hello 5
hello 6
hello 7
hello …
Pranav
- 3,340
- 8
- 35
- 48
6
votes
2 answers
Download file in chunks (Windows Phone)
In my application I can download some media files from web. Normally I used WebClient.OpenReadCompleted method to download, decrypt and save the file to IsolatedStorage. It worked well and looked like that:
private void…
Olter
- 1,129
- 1
- 21
- 40
6
votes
3 answers
python: is there a library function for chunking an input stream?
I want to chunk an input stream for batch processing. Given an input list or generator,
x_in = [1, 2, 3, 4, 5, 6 ...]
I want a function that will return chunks of that input. Say, if chunk_size=4, then,
x_chunked = [[1, 2, 3, 4], [5, 6, ...],…
gatoatigrado
- 16,580
- 18
- 81
- 143
6
votes
2 answers
Viewstate hidden field so big it makes everything crash
For some reason the viewstate of my application became gigantic (around 14 million characters). It adds around 1 minute of loading time. If the page finally loads (which is not often), the server crashes every time someone send a form because "Post…
marcgg
- 65,020
- 52
- 178
- 231
5
votes
1 answer
Controlling Webpack 3 Bundling / Chunking (in Ionic3)
I have a bunch of stuff in node_modules that, from what I can tell, all ends up in vendor.js when I build my Ionic3 project. For simplicity's sake, lets say I have the following folders in node_modules: abc, xyz, uvw, and qrs. Lets say further that…
vicatcu
- 5,407
- 7
- 41
- 65
5
votes
2 answers
ne_chunk without pos_tag in NLTK
I'm trying to chunk a sentence using ne_chunk and pos_tag in nltk.
from nltk import tag
from nltk.tag import pos_tag
from nltk.tree import Tree
from nltk.chunk import ne_chunk
sentence = "Michael and John is reading a booklet in a library of…
sang
- 375
- 2
- 8
- 23
5
votes
3 answers
Absolute position of leaves in NLTK tree
I am trying to find the span (start index, end index) of a noun phrase in a given sentence. The following is the code for extracting noun phrases
sent=nltk.word_tokenize(a)
sent_pos=nltk.pos_tag(sent)
grammar = r"""
NBAR:
…
Corleone
- 361
- 1
- 3
- 6
5
votes
1 answer
Are there any libraries or samples for non-duplex WCF chunking?
I'm looking for a way of implementing a file transfer service over HTTPS which uses chunking to cope with intermittent connectivity loss and to reduce the large timeouts required by using Streaming. Because the client may be behind firewalls, the…
Tom Robinson
- 8,348
- 9
- 58
- 102
5
votes
1 answer
CryptoJS SHA256 Large File Progressive Checksum
I am trying to use CryptoJS to get the checksum of large files( bigger than 500MB) so browser doesn't crash. I am already using a Web Worker with chunking. So, I am try to progressively use each chunk when I iterate through the chunks to update…
Claude
- 417
- 1
- 8
- 15
5
votes
3 answers
Semantic parsing with NLTK
I am trying to use NLTK for semantic parsing of spoken navigation commands such as
"go to San Francisco", "give me directions to 123 Main Street", etc.
This could be done with a fairly simple CFG grammar such as
S -> COMMAND LOCATION
COMMAND -> "go…
ilyaeck
- 51
- 1
- 2
5
votes
1 answer
Most memory efficient way to read chunk in a buffer in Python
I have a text file of lines (of several GB and ~ 12 millions of lines), where each line is a point x, y, z, + accessory info. I wish to read chunk-by-chunk the file, processing the point and split (following an spatial index based on the position of…
Gianni Spear
- 7,033
- 22
- 82
- 131
4
votes
1 answer
Unexpected behaviour when chunking with multiple netcdf files in xarray/dask
I'm working with a set of 468 netcdf files summing up to 12GB in total. Each file has only one global snapshot of a geophysical variable, i.e. for each file the data shape is (1, 1801, 3600) corresponding to dimensions ('time', 'latitude',…
susopeiz
- 673
- 1
- 9
- 11
4
votes
2 answers
What does this statement mean?
When reading the Improving .NET Application Performance and Scalability I have bumped into this under "Improving Managed Code Performance/Garbage Collector Guidlines:
Avoid preallocating and chunking memory.
But the book never goes into explaining…
dexter
- 7,063
- 9
- 54
- 71