Questions tagged [chunks]

A chunk is a fragment of information which is used in many multimedia formats

A chunk is a fragment of information which is used in many multimedia formats, such as PNG, IFF, MP3 and AVI.

Each chunk contains a header which indicates some parameters (e.g. the type of chunk, comments, size etc.) In the middle there is a variable area containing data which are decoded by the program from the parameters in the header. Chunks may also be fragments of information which are downloaded or managed by P2P programs. In distributed computing, a chunk is a set of data which are sent to a processor or one of the parts of a computer for processing. For example a sub-set of rows of a matrix.

901 questions
6
votes
1 answer

Webpack splitChunks plugin - why does setting a priority of a chunk make its initialisation asynchronous?

I have a problem understanding the behaviour of Webpack splitChunks plugin. What I'm working on is rewriting old scripts on existing site into components and using Webpack for bundling. The bundles are just JS, most is loaded at the end of the…
actimel
  • 442
  • 6
  • 22
6
votes
0 answers

Best practices to upload large files by chunks in Spring boot

I have A big file and i want to upload that in Server side. it's very important when occured any problem (like interrupting the internet or power cut ...) if i retry to upload, file uploaded from resume and doesn't need to send file from…
hamed
  • 114
  • 2
  • 2
  • 9
6
votes
2 answers

Fuzzy matching/chunking algorithm

Background: I have video clips and audio tracks that I want to sync with said videos. From the video clips, I'll extract a reference audio track. I also have another track that I want to synchronize with the reference track. The desync comes from…
Confluence
  • 1,331
  • 1
  • 10
  • 26
6
votes
3 answers

using a python generator to process large text files

I'm new to using generators and have read around a bit but need some help processing large text files in chunks. I know this topic has been covered but example code has very limited explanations making it difficult to modify the code if one doesn't…
user3062260
  • 1,584
  • 4
  • 25
  • 53
6
votes
2 answers

Download files by chunks in multiple threads in Go

I need to download files, chunk by chunk in multiple threads. For example, I have 1k files, each file ~100Mb-1Gb and I can download these files only by chunks 4096Kb(each http get request gives me only 4kb). It might be to long to download it in one…
Bobby
  • 83
  • 1
  • 5
6
votes
2 answers

Splitting Data into chunks in Swift 3

I need to send images read from the Photo Library over the wire - in chunks of 5MB. I read an image from the library using: PHImageManager.requestImageData(for:options:resultHandler:) and get a Data object. I would then like to efficiently split…
GK100
  • 3,664
  • 1
  • 26
  • 19
6
votes
1 answer

PHP: Split string into chunks of 8, how do I do this?

I have binary basically, say it's 300 in length. How would I split (much like using explode) it into 8 bit chunks? I look at chunk_split() but it only seems to have an 'end' parameter, not an option to put it into an array.. Or can it be socketed…
oni-kun
  • 1,775
  • 6
  • 17
  • 22
5
votes
2 answers

How to share singletons instances between chunks with webpack?

I'm having trouble with Webpack 4, trying to preload some data with an async chunk, then when data is loaded, append an other chunk computed with webpack to the dom. Both chunks use the same instance, a Singleton, once as a container while loading…
5
votes
3 answers

Partition a large file into small files in R

I need to break a large file (14 gigabytes) into smaller files. The format of this file is txt, the tab is ";" and I know it has 70 columns (string, double). I would like to read 1million and save them in different files, file1, file2 ...…
j_3265
  • 207
  • 3
  • 12
5
votes
1 answer

Count number of chunks

I'm reading in a large csv file using chuncksize (pandas DataFrame), like so reader = pd.read_csv('log_file.csv', low_memory = False, chunksize = 4e7) I know I could just calculate the number of chunks with which it reads in the file but I would…
theresemoreau
  • 109
  • 2
  • 8
5
votes
0 answers

Angular 4.3 HttpClient Chunked Uploads

I have to deal with huge file uploads (over 4GB). Currently I am using the new HttpClient. Is it possible to set a option for chunked uploads in the new HttpClient Module in Angular 4.3? I found a solution for Angularjs with the ng-file-upload…
smedasn
  • 1,249
  • 1
  • 13
  • 16
5
votes
3 answers

Chunk (cached) load error with angular 4

I have an angular 4 app with some lazy loading routes. The webapp is deployed on a wildfly server. Often when I update the package and try to use the app I get this 7.67f0bdb1c002c6632088.chunk.js Failed to load resource: the server responded with…
Fabrizio P
  • 241
  • 3
  • 13
5
votes
0 answers

curl set upload chunk size

I want to upload a big file with curl. For that, I want to split it, without saving it to disk (like with split). I tried to use --continue-at with Content-Length. curl -s \ --request PATCH \ --header "Content-Type:…
fentas
  • 1,011
  • 12
  • 14
5
votes
1 answer

Generate sourcemaps only for some chunks

I'm building my app using webpack. I generate 3 bundles: app.js, vendor.js and manifest.js. Since I have added UglifyJsPlugin to my conf, 3 sourcemaps are also generated. I'd like to only generate a sourcemap for my app.js bundle, since the others 2…
Nicolas SEPTIER
  • 671
  • 8
  • 20
5
votes
1 answer

Are cross-platform PNG-in-OTF fonts possible efficiently?

The most recent version of the Opentype font format (1.8 as of late 2016) standardizes two different tables to embed PNG bitmap data: Google’s CBDT (together with CBLC) and Apple’s sbix. Furthermore, the SVGs in Mozilla’s SVG  table can also embed…
Crissov
  • 947
  • 11
  • 16