Questions tagged [chunks]

A chunk is a fragment of information which is used in many multimedia formats

A chunk is a fragment of information which is used in many multimedia formats, such as PNG, IFF, MP3 and AVI.

Each chunk contains a header which indicates some parameters (e.g. the type of chunk, comments, size etc.) In the middle there is a variable area containing data which are decoded by the program from the parameters in the header. Chunks may also be fragments of information which are downloaded or managed by P2P programs. In distributed computing, a chunk is a set of data which are sent to a processor or one of the parts of a computer for processing. For example a sub-set of rows of a matrix.

901 questions
3
votes
1 answer

Timing R Chunk in R MarkDown/Notebook (Equivalent of %%timeit in python)

I am looking for an elegant way of timing execution of R chunk preferably running the chunk multiple times automatically in background. (Magic function %%timeit in Python notebook does exactly that) I know there are several ways of timing an R…
PagMax
  • 8,088
  • 8
  • 25
  • 40
3
votes
0 answers

Python: Chunked uploads via requests in one connection?

I'm expecting problems with using requests, i try to send huge file (1GB) via requests, but script that i'm using seems to sending data is trying to upload whole file at once. I tryed to implement 'chunks' but implementing it causes that script…
Marek Grzyb
  • 177
  • 13
3
votes
1 answer

R - read csv by chunks process them in parallel

How can I read a CSV file by chunks (its size is too large to read in once), and process all chunks using parallel package? Let's say I want to calculate the average of a column by chunks. Without parallel I would use something like…
ragesz
  • 9,009
  • 20
  • 71
  • 88
3
votes
4 answers

Python Flask chunk data upload not working

I am trying to upload a large file (say ~1GB) from client (using Python request.post) to the flask server. When client sends the request to server in chunks of 1024, server do not read the whole file and save to server 0kb. Can you please help me in…
Amit Baswa
  • 101
  • 2
  • 6
3
votes
1 answer

How to upload file to google storage in multiple chunks?

I am trying to upload file to google storage in multiple chunks but signed URL. Below are the steps I am following: Create Resumable Upload URL using Node.js. Sample URL:…
Suyog Kale
  • 373
  • 6
  • 17
3
votes
1 answer

Video encryption for offline playing In Android

I want to download mp4 video from server to my Android Device. I want this video to be stored in chunks(encrypted) and should combine in real time when video plays. How to start working on this.
Piyush Aggarwal
  • 215
  • 3
  • 12
3
votes
0 answers

How to upload a list of large files using django?

I know how to upload large files using the django-chunked-upload package. It's an elegant solution to upload one file using an tag. I haven't found anything allowing me to upload more than one file with this package. In my case,…
3
votes
0 answers

Change knitr chunk defaults outside documents

I teach a lab and I have my students write their answers in .Rmd files. For grading, I download and render them as pdfs in a batch. I use the following script to render everything and save in a file. library(rmarkdown) # Handy functions for…
cgmil
  • 410
  • 2
  • 18
3
votes
5 answers

Randomly dividing a list into chunks of two or three items

I am stuck on a problem involving splitting up a list into different sized chunks. I want to have a list that is randomly split into either pairs of 2 or 3. example: L = [1,1,1,1,1,1,1,1,1,1,1,1] and I want to get something out like: L2 =…
Maple123
  • 79
  • 5
3
votes
1 answer

What are valid chunks extensions?

RFC 7230 defines chunked encoding and states : The chunked encoding allows each chunk to include zero or more chunk extensions, immediately following the chunk-size, for the sake of supplying per-chunk metadata (such as a signature or…
Jeff Bencteux
  • 1,406
  • 16
  • 27
3
votes
0 answers

can't accept new chunks because there are still 1 deletes from previous migration

I have a mongodb production cluster running in 2.6.11 with 20 replicatSets. I getting space disk issue, because the chunks majority are store in one replicatSet. When I check the log, I can see that move chunk failed because of "deletes from…
3
votes
0 answers

Dynamically require one chunk per directory for on-demand (async) files in webpack?

Problem This is how the app behaves: every folder corresponds to a dynamic "feature" in the app. features are independent of each other. (Inside each folder, none of the files have dependencies on other folders. However, each folder may use the…
U Avalos
  • 6,538
  • 7
  • 48
  • 81
3
votes
1 answer

Pandas to_csv index=False not working when writing incremental chunks

I'm writing a fixed-width file to CSV. Because the file is too large to read at once, I'm reading the file in chunks of 100000 and appending to CSV. This is working fine, however it's adding an index to the rows despite having set index = False. How…
user3867061
  • 73
  • 2
  • 16
3
votes
2 answers

iOS video recording in chunks

Is it possible to clip video files while continuos recoding? What I am looking for is say I record a video, I want to send video clips to a server every 5 seconds until the recording is being stopped. For example a video file is recorded for 10…
MobileGuy
  • 39
  • 2
3
votes
2 answers

php array_chunk with balanced number of elements

I have a need to split an array into several chunks each of them with same number of elements (even repeated across different chunks) balanced across the output So, for example and starting from an array such this: $input =…
Stefano Radaelli
  • 1,088
  • 2
  • 15
  • 35