Stack Overflow
Stack Overflow

Questions tagged [filesplitting]

87 questions
2
votes
1 answer

How to create splits from a sequence file in Hadoop?

In Hadoop, I have a sequence file of 3GB size. I want to process it in parallel. Therefore, I am going to create 8 maptasks and hence 8 FileSplits. FileSplit class has constructors that require the: Path of the file Start position Length For…
Mosab Shaheen
  • 1,114
  • 10
  • 25
2
votes
1 answer

While splitting txt file through batch script Exclamations are ommitting

Iam new to batch script and here I tried to split my text file into chunks for each 1 million rows. Chunk files are generated as I expected, but inside the output file content Iam missing the Exclamations ( ! ) and even it skipping the immediate…
CIPHER
  • 237
  • 1
  • 4
  • 19
2
votes
1 answer

Splitting / chunking JSON files with JQ in Bash or Fish shell?

I have been using the wonderful JQ library to parse and extract JSON data to facilitate re-importing. I am able to extract a range easily enough, but am unsure as to how you could loop through in a script and detect the end of the file, preferably…
Chris Conover
  • 8,889
  • 5
  • 52
  • 68
2
votes
1 answer

Split audio file in android

I have an app that records audio using MediaRecorder from MIC whenever a phone call is present, i need to be able to save the last x minutes from this recording when the call is finished - e.g. split the audio file the recording created. I searched…
Tal Mantelmakher
  • 994
  • 1
  • 7
  • 23
2
votes
1 answer

Splitting a file in Java for Multithreading

For a project I am working on, I am trying to count the vowels in text file as fast as possible. In order to do so, I am trying a concurrent approach. I was wondering if it is possible to concurrently read a text file as a way to speed up the…
jstnchng
  • 2,161
  • 4
  • 18
  • 31
2
votes
1 answer

Split A large JSON into Smaller parts in Javascript/jQuery

I have a file upload functionality in my application which can not upload JSON files which are more than 10MB in size. If user uploads a file >= 10 MB , My app should split it into smaller JSON files each less than 10MB. Also, the Proper JSON…
A-D
  • 371
  • 1
  • 9
  • 24
2
votes
1 answer

Text file splitting in multiple files by content in Powershell

i'm reading a lot of threads - but nothing for me personal. I need to split text file in the following form: --------------------- Instance Type and Transmission -------------- ...text.. ...text.. --------------------------- Message…
Magsky
  • 27
  • 1
  • 5
2
votes
1 answer

How to check if zip file is split across multiple archives using python's zipfile lib?

According to the zip file standard: http://www.pkware.com/documents/casestudies/APPNOTE.TXT it also supports splitting a zip file across multiple files: Spanned/Split archives created using PKZIP for Windows (V2.50 or…
Eduard Florinescu
  • 16,747
  • 28
  • 113
  • 179
1
vote
0 answers

How to split a large file into small chunks (in Grails) so as to insert into a db as a BLOB

We are using Grails 2.0.1 I have a controller which reads a uploaded file from my GSP as inputstream , I want to split this file into chunks in the controller so as to be able to insert the file data in the form of BLOB type in my underlying DB.!…
user1307224
  • 11
  • 2
1
vote
1 answer

Folder path of select file in AppleScript

I'm creating simple script to convert mp3 files using shell script. I decided to automate my conversion using applescript. Basically what I'm doing is selecting mp3 file then splitting that file using my command line and i want to create a folder…
Maksim
  • 16,635
  • 27
  • 94
  • 135
1
vote
2 answers

How can I modify this Powershell Script?

I have a single text file that contains 60K+ lines in it. Those 60K+ lines are actually around 50 or so programs written in Natural. I need to break them apart into individual programs. I have a script that works perfectly with a single flaw. The…
user3166462
  • 171
  • 9
1
vote
0 answers

Python - Split a text file into multiple files with a character length limit

I am trying to split a large text file in PYTHON into multiple sub-files with the below conditions: Sub-files must have a character limit of 1024 characters Complete English sentences (i.e. fullstop to next fullstop) must be end up in the same…
Parsh
  • 347
  • 2
  • 8
1
vote
2 answers

Creating a multi-part archive to fit on floppy on Solaris 5.8

I am trying to use tar to split a single file in to parts small enough to fit on a 1.44MB floppy on Solaris 5.8. According to the references below, I should be able to achieve this by using the k option to specify the size of the segments, and the f…
toxicantidote
  • 168
  • 2
  • 10
1
vote
1 answer

Split csv file into specified number of files without page break

I have a 200,000 file to be split into 8 chunks using powershell The file has rows with the first value being the record 'KEY' I would like to ensure that rows corresponding to the key field value (which is the first value of the row) do not break…
TheKingsLanding
  • 11
  • 2
1
vote
2 answers

VBA: Splitting excel file up based on a category in the data

In essence we want to create a VBA code that automatically creates Workbooks for each type of store (a column/variable in our dataset). As an example, we have one source workbook with the following table: Store Seller Item Price A |…
Natalie de Vries
  • 11
  • 1
1
2
3 4 5 6