Questions tagged [filesplitting]

87 questions
0
votes
2 answers

Filesplitter using .php

i m designing a website where users upload file, but the free webhost provides us only 3mb per file limit, so can i design a filesplitter using .php which splits a file(>3mb) into 3mb chunks and then while downloading; it re-assembles file into 1…
0
votes
3 answers

How to map a set of text as a whole to a node?

Suppose I have a plain text file with the following data: DataSetOne
content
content
content
DataSetTwo
content
content
content
content
...and so on... What I want to to is: count how…
Terminal User
  • 873
  • 3
  • 13
  • 21
0
votes
1 answer

Split XML based on size using Java

I am trying to split an XML file using the following method, it created the first split file no problem but when i use output.clear(); to clear the Array of XMLEvents that already have been written it throws an error. error: Exception in thread…
0
votes
1 answer

Splitting Large XML FIles Java (StAX)

I am using this code https://github.com/koen-serneels/blog/tree/master/BigXmlTest/src/main/java/be/error/bigxmltest from GitHub to split large XML files(6GB).I am starting with the basic XML File provided to understand the program. The program…
0
votes
1 answer

Creating CombineFileSplit in Java of Hadoop?

CombineFileSplit has a constructor: CombineFileSplit(Path[] files, long[] start, long[] lengths, String[] locations) is it necessary for the locations array to be the same size as files array, because the file can reside in many locations/nodes?
Mosab Shaheen
  • 1,114
  • 10
  • 25
0
votes
2 answers

Large data table to multiple csv files of specific size in .net

I have one large data table of some millions records. I need to export that into multiple CSV files of specific size. So for example, I choose file size of 5MB and when I say export, The Datatable will get exported to 4 CSV files each of size 5MB…
Jay Nanavaty
  • 1,089
  • 1
  • 15
  • 29
0
votes
1 answer

Split a bulk pdf into smaller pdfs using a command?

I have a pdf of 470 pages and I want split that into smaller pdfs using a command in Linux. I have hundreds of such pdfs and I want to automate the process. Is there a way to do it.
dheeraj Vadlani
  • 377
  • 2
  • 13
0
votes
1 answer

PhpStorm virtual file splitting

I can't find a more appropriate. I'm using PhpStorm to create web content (php, html, css, js..) and I'm facing the problem of long files (not even so long few hundred lines enough to be lost) where it gets hard to find things and remove unnecessary…
fekiri malek
  • 354
  • 1
  • 3
  • 14
0
votes
0 answers

PySpark: read files without knowing the key of very single row

If you are reading files with Apache Spark (I'm using PySpark) one would expect a key in each row. For instance like this key1, timestamp1, value1 key2, timestamp2, value2 key1, timestamp3, value3 key1, timestamp4, value4 which is then reduced by…
Matthias
  • 5,574
  • 8
  • 61
  • 121
0
votes
2 answers

XML splitting of BIG file using Java

I'm trying to create a java program that will split the selected XML file. XML file data…
Grimmjow
  • 45
  • 10
0
votes
2 answers
0
votes
2 answers

Perl - Changing file name in the middle of write

I am trying to take a very large txt file (over a million lines) that I created in Perl and run it through a different statement in Perl that will essentially look something like this (note the following is shell) a=0 b=1 while read line; do …
Logan Smith
  • 139
  • 1
  • 8
0
votes
0 answers

How to efficiently handle huge JSON file, needs some ideas

It's a questions about the train of thought, so please don't let me to use a third-party library to deal this. Recently, I took a job interview, There's a questions like below: there is a huge JSON file, structure like a Database: { …
leo
  • 35
  • 1
  • 1
  • 7
0
votes
1 answer

Splitting file into parts by bits

Ok, so this is a unique question. We are getting files (daily) from a company. These files are downloaded from their servers to ours (SFTP). The company that we deal with deals with a third party provider that creates the files (and reduces their…
ctwheels
  • 21,901
  • 9
  • 42
  • 77
0
votes
2 answers

R - split file from gnuplot into 2 parts

I am trying to modify data which were originally used for gnuplot. Data looks like this: 1 2 3 4 5 6 7 8 9 10 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 1.10 1.11 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 2.9 2.10 2.11 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 3.10…
Wiolos
  • 1