Questions tagged [filesplitting]

87 questions
0
votes
2 answers

splitting one item in listBox into two Items

I have a problem with my code, I am supposed to import a list from a .txt file, each line in the txt file has two item, name and city for example Alex###London Justin###Texas I have a code that imports this list from the txt file into the listBox1…
Ali Nouri
  • 11
  • 1
0
votes
0 answers

Creating a loop to parse a csv file and convert a list into a 96 well plate map

I have a csv file I've gotten to look like this: Source_Well Source_Concentration Source_Concentration_units \ 0 A01 NaN NaN 1 A01 NaN NaN…
0
votes
0 answers

How to limit the size of generated ZIPs?

I'm using : ICSharpCode.SharpZipLib.Zip.FastZip z = new ICSharpCode.SharpZipLib.Zip.FastZip(); So i'm generating a zip regarding a folder. This folder contains several files. z.CreateEmptyDirectories = true; z.CreateZip("Temp.zip", directory, true,…
0
votes
1 answer

Split nested JSON File into two JSONs according to their ID?

I have nested JSON File which loaded as python dictionary called movies_data as follows: with open('project_folder/data_movie_absa.json') as infile: movies_data = json.load(infile) It has the following structure: { "review_1": {"tokens": ["Best",…
Ahmad
  • 332
  • 2
  • 13
0
votes
3 answers

How would you convert a large sdf file of chemical compounds into individual files containing molecular images?

A new deep-learning algorithm for drug-discovery based on images, requires splitting a file containing ~3000 chemical compounds in png files containing individual 2D 200 x 200 pixel images (.: SN00001400.png, SN00002805.png, SN00002441.png........).…
Julio Coll
  • 17
  • 1
  • 7
0
votes
1 answer

Splitting very large csv using chunks with conditions on the nth character of a string

I am trying to split a very large (22GB) CSV file, using both chunks and a condition on the nth character of a given column in my data. I have been trying quite helplessly to combine this: Python: Split CSV file according to first character of the…
0
votes
1 answer

Powershell Script to split one big file into multiple files with two pairs of a tag each in a file with a naming convention on filename

I am writing a Powershell script to split one big file into multiple files with two pairs of a tag each in a file and those small filenames must follow a naming convention. Example abcdef123.xml contents:
Amar Kumar
  • 11
  • 6
0
votes
1 answer

Error in splitting and writing txt files in R studio

I have this big file names Objects_Population - AllCells.txt that is ~3GB, the file has 25704373 rows and 132 variables. I want to read the file and split the rows based on one variable, which is the column named treatmentsum. In this column, I have…
ML33M
  • 341
  • 2
  • 19
0
votes
1 answer

ND-JSON Split in SFTP

I have a large ND-JSON file in SFTP (~20K lines). Is there a way to generate sub files out of this (~500 lines each) and place in another folder in SFTP? Does Mule 4 has the capability to split a large file and write in SFTP? Or is there a need for…
0
votes
2 answers

Split XML file by number of records/treshold and copy header - XSLT 1.0

I have the following XML structure 2011-01-16 06:00:33 DynamicExport 1.
Peter
  • 1,786
  • 4
  • 21
  • 40
0
votes
1 answer

How to split file with certain conditions for each end line of each file

I have a .txt file like this: 2019-03-29 12:03:07 line1 line2 line3 .... 2019-03-30 07:05:09 line1 line2 .... 2019-03-31 10:03:20 line1 …
elisa
  • 489
  • 5
  • 13
0
votes
2 answers

How to chunk a big file with certain size and condition

I have one large text file. I chunk that file into small files with a certain size. The following is an example I get: import math import os numThread = 4 inputData= 'dir\example.txt' def chunk_files(): nline = sum(1 for line in…
elisa
  • 489
  • 5
  • 13
0
votes
1 answer

Split XML file based on a tag using XSLT

I have a need to split an XML file based on a tag inside. Here is the input file will look like. The spli should happen based on Order tag
F khader
  • 45
  • 7
0
votes
0 answers

Reconstructing a chunked file in Node.js

I am working on a angularjs / nodejs (express) stack. In this project, I have to upload large binary file (~150mb) from the client to server. Due to a company proxy limitation, we have to chunk the files thanks to the ng-file-upload library. The…
0
votes
1 answer

Python Script to download large files in parts using curl

My Institute doesn't allow file downloads more than 300MB so I came up with this trick of downloading the files in parts! Now I wanted to ease the task and make a script in python! I'm using os.system() to execute commands! My plan is to use…