Stack Overflow
Stack Overflow

Questions tagged [file-processing]

333 questions
1
vote
2 answers

Reading Lines of Text from a File

I have a text file containing 5 customers (1 per line), Customer 1, Customer 2, Customer 3, Customer 4 and Customer 5. Using the following code, it reads the 5 lines of text perfectly; import java.io.*; public class CustomerIO { public void…
Frank
  • 33
  • 2
1
vote
3 answers

How to merge continuous lines of a csv file

I have a csv file that carries outputs of some processes over video frames. In the file, each line is either fire or none. Each line has startTime and endTime. Now I need to cluster and print only one instance out of continuous fires with their…
Tina J
  • 4,983
  • 13
  • 59
  • 125
1
vote
1 answer

Read Big File (over 60GB) and Write new File

There is one file that is 60GB in size and 200,000,000 rows . The payload of the file is shown below. source.txt 0.0 4.6 6.3 3.8 5.0 0.0 -3.8 -5.9 1.5 14.2 0.0 1.0 6.9 5.8 6.1 0.0 5.4 -7.1 0.9 6.8 0.0 -1.8 2.6 0.0 -11.5 -0.0 0.0 13.4 -1.8 5.2 2.4…
m2sj
  • 629
  • 1
  • 5
  • 7
1
vote
3 answers

What is an overhead for creating Java objects from lines of csv file

the code reads lines of CSV file like: Stream strings = Files.lines(Paths.get(filePath)) then it maps each line in the mapper: List tokens = line.split(","); return new UserModel(tokens.get(0), tokens.get(1), tokens.get(2),…
Alex Kamornikov
  • 278
  • 2
  • 10
1
vote
3 answers

Spring Batch file processing error, my ItemReader is not closed

I need to add a Spring Batch Job in my Spring Boot application, i need to downloads a list of file from a FTP and process them. They are CSV files. I have created a Job with only one Step (i will come back later on this point). In my step i have a…
Sagon nicolas
  • 198
  • 3
  • 23
1
vote
1 answer

Start file processing from line with certain string in Python

I am writing a Python (specifically 3.x) script to read names from a file and process them. Lets assume I have the following text in the file names.txt which looks something like this: Rebecca Rivera Ralph Turner Katherine Green Douglas…
KaanTheGuru
  • 373
  • 1
  • 2
  • 11
1
vote
1 answer

Keeping Track of Excel Files Which Have Already been Processed VBA

I have thousands of excel files in sub folders which I need to pull data from, and compile it all in a master sheet. The files typically come in day by day over several months. I have already built a macro which accomplishes all this. What I am…
RayArc
  • 15
  • 3
1
vote
1 answer

Batch processing for micro service - Spring service design?

I am curious to learn, Which design approach you would take in following scenario? I have a FTP server where my java spring app (Service 1) will go and fetch the file. I will then store that file on to a S3 bucket. this file may have up to a million…
Muks
  • 141
  • 2
  • 11
1
vote
1 answer

best way of reading large files spring boot

I'm using spring boot and angular to develop an app that tracks orders from log files (up to 1gb) I'm willing for your suggestions about the best solutions to read, processing and validating files in spring ,I have only thought about spring batch…
tero17
  • 1,570
  • 1
  • 11
  • 20
1
vote
0 answers

How can I export console on HTML page onto a text file?

For a HTML page we have produced with JavaScript, we would like to export the output on the console into a text file as it is updated so we can use in on a Java application. This has to be done automatically every time the console is updated, and…
Speek Sim
  • 11
  • 3
1
vote
3 answers

Storing and processing a lot of tiny files

There are a lot of files with size from 1Kb to 5Mb on our servers. Total size of those files is about 7Tb. Process algorithm - read and make some decisions about this file. Files may have several formats: doc, txt, png, bmp and etc. Therefore I…
Rustam Fatkullin
  • 49
  • 1
  • 10
1
vote
0 answers

File is being used by another process - Network Share

I have a VB.NET application that is attempting to use a file, but the code is throwing an error saying that the file is being used by another process. I do not need to know if the file is being used by another process because the error already…
Acavier
  • 79
  • 7
1
vote
0 answers

How to process excel with java excluding apache-poi, jexcel and xlsx4j libraries?

What I already did I've already checked How to read and write excel file in java and Java Library to read Microsoft Excel files but they are all about the above libraries. I have e java application for processing excel files. I implemented it with…
Gyunesh Shefkedov
  • 181
  • 4
  • 18
1
vote
0 answers

BeautifulSoup - Loop through Files in Directory, Clean, Save

I am pretty new to Python and this is the most complex loop I have written so far... yeah. Anyway, I have a batch of files in the same directory that I want to clean using BeautifulSoup and re-save. Here is the code I have written. It is running…
user7317101
1
vote
2 answers

How to get my python code to go back into the loop after the exception is thrown

I'm a beginner in python & am having some problems with the structure of my homework assignment; my assignment is: "Write a program that asks the user for a filename, opens the file and reads through the file just once before reporting back to the…
KindeR66
  • 37
  • 2
  • 3
  • 10
1 2 3
…
22 23