Stack Overflow
Stack Overflow

Questions tagged [file-processing]

333 questions
0
votes
1 answer

wso2 esb to download/get a local file

I have some static files (some are HTML, some are images and some are pure data files - like .csv or .xls etc) that I want to share through the ESB. I can make that happen if I run a separate HTTP server that will receive the request for these…
Sajumon Joseph
  • 31
  • 1
  • 5
0
votes
1 answer

Perl file processing on SHIFT_JIS encoded Japanese files

I have a set of SHIFT_JIS (Japanese) encoded csv file from Windows, which I am trying to process on a Linux server running Perl v5.10.1 using regular expressions to make string replacements. Here is my requirement: I want the Perl script’s regular…
frank
  • 1,283
  • 1
  • 19
  • 39
0
votes
2 answers

java program file re-processing upon temporary IO Exception

I am processing a large number of files, say 1000 files using a java program. Processing each file takes significant amount of time. Problem is : when I process a file, due to some unknown problem (may be antivirus or any other problem) the input…
peeyush
  • 2,841
  • 3
  • 24
  • 43
0
votes
1 answer

How to process file content in bash

I want to process PHP files on the content but i'm only interested in the parts between < ?php ... ?>. The rest should be removed and saved to a new file. Below I've already part of the code based on the code from this page multi line sed search.…
jjacobs
  • 57
  • 1
  • 5
0
votes
1 answer

what would happen to a file if writing on it failed?

Would the file still have its previous contents correctly? 1)When error happened by using file_put_contents func 2)When error happened by using copy func I'm asking because I want to implement semi-dynamic pages and I want to know if an error in…
MTVS
  • 2,046
  • 5
  • 26
  • 37
0
votes
1 answer

c# - Processing a Large File, Line by Line - Optimization

So I'm currently trying to research the best approach for dealing with processing a large file in c#. We currently have a large file with 10 million + lines of data. Originally, my client said the file would contain tens of thousands of lines so we…
Franco Trombetta
  • 207
  • 1
  • 5
  • 14
0
votes
2 answers

reading and filling separate variables from file

I am doing a homework assignment where we are to read company data from a file and then process it for errors. What I have so far I think will work with the first line, but I'm not sure how to make it read each line after. Each line is a record…
sircrisp
  • 1,037
  • 4
  • 17
  • 32
0
votes
3 answers

Loop to check existence of file and process it

I am starting the first part of a school assignment and I must prompt the user to enter a filename, check for the existence of the file, and if it exists, open it for processing; otherwise I am to have the user enter another filename. When I compile…
sircrisp
  • 1,037
  • 4
  • 17
  • 32
0
votes
2 answers

How Should I Move A File On Exception?

The requirement: On an error (thrown exception), the file being processed should be moved to the folder for files with errors (app.config setting). The problem: The only way that I can of handling this is to have a nested Try/Catch inside of the…
RiddlerDev
  • 7,370
  • 5
  • 46
  • 62
0
votes
1 answer

Node.js: Processing a stream without running out of memory

I'm trying to read a giant logfile (250,000 lines), parsing each line into a JSON object, and insert each JSON object to CouchDB for analytics. I'm trying to do this by creating a buffered stream that will process each chunk seperately, but I always…
user225643
  • 3,601
  • 5
  • 27
  • 22
0
votes
1 answer

Protecting files and directories on the web

Mostly we upload things by an upload field in the HTML and uploads the file in a directory on the application root or elsewhere and stores the path in a database. If the file is to be uploaded for specific users then the user can download from…
Gunah Gaar
  • 525
  • 2
  • 10
  • 28
0
votes
1 answer

Loadbalance the thread in java on the basis of file size

Hi i have requirement to process large number of files via multithreading in java. The files will be of random size (min:100 MB , max :1.5GB).The configuration is i can only create 8 thread at the max and each thread will be allocated 8 files for…
prabhakar
  • 55
  • 1
  • 6
0
votes
1 answer

Parse a large file of non-schematized json using Jackson?

I have a very large .json file on disk. I want to instantiate this as a Java object using the Jackson parser. The file looks like this: [ { "prop1": "some_value", "prop2": "some_other_value", "something_random": [ // ... arbitrary…
i_am_jorf
  • 53,608
  • 15
  • 131
  • 222
0
votes
1 answer

Best way to process thousand of files for hundreds of users from Dropbox

On a PHP based website, users will give permission to a Dropbox app to use their Dropbox folder, then the user put thousands of text files in this folder, maybe at once, maybe continuously, which I need to process, save to database and show the…
kissgyorgy
  • 2,947
  • 2
  • 32
  • 54
-1
votes
2 answers

How to convert an mp3 file to raw audio format using javascript

I'm working on a project that involves song matching, so I am integrating with rapidApi's shazam endpoints. But the thing is, the song matching endpoint needs the audio snippet to be a base64 string of the audio in raw audio format. I know the API…
Lord Bee
  • 132
  • 6
1 2 3
…
22 23