Questions tagged [file-processing]
333 questions
0
votes
1 answer
Adding proxies to dictionary in python from .txt
The goal is to get my text file that contains 1 proxy per line, formatted as ip:port into a dictionary in my python script. Having a blast with python so far, but this issue is making me want to pull my hair out-- I've read many many questions but…

wannabee
- 3
- 1
0
votes
2 answers
System architecture - ETL
We are in the process of designing an ETL process, where we’ll be getting a daily account file (maybe half a million records, could grow) from client and we’ll be loading that file to our database.
Our current process splits the file into smaller…

Himan
- 379
- 1
- 7
0
votes
3 answers
How can I lock a file from within a Java application for all other processes on a operating system?
I have a file I need to read several times from. I have to open the InputStream to the same file in sequence. Now I wonder if that file can be locked for the whole os as long as a specific portion of the Java application is running?
I want to…

xetra11
- 7,671
- 14
- 84
- 159
0
votes
1 answer
Suggestions for faster file processing?
I have a cluster of 4 servers. A file consists of many logical documents. Each file is started as a workflow. So, in summary a workflow runs on the server for each physical input file which can contain as many as 3,00,000 logical documents. At any…

phoenix
- 3,531
- 9
- 30
- 31
0
votes
1 answer
How to use FileHelper library to get number of delimiters
Using the FileHelper Library Is there a way to get an exception if the record does not have expected number of delimiters in a line?
And another question is there is there a way to get an exception if a particular field for example Name is more…

Beenish Qasmi
- 13
- 2
0
votes
1 answer
How to sort DDL by name of the object
I want to sort the generated DDL of a database by name of the object. For example, I have the following DDL:
CREATE TABLE MyTable3 (
col1 integer,
col2 varchar(10)
);
CREATE TABLE MyTable1 (
col1 integer
);
CREATE TABLE MyTable2 (
col1…

AngocA
- 7,655
- 6
- 39
- 55
0
votes
0 answers
Find Lowest Character Using Binary Search Using C Language
Example TestData.txt
Aquos|5@10000
Chitato|10@9500
Chili|20@4000
Output I want(using Quick Sort) report (by subtotal):
A5-120-0|Aquos|5@10000=50000
C5-120-1|Chili|20@4000=80000
A7-504-0|Chitato|10@9500=95000
Total Price = 225000
[a] [b] - [c] -…

Edward Sulistijono
- 11
- 3
0
votes
2 answers
How do I write date, time, serial, part, etc... to csv file using Python?
The code works properly upto entering for loop and the date values is fetched. after that it returns an empty list of values for rest of the variables like time, ref1, seriel and all.
import pandas as pd
import re
# Create a Dataframe from…

Sharvaa
- 41
- 9
0
votes
1 answer
Why is cv2.imread() not storing the name of my image files?
I'm trying to write a script which will take all of the images in a given directory and format the size.
I have been able to import the files as a list using OS and split them using the loop. I've printed each file name and index successfully, but…

T. Keith
- 11
- 4
0
votes
4 answers
Read special line from txt file in j2me
I have a text file, for example : file.txt, I want to read a line, for example line 7, have any way to read directly line 7 without reading other lines? I want to save memory from this work.

DJafari
- 12,955
- 8
- 43
- 65
0
votes
1 answer
How to split the image in the chunks of 4MB and upload to server in android
I want to split the image in the chunks for 4mb each and then upload to server.How can I achieve this for sending an image in multipart.
I have tried some way but I am getting media not supported error.
FileInputStream fileInputStream =…

bmm
- 3
- 1
- 4
0
votes
1 answer
OpenCV: Is possible to open Compressed Video in Java?
I have compressed .avi format video. I want to get frames from Video using OpenCV.
public static void main(String[] args) {
System.loadLibrary(Core.NATIVE_LIBRARY_NAME);
String filePath = "C:\\Users\\P6090053.avi";
String output =…

Praveen Gopal
- 529
- 8
- 23
0
votes
1 answer
Printing to a file
I am trying to print even numbers from a input.txt file to a display.txt output file. Anytime I send the output to the output console as a test it works perfect. It shows the even numbers. Anytime I use print stream and send it to a file, it only…

mikegreene123
- 1
- 5
0
votes
2 answers
Use only a certain portion of file in every iteration
I am using an external API for Python (specifically 3.x) to get search results based on certain keywords located in a .txt file. However, due to a constraint as to how many keywords I can search for in every time interval (assume I need an hourly…

KaanTheGuru
- 373
- 1
- 2
- 11
0
votes
2 answers
How to write/append a result from program with existing file at other directory with same name?
I wanted to write a result getting from code, to same name existing file in other directory "/home/work/new_data/ " at first line. My file names are abc.1 to abc.1000
I tried as following but I didn't get output as expected, is it due to myfile…

Abhijeet
- 1
- 5