Questions tagged [file-processing]

333 questions
0
votes
1 answer

Adding proxies to dictionary in python from .txt

The goal is to get my text file that contains 1 proxy per line, formatted as ip:port into a dictionary in my python script. Having a blast with python so far, but this issue is making me want to pull my hair out-- I've read many many questions but…
wannabee
  • 3
  • 1
0
votes
2 answers

System architecture - ETL

We are in the process of designing an ETL process, where we’ll be getting a daily account file (maybe half a million records, could grow) from client and we’ll be loading that file to our database. Our current process splits the file into smaller…
Himan
  • 379
  • 1
  • 7
0
votes
3 answers

How can I lock a file from within a Java application for all other processes on a operating system?

I have a file I need to read several times from. I have to open the InputStream to the same file in sequence. Now I wonder if that file can be locked for the whole os as long as a specific portion of the Java application is running? I want to…
xetra11
  • 7,671
  • 14
  • 84
  • 159
0
votes
1 answer

Suggestions for faster file processing?

I have a cluster of 4 servers. A file consists of many logical documents. Each file is started as a workflow. So, in summary a workflow runs on the server for each physical input file which can contain as many as 3,00,000 logical documents. At any…
phoenix
  • 3,531
  • 9
  • 30
  • 31
0
votes
1 answer

How to use FileHelper library to get number of delimiters

Using the FileHelper Library Is there a way to get an exception if the record does not have expected number of delimiters in a line? And another question is there is there a way to get an exception if a particular field for example Name is more…
0
votes
1 answer

How to sort DDL by name of the object

I want to sort the generated DDL of a database by name of the object. For example, I have the following DDL: CREATE TABLE MyTable3 ( col1 integer, col2 varchar(10) ); CREATE TABLE MyTable1 ( col1 integer ); CREATE TABLE MyTable2 ( col1…
AngocA
  • 7,655
  • 6
  • 39
  • 55
0
votes
0 answers

Find Lowest Character Using Binary Search Using C Language

Example TestData.txt Aquos|5@10000 Chitato|10@9500 Chili|20@4000 Output I want(using Quick Sort) report (by subtotal): A5-120-0|Aquos|5@10000=50000 C5-120-1|Chili|20@4000=80000 A7-504-0|Chitato|10@9500=95000 Total Price = 225000 [a] [b] - [c] -…
0
votes
2 answers

How do I write date, time, serial, part, etc... to csv file using Python?

The code works properly upto entering for loop and the date values is fetched. after that it returns an empty list of values for rest of the variables like time, ref1, seriel and all. import pandas as pd import re # Create a Dataframe from…
Sharvaa
  • 41
  • 9
0
votes
1 answer

Why is cv2.imread() not storing the name of my image files?

I'm trying to write a script which will take all of the images in a given directory and format the size. I have been able to import the files as a list using OS and split them using the loop. I've printed each file name and index successfully, but…
T. Keith
  • 11
  • 4
0
votes
4 answers

Read special line from txt file in j2me

I have a text file, for example : file.txt, I want to read a line, for example line 7, have any way to read directly line 7 without reading other lines? I want to save memory from this work.
DJafari
  • 12,955
  • 8
  • 43
  • 65
0
votes
1 answer

How to split the image in the chunks of 4MB and upload to server in android

I want to split the image in the chunks for 4mb each and then upload to server.How can I achieve this for sending an image in multipart. I have tried some way but I am getting media not supported error. FileInputStream fileInputStream =…
bmm
  • 3
  • 1
  • 4
0
votes
1 answer

OpenCV: Is possible to open Compressed Video in Java?

I have compressed .avi format video. I want to get frames from Video using OpenCV. public static void main(String[] args) { System.loadLibrary(Core.NATIVE_LIBRARY_NAME); String filePath = "C:\\Users\\P6090053.avi"; String output =…
Praveen Gopal
  • 529
  • 8
  • 23
0
votes
1 answer

Printing to a file

I am trying to print even numbers from a input.txt file to a display.txt output file. Anytime I send the output to the output console as a test it works perfect. It shows the even numbers. Anytime I use print stream and send it to a file, it only…
0
votes
2 answers

Use only a certain portion of file in every iteration

I am using an external API for Python (specifically 3.x) to get search results based on certain keywords located in a .txt file. However, due to a constraint as to how many keywords I can search for in every time interval (assume I need an hourly…
KaanTheGuru
  • 373
  • 1
  • 2
  • 11
0
votes
2 answers

How to write/append a result from program with existing file at other directory with same name?

I wanted to write a result getting from code, to same name existing file in other directory "/home/work/new_data/ " at first line. My file names are abc.1 to abc.1000 I tried as following but I didn't get output as expected, is it due to myfile…
Abhijeet
  • 1
  • 5