Read single varible from txt file each time processing multiple files using pandas and python

Question

I stored a calculated variable in another file let's say A.txt as follows:

I want to use single variable each time from file A.txt (sequentially) when each acb.* read by pandas, processing acb.* multiples files that I was doing as follows using pandas: (how do I read acb.* file in numeric order like 1 then 2 and so on?)

  import pandas as pd
  import numpy as np
  import glob
  for filename in sorted(glob.glob('acb.*')): 
  with open(filename) as f:
    df = pd.read_table(f, sep=" ", skiprows=2)

How to combine this two task simultaneously? I know we can read two files at single time in pandas but how do I use single variable from file A.txt each time when I read a acb.* file sequentially?

"How to combine this two task simultaneously?" what two tasks? Your question is completely unclear, at least to me. — roganjosh, Dec 21 '18 at 21:30
not really, I will be procesing acb.* files (sequentially) and for that I need to use a data from A.txt file line by line. So it like use 123 for acb.1 and 1123 for acb.2 .. — Abhijeet, Dec 21 '18 at 21:30
How you want to incorporate the data from A.txt into the dataframe? — Vaishali, Dec 21 '18 at 21:39
I need those data for performing some data processing on acb files — Abhijeet, Dec 21 '18 at 21:55

score 0 · Answer 1 · answered Dec 21 '18 at 23:01

not sure if i understood your question fully but you can read the data into pandas df, and then looping through each row while looping through each line of the abc file:

import pandas as pd
import numpy as np
import glob

df = pd.read_table(f, sep=" ", skiprows=2)

for filename in sorted(glob.glob('acb.*')): 
    with open(filename) as f:
       for row in df.itertuples():
       print(row.column1)
       print(row.Index)
       #do tasks

Read single varible from txt file each time processing multiple files using pandas and python

1 Answers1