Concatenate result dataframe after multiprocessing

Question

I wrote multitprocessing program in python. For each process my program returns a dataframe. At the end I want to concatenate those dataframes into one dataframe. How can I do it?

Code example:

def main():
    with Pool() as pool:
        result_df = pool.starmap(search, zip(a, b))

if __name__ == '__main__':    
    # freeze_support()
    main()

does this answer to your question? https://stackoverflow.com/questions/44621116/combine-dataframes-returned-from-python-multiprocess-calling-function — dhananjay sawarkar, Aug 05 '21 at 07:06

score 0 · Accepted Answer · answered Aug 05 '21 at 08:08

0

Just use concat()

df = pd.concat(result_df)

answered Aug 05 '21 at 08:08

alec_djinn

10,104
8
46
71

Concatenate result dataframe after multiprocessing

1 Answers1