proper implementation of pandas concat

Question

concat = pd.concat([data_1, data_2])

above code works on multiple CSVs but it duplicates the column tried reset_index and axis=0 but no good.

all CSVs have 21 columns but the code gives me 42 columns after concat

Any suggestions, ideas, comments are much appreciated.

Thanks

Are you wanting concatenate horizontally or vertically? What is this duplicated column? What does `data_1` and `data_2` look like? — Riley, Oct 27 '21 at 07:59
Does this answer your question? [Concatenate rows of two dataframes in pandas](https://stackoverflow.com/questions/28135436/concatenate-rows-of-two-dataframes-in-pandas) — kd88, Oct 27 '21 at 08:05
all CSVs have 21 columns but the code gives me 42 columns after concat — Panda, Oct 27 '21 at 08:30

Talal Siddiqui · Answer 1 · 2021-10-27T09:30:20.893

0

Have you tried using axis=1 . It will concatenate column wise.

concat = pd.concat([data_1, data_2], axis =1)

edited Oct 27 '21 at 09:30

answered Oct 27 '21 at 08:27

Talal Siddiqui

tried it, still no good. not sure why – Panda Oct 27 '21 at 08:33
Can you please share the code and dataset? – Talal Siddiqui Oct 27 '21 at 08:55
try this ` df = df.loc[:,~df.columns.duplicated()] ` It will remove duplicate columns – Talal Siddiqui Oct 27 '21 at 09:21
or if you have 2 csv files, you may also go for `concat = pd.merge(data_1, data_2, how='inner')' – Talal Siddiqui Oct 27 '21 at 09:26

score -2 · Answer 2 · answered Oct 27 '21 at 08:01

-2

Convert them to numpy array and then concat using hstack and vstack

answered Oct 27 '21 at 08:01

2 Answers2