pandas read_csv: The error_bad_lines argument has been deprecated and will be removed in a future version

Question

I am trying to read some data which may sometimes have erroneous and bad rows, so as always I passed error_bad_lines=False but the console keeps throwing the deprecation warning on every run. Why is this feature deprecated and is there any other alternative for skipping bad lines?

Which function do you use? `read_csv`? – Corralien Oct 10 '21 at 09:32 — Corralien, Oct 10 '21 at 09:32
Yes, sorry forgot to mention that. – Atharva Katre Oct 10 '21 at 11:13 — Atharva Katre, Oct 10 '21 at 11:13

score 36 · Accepted Answer · edited Jun 03 '22 at 15:36

36

Read the documentation:

Deprecated since version 1.3.0: The on_bad_lines parameter should be used instead to specify behavior upon encountering a bad line instead.

So, replace:

df = pd.read_csv(..., error_bad_lines=False)

with:

df = pd.read_csv(..., on_bad_lines='skip')

edited Jun 03 '22 at 15:36

Sunderam Dubey

1
11
20
40

answered Oct 10 '21 at 09:35

Corralien

109,409
8
28
52

Thanks for the answer. Just to make it even more clear, if you use `error_bad_lines` and `warn_bad_lines`, both should be replaced by `on_bad_lines`. – ruhanbidart Jul 08 '22 at 18:58
2

@ruhanbidart. Right you can replace `error_bad_lines=True` by `on_bad_lines='error'` and `warn_bad_lines=True` by `on_bad_lines='warn'` – Corralien Jul 08 '22 at 21:49
1

Thanx for this excellent punchline ;-) – Laurent B. Feb 07 '23 at 00:26

pandas read_csv: The error_bad_lines argument has been deprecated and will be removed in a future version

1 Answers1

Linked