0

Does dask dataframe pass the error bad lines parameter to pandas DataFrame class? In other words, this does not seem to work because I get an error when I try to run groupby query.

df = dd.read_csv('s3://todel162xx/some.csv' , error_bad_lines=False, storage_options = {'anon':False})

There are only 1 or 2 lines in the csv file that may have different datatypes.

shantanuo
  • 31,689
  • 78
  • 245
  • 403

1 Answers1

0

Yes, dask.dataframe.read_csv passes through the error_bad_lines keyword argument

MRocklin
  • 55,641
  • 23
  • 163
  • 235