CSV Exports - Ordering of columns using scrapy crawl -o output.csv

Question

Is there a way to specify the order of the columns in a CSV output using the -o parameter?

It seems to follow a random order and does not follow the order in the items.py file or when the item fields get populated in the scrape.

Thanks!

score 10 · Accepted Answer · edited May 23 '17 at 11:33

10

There is a relevant field_to_export attribute in CsvItemExporter, but, as far as I understand, there is no way to set it from the command-line. You need to do it through the pipeline, see:

How can I use the fields_to_export attribute in BaseItemExporter to order my Scrapy CSV data?

edited May 23 '17 at 11:33

Community

1
1

answered Feb 06 '15 at 15:19

alecxe

462,703
120
1,088
1,195

score 8 · Answer 2 · edited Jul 30 '20 at 21:20

8

You can solve it from adding a line in settings.py

FEED_EXPORT_FIELDS = ['field1', 'field2', 'field3']

edited Jul 30 '20 at 21:20

ndrwnaguib

5,623
3
28
51

answered Jul 30 '20 at 20:12

Md. Sazol

81
1
3

tried adding it. Didn't work for me. – claws Aug 08 '22 at 13:08

CSV Exports - Ordering of columns using scrapy crawl -o output.csv

2 Answers2

Linked