scrapy misses xpaths where xpath contains cp1251

Question

Values response:

{
 'articul': [u'testetete'],
 'diametr': ['Empty'],
 'image': [u'/foto/11.20.jpg'],
 'name': [u'Трололололо'],
 'url': ['http://test.ru/goods/detali.html?product_id=20']
}

where other fields?

Answer 1

It's because add_xpath method gets XPath as argument only. If you need to add another one (such as "Масса" or "Состав") to value that spider takes from xpath, you can add it to pipelines.py , or to your another module, that takes results from Spider.