Scrapy抓取數(shù)據(jù)輸出到CSV文件，不是按照items.py中定義的字段的順序琼掠。
from scrapy import Field,Item
class JsuserItem(Item):
author = Field()
url = Field()
title = Field()
reads = Field()
comments = Field()
likes = Field()
rewards = Field()
QQ20160728-1.png
如何在輸出CSV文件時拒垃，按指定的順序輸出呢？
1）在spiders中增加文件csv_item_exporter.py
from scrapy.conf import settings
from scrapy.contrib.exporter import CsvItemExporter
class MyProjectCsvItemExporter(CsvItemExporter):
def __init__(self, *args, **kwargs):
delimiter = settings.get('CSV_DELIMITER', ',')
kwargs['delimiter'] = delimiter
fields_to_export = settings.get('FIELDS_TO_EXPORT', [])
if fields_to_export :
kwargs['fields_to_export'] = fields_to_export
super(MyProjectCsvItemExporter, self).__init__(*args, **kwargs)
2）settings.py中
FEED_EXPORTERS = {
'csv': 'jsuser.spiders.csv_item_exporter.MyProjectCsvItemExporter',
} #jsuser為工程名
FIELDS_TO_EXPORT = [
'author',
'title',
'url',
'reads',
'comments',
'likes',
'rewards'
]
再次爬取數(shù)據(jù)時瓷蛙，就會按照指定的列順序來輸出了悼瓮。
QQ20160728-0.png
還可以在settings.py中指定csv文件中的分隔符
CSV_DELIMITER = "\t"
