【发布时间】:2014-02-26 19:16:08
【问题描述】:
这是我的主要蜘蛛 bathuni.py
from scrapy.spider import Spider
from scrapy.selector import Selector
from bathUni.items import BathuniItem
class bathuni(Spider):
name = "bathU"
allowed_domains = ["http://international.southwales.ac.uk/"]
start_urls= ["http://international.southwales.ac.uk/country/argentina/en/",
"http://international.southwales.ac.uk/country/france/en/",
"http://international.southwales.ac.uk/country/australia/en/"]
def parse(self, response):
sel = Selector(response)
sites = sel.xpath('//div[@class="factsheet"]/ul/li')
for site in sites:
country = site.xpath('text()').extract()
return country
我的 items.py 如下
from scrapy.item import Item, Field
class BathuniItem(Item):
Country = Field()
我用来输出到 csv 文件的命令是
scrapy crawl bathU -o countries.csv -t csv
我的输出文件总是空的。任何帮助,将不胜感激。谢谢。
【问题讨论】: