【发布时间】:2018-08-18 09:33:58
【问题描述】:
我正在尝试使用 scrapy 从本地 http 服务器抓取一个 html 文件,但出现此错误
AttributeError: 'unicode' 对象没有属性 'css'
这里是代码
import scrapy
from ..items import YpauItem
class ypau(scrapy.Spider):
name = 'ypau'
#allowed_domains = ['http://localhost']
start_urls = ['http://localhost/']
def parse(self, response):
selector = response.css('a::attr(href)').extract()
for url in selector:
urls = scrapy.Request(response.urljoin(url), callback=self.parsePage)
yield urls
print urls
def parsePage(self, response):
container = response.css('.listing.listing-search.listing-data').extract()
for items in container:
bname = items.css('listing-name::text').extract()
item = YpauItem()
item['Business_Name'] = bname
yield item
【问题讨论】:
标签: python web-scraping scrapy web-crawler