【发布时间】:2016-06-30 23:15:44
【问题描述】:
我正在尝试抓取来自亚马逊的所有评论。当我在下面运行我的代码时,它返回空列表而没有任何错误。我不知道为什么。你能帮帮我吗?
from __future__ import unicode_literals
import requests
from scrapy.selector import Selector
def fetch_page(url):
r = requests.get(url)
return r.text
def review_positive(url):
#html = fetch_page(url)
sel = Selector(text = url)
review = sel.css(' .a-section review').extract()
return review
print (review_positive('https://www.amazon.com/Apple-iPhone-Unlocked-GB-Packaging/product-reviews/B01DAJT1AW/ref=cm_cr_arp_d_viewpnt_lft?ie=UTF8&showViewpoints=1&sortBy=helpful&filterByStar=positive&pageNumber=1'))
【问题讨论】:
标签: python scrapy amazon screen-scraping review