【发布时间】:2019-06-12 15:04:34
【问题描述】:
我的本地机器上没有问题。 但是当我将它部署在云服务器中时,特别是在 Scrapinghub 我需要添加 geckodriver
如何在我的 requirements.txt 中包含 geckodriver?
这是我的工作代码
from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
from selenium.webdriver.firefox.firefox_binary import FirefoxBinary
def parse_subpage(self, response):
profile = webdriver.FirefoxProfile()
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.http",
"localhost")
profile.set_preference("network.proxy.http_port",
3128)
profile.update_preferences()
capabilities = webdriver.DesiredCapabilities().FIREFOX
capabilities["marionette"] = True
driver = webdriver.Firefox(capabilities=capabilities,
firefox_profile=profile)
driver.get('sample.com')
driver.quit()
我的 Requirement.txt
mysql-connector-python
pytz==2018.9
selenium==3.13.0
geckodriver==0.24.0
观察到错误:
ERROR: Could not find a version that satisfies the requirement geckodriver==0.24.0 (from -r /app/requirements.txt (line 4)) (from versions: none)
【问题讨论】:
标签: selenium firefox scrapy geckodriver selenium-firefoxdriver