【发布时间】:2021-01-06 17:19:55
【问题描述】:
我正在尝试使用 selenium 抓取动态 website,但无法使用 selenium 获取网站内容。
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from webdriver_manager.chrome import ChromeDriverManager
driver = webdriver.Chrome(ChromeDriverManager().install())
from bs4 import BeautifulSoup
import time
url = 'https://www.aodour.pk/brand/hemani'
driver.get(url)
time.sleep(30) #for loading the page properly
html_js = driver.page_source
#driver.find_element_by_tag_name('body').send_keys(Keys.ESCAPE)
#I tried to skip the AD but didn't know why not it skip the AD
driver.get(url) #try to reload the page again (for skipped the Ad)
time.sleep(30)
soup = BeautifulSoup(html_js,'html.parser')
我有两个问题。
-
为什么我没有得到页面内容?
-
为什么 ESCAPE 键不适合我?
【问题讨论】:
标签: python selenium selenium-webdriver web-scraping webdriverwait