【发布时间】:2016-06-21 07:39:05
【问题描述】:
我使用 Selenium-python 抓取 this page 并点击分页号。
我试试这个:
driver = webdriver.Chrome()
time.sleep(5)
driver.get(
'http://www.ooshop.com/courses-en-ligne/ContentNavigation.aspx?TO_NOEUD_IDMO=N000000013081&FROM_NOEUD_IDMO=N000000013056&TO_NOEUD_IDFO=81018&NOEUD_NIVEAU=2&UNIVERS_INDEX=2')
nbdespages = 23
for i in xrange(2,nbdespages):
time.sleep(10)
number = str(i)
if(i<10):
cssSelec = 'ctl00_cphC_pn3T1_ctl01_rptPaginationB_ctl0%s_lbPage' %number
else:
cssSelec = 'ctl00_cphC_pn3T1_ctl01_rptPaginationB_ctl%s_lbPage' %number
try:
driver.execute_script("window.scrollTo(0, document.body.scrollHeight);")
element = WebDriverWait(driver, 30).until(EC.presence_of_element_located((By.CSS_SELECTOR, cssSelec)))
driver.execute_script("arguments[0].click()", element)
driver.find_element_by_css_selector(cssSelec).click()
finally:
driver.save_screenshot('/Users/Parik/Desktop/test.jpg')
print "TRY Again, you will find"
但我得到了这个例外:
TimeoutException: Message:
我使用 WebDriverWait 因为有时如果我不使用它会出现此错误,我会阅读 this question 并将其用于我的问题:
Element is not clickable at point
css选择器的值是正确的
POST http://127.0.0.1:51099/session/ddf78c5a19e720909cbe6a0f5408788e/element {"using": "css selector", "sessionId": "ddf78c5a19e720909cbe6a0f5408788e", "value": "ctl00_cphC_pn3T1_ctl01_rptPaginationB_ctl02_lbPage"}
UPADTE1
更新 2
通过屏幕截图,我看到我看不到数字,我将代码更改为:
try:
element = driver.find_element_by_css_selector('img#ctl00_cphC_pn3T1_ctl01_rp_ctl15_ctl00_iVisu.image')
driver.execute_script("return arguments[0].scrollIntoView();", element)
driver.execute_script("arguments[0].click()", element)
driver.find_element_by_css_selector(cssSelec).click()
finally:
driver.save_screenshot('/Users/Parik/Desktop/test.jpg')
print "TRY Again, you will find"
但我总是有这个例外:
NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":"ctl00_cphC_pn3T1_ctl01_rptPaginationB_ctl02_lbPage"}
(Session info: chrome=51.0.2704.103)
(Driver info: chromedriver=2.21.371459 (36d3d07f660ff2bc1bf28a75d1cdabed0983e7c4),platform=Mac OS X 10.11.5 x86_64)
【问题讨论】:
-
我认为首先你需要向下滚动以使分页数可见。这样做,让我知道会发生什么……如果可以,我会将其转换为答案。
-
您需要执行
javascript来执行像这样的点击driver.execute_script("arguments[0].click();",element)....希望它会起作用.. -
@noor 我更新了我的代码,但我遇到了同样的问题
-
@SaurabhGaur 我添加了滚动,但没有帮助
-
@parik..ok 忘记一切...就像这样使用
try:driver.execute_script("document.getElementById(arguments[0]).click();", cssSelec)..
标签: python selenium selenium-webdriver web-scraping selenium-chromedriver