无法使用 selenium python 定位元素

Question

对不起，如果我的问题格式错误，因为我是编程和 StackOverFlow 的新手。我无法使用类或任何其他方法找到下载按钮。目前正在尝试使用 xpath 解决，但我听说 xpath 不是可靠的方法。我正在尝试抓取 wikiloc 站点以下载特定位置内的所有轨道路径。登录的问题可能是我在抓取时可能没有登录。顺便说一句，我主要使用谷歌 colab。我的代码如下：

driver.get('https://www.wikiloc.com/wikiloc/start.do')
driver.find_element_by_name('email').send_keys('testacount852')
driver.find_element_by_name('password').send_keys('49Vchu4njDrrT7.')
driver.find_element_by_id('submit-button').click()
time.sleep(10)
driver.get("https://www.wikiloc.com/trails/outdoor/france/brittany")
links = []
temp_links = []
names = []
temp_names = []
for _ in range(4):
  temp = driver.find_elements_by_css_selector('a.trail-title.dont-break-out')
  temp_links = [x.get_attribute('href') for x in temp]
  temp_names = [x.text for x in temp]
  links = links+temp_links
  names = names+temp_names
  try:
    driver.find_element_by_class_name('next').click()
    time.sleep(2)
  except:
    break
for link in links:
  driver.get(link)
  driver.find_element_by_id('download-button').click()
  time.sleep(4)
  driver.find_element_by_class_name('active').click()
  time.sleep(4)
  driver.find_element_by_xpath("/html/body/main/div/div[2]/div/div[1]/div/div[2]/div/div[2]/form/div[2]/input").click()
  time.sleep(4)

df['Names'] = pd.Series(names)
df['Links'] = pd.Series(links)
df.to_csv('test1.csv')
driver.close()

这是我的凭据的链接 [1]：https://i.stack.imgur.com/HZ6bZ.png

Answer 1

在 youtube 上有一个非常好的教程（这个人教使用这个非常有趣的 cookie clicker 游戏）；它具有 try/except 我在下面这是我访问硒项目的 goto。我能够使用下面显示的代码使其工作，希望这会有所帮助...

from selenium import webdriver
from time import sleep
import time
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC


driver = webdriver.Chrome()

driver.get('https://www.wikiloc.com/wikiloc/start.do')
driver.find_element_by_name('email').send_keys('testacount852')
driver.find_element_by_name('password').send_keys('49Vchu4njDrrT7.')
driver.find_element_by_id('submit-button').click()
time.sleep(10)
driver.get("https://www.wikiloc.com/trails/outdoor/france/brittany")
links = []
temp_links = []
names = []
temp_names = []
for _ in range(4):
  temp = driver.find_elements_by_css_selector('a.trail-title.dont-break-out')
  temp_links = [x.get_attribute('href') for x in temp]
  temp_names = [x.text for x in temp]
  links = links+temp_links
  names = names+temp_names
  try:
    driver.find_element_by_class_name('next').click()
    time.sleep(2)
  except:
    break
for link in links:
    driver.get(link)
    try:
        downloadbutton = WebDriverWait(driver,15).until(EC.presence_of_element_located((By.CSS_SELECTOR,"#download-button")))
        downloadbutton.click()
    except:
        print("Couldn't find the download button")
        pass
    time.sleep(4)
    driver.find_element_by_class_name('active').click()
    time.sleep(4)
    driver.find_element_by_xpath("/html/body/main/div/div[2]/div/div[1]/div/div[2]/div/div[2]/form/div[2]/input").click()
    time.sleep(4)

df['Names'] = pd.Series(names)
df['Links'] = pd.Series(links)
df.to_csv('test1.csv')
driver.close()

Answer 2

好的，我发现了问题。是验证码打破了它。我无法登录，并且在我登录之前下载按钮 (xpath) 将不可用。感谢大家特别帮助我@ShawnRamirez 指出验证码。

Answer 3

2 个问题：

1. 点击下载按钮后，没有类名为'active'的webelement？

2. 你想通过这个 xpath 找到什么以及在哪个页面 '/html/body/main/div/div[2]/div/div[1]/div/div[2]/div/div[2 ]/form/div[2]/输入'? ==========================================

更新：

driver.find_element_by_xpath(".//li/a[text() ='File']").click()
driver.find_element_by_xpath(".//input[@id='btn-download-file']").click()

Answer 4

我使用 cookie 而不是提供凭据绕过了登录问题：

所以而不是提供

driver.find_element_by_name('email').send_keys('testacount852')
driver.find_element_by_name('password').send_keys('49Vchu4njDrrT7.')
driver.find_element_by_id('submit-button').click()

我绕过登录：

driver.get('https://www.wikiloc.com/wikiloc/start.do')
driver.add_cookie({"name": "SESSION", "value": "##############"})

driver.add_cookie({"name": "wluseruuid", "value": "****************"})
driver.add_cookie({"name": "_wlutm", "value": "********************"})
driver.add_cookie({"name": "wikiloc_cookie_consent", "value": "**********"})
driver.add_cookie({"name": "JforumSSO", "value": "************"})