遍历 URL 时 URL 不更新

Question

以下代码执行以下操作：

1 打开一个特定的 URL（对于第一个日期 YYYY-MM-DD）；

2 getURL() 生成所有日期在特定日期范围内的所有 URL（从第二天开始）；

3 打开新标签页，其中第一个日期由 getURL() 生成；

4 返回上一个标签并关闭它；

5 重复步骤 3 和 4。

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
import time
from datetime import datetime, timedelta

# Load Chrome driver and movement.uber.com/cities website
PATH = 'C:\Program Files (x86)\chromedriver.exe'
driver = webdriver.Chrome(PATH)


# Attributing the city name and the center-most zone code (or origin) to variables so they can be inserted in the URL later
city = 'atlanta'
origin_code = '1074'
coordinates = '&lat.=33.7489&lng.=-84.4234622&z.=12'


# Open URL for the first day in the desired city (change coordinates depending on city)
driver.get('https://movement.uber.com/explore/' + city + '/travel-times/query?si' + origin_code + '&ti=&ag=taz&dt[tpb]=ALL_DAY&dt[wd;]=1,2,3,4,5,6,7&dt[dr][sd]=' + 
           '2016-01-02' + '&dt[dr][ed]=' + '2016-01-02' + '&cd=&sa;=&sdn=' + coordinates + '&lang=en-US')


# Generating the correct URLs for each date
def getURL():
    date = datetime(2016,1,4)
    while date <= datetime(2020,3,31):
        yield ('https://movement.uber.com/explore/' + city + '/travel-times/query?si' + origin_code + '&ti=&ag=taz&dt[tpb]=ALL_DAY&dt[wd;]=1,2,3,4,5,6,7&dt[dr][sd]=' +
               date.strftime('%Y-%m-%d') + '&dt[dr][ed]=' + date.strftime('%Y-%m-%d') + '&cd=&sa;=&sdn=&lat.=33.7489&lng.=-84.4234622&z.=12&lang=en-US')
        date += timedelta(days=1)

# Open new tab
i = 0
for url in getURL():
    i += 1
    if i < 3:
        driver.execute_script("window.open(url)")

        # Switch to previous tab and close it (leaving us with the newly above opened tab)
        tabs = driver.window_handles

        if len(tabs) > 1:
            driver.switch_to.window(tabs[0])
            driver.close()
            driver.switch_to.window(tabs[1])

问题：每次打开新标签/“窗口”时，代码都会打开第一个日期为 YYYY-MM-DD 的 URL，完全忽略了 getURL() 生成的 URL。

问题：如何打开下一个日期的新标签，关闭前一个，重复？

我的最终目标：下载每个不同 URL 内的数据集（但其代码与这里的问题无关）。 Obs.：我为此使用 Selenium 库。

Answer 1

错误在于您启动标签的方式。

当我改变 FROM 时：

driver.execute_script("window.open(url)")

到：

driver.execute_script("window.open('"+url+"','_blank')")

脚本在我的机器上完美执行。

看起来你的方法中的url 没有在迭代中更新。如果你把它变成for循环的一个参数，它每次都会被解析。

查看here 以获取有关如何打开窗口的 javascript 的更多信息（仅供参考 - 您也可以使用 _self 而不是 _blank 来替换当前窗口 - 这可能会减轻您对标签管理的需求） .

我的测试结果...

这是第一次迭代：

这是第二次迭代：

---

供参考这是我运行的整个脚本：（请注意，我更新了i 以进行更多迭代，我的机器的chromedriver PATH + 添加了几个prints）

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
import time
from datetime import datetime, timedelta

# Load Chrome driver and movement.uber.com/cities website
#PATH = ''# - mine lives local -> 'C:\Program Files (x86)\chromedriver.exe'
#driver = webdriver.Chrome(PATH)
driver = webdriver.Chrome()

# Attributing the city name and the center-most zone code (or origin) to variables so they can be inserted in the URL later
city = 'atlanta'
origin_code = '1074'
coordinates = '&lat.=33.7489&lng.=-84.4234622&z.=12'


# Open URL for the first day in the desired city (change coordinates depending on city)
driver.get('https://movement.uber.com/explore/' + city + '/travel-times/query?si' + origin_code + '&ti=&ag=taz&dt[tpb]=ALL_DAY&dt[wd;]=1,2,3,4,5,6,7&dt[dr][sd]=' + 
           '2016-01-02' + '&dt[dr][ed]=' + '2016-01-02' + '&cd=&sa;=&sdn=' + coordinates + '&lang=en-US')


# Generating the correct URLs for each date
def getURL():
    date = datetime(2016,1,4)
    while date <= datetime(2020,3,31):
        yield ('https://movement.uber.com/explore/' + city + '/travel-times/query?si' + origin_code + '&ti=&ag=taz&dt[tpb]=ALL_DAY&dt[wd;]=1,2,3,4,5,6,7&dt[dr][sd]=' +
               date.strftime('%Y-%m-%d') + '&dt[dr][ed]=' + date.strftime('%Y-%m-%d') + '&cd=&sa;=&sdn=&lat.=33.7489&lng.=-84.4234622&z.=12&lang=en-US')
        date += timedelta(days=1)

# Open new tab
i = 0
print("urls: %i", len(list(getURL())))
for url in getURL():
    i += 1
    if i < 10:
        driver.execute_script("window.open('"+url+"','_blank')")
        print (url)
        # Switch to previous tab and close it (leaving us with the newly above opened tab)
        tabs = driver.window_handles

        if len(tabs) > 1:
            driver.switch_to.window(tabs[0])
            driver.close()
            driver.switch_to.window(tabs[1])

Answer 2

您也许可以尝试将您创建的所有网址放在一个列表中，然后返回它 像这样：

def getURL():
    tab = []
    date = datetime(2016,1,4)
    while date <= datetime(2020,3,31):
        url ='https://movement.uber.com/explore/' + city + '/travel-times/query?si' + origin_code + '&ti=&ag=taz&dt[tpb]=ALL_DAY&dt[wd;]=1,2,3,4,5,6,7&dt[dr][sd]=' +
               date.strftime('%Y-%m-%d') + '&dt[dr][ed]=' + date.strftime('%Y-%m-%d') + '&cd=&sa;=&sdn=&lat.=33.7489&lng.=-84.4234622&z.=12&lang=en-US'
        tab.append(url)
        date += timedelta(days=1)
    return tab