从页面源 python regex 获取部分

Question

我正在尝试使用正则表达式从页面中提取特定部分，但它不起作用。

这是我要从页面中提取的部分：

"publishedTimeText":{"runs":[{"text":"1 day ago","navigationEndpoint":{"clickTrackingParams":"CLQBEPS8AiITCPGhkIPt094CFc8SKgodd30BJSibHA==","commandMetadata":{"webCommandMetadata":{"url":"/channel/UCqwUrj10mAEsqezcItqvwEw/community?lb=Ugy4VG4gQFILnreq-Bd4AaABCQ","webPageType":"WEB_PAGE_TYPE_BROWSE"}}

到目前为止，我已经尝试过了：

import requests
import re

r = requests.get('http://rophoto.es/kha.txt')


mystrx = re.search(r'^{"publishedTimeText":.*"WEB_PAGE_TYPE_BROWSE"}}', html_source)

但它对我没有用。

Answer 1

这段代码怎么样：

import requests
import re

regex = r"\"publishedTimeText\":.*?\"WEB_PAGE_TYPE_BROWSE\"}}"
r = requests.get('http://rophoto.es/kha.txt')
html_source = r.content.decode('utf-8')

mystrx = re.search(regex, html_source, re.MULTILINE)
print(mystrx.group(0))
# "publishedTimeText":{"runs":[{"text":"1 day ago","navigationEndpoint":{"clickTrackingParams":"CLQBEPS8AiITCPGhkIPt094CFc8SKgodd30BJSibHA==","commandMetadata":{"webCommandMetadata":{"url":"/channel/UCqwUrj10mAEsqezcItqvwEw/community?lb=Ugy4VG4gQFILnreq-Bd4AaABCQ","webPageType":"WEB_PAGE_TYPE_BROWSE"}}

regex101 的详细信息：https://regex101.com/r/WJ82Ky/1

通过此链接：https://youtube.com/channel/UCqwUrj10mAEsqezcItqvwEw/community 您需要：
– pip 安装硒
– pip install webdriver_manager
然后使用下面的代码，它在我的电脑上运行良好：

import re
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager

regex = r"\"publishedTimeText\":.*?\"WEB_PAGE_TYPE_BROWSE\"}}"

driver = webdriver.Chrome(ChromeDriverManager().install())
driver.get('https://youtube.com/channel/UCqwUrj10mAEsqezcItqvwEw/community')
html_source = driver.page_source
driver.quit()

mystrx = re.search(regex, html_source, re.MULTILINE)
print(mystrx.group(0))
# "publishedTimeText":{"runs":[{"text":"2 days ago","navigationEndpoint":{"clickTrackingParams":"CLQBEPS8AiITCKisjoWO1t4CFVwlKgodcY4PXiibHA==","commandMetadata":{"webCommandMetadata":{"url":"/channel/UCqwUrj10mAEsqezcItqvwEw/community?lb=Ugy4VG4gQFILnreq-Bd4AaABCQ","webPageType":"WEB_PAGE_TYPE_BROWSE"}}