如何寻找正确的类和 id 来解析页面？

Question

这是我到目前为止的代码，我正在尝试获取订阅者数量。 这是我得到的错误：

AttributeError: 'NoneType' object has no attribute 'find_all'

希望有人能帮忙！

    from bs4 import BeautifulSoup
    import requests as r

    url = r.get("https://www.youtube.com/channel/UC57EgpLB1Q0tXc5tWDhttoQ)
    soup_content = BeautifulSoup(url.content, 'html.parser')
    id_ = soup_content.find(id="meta")
    class_ = id_.find_all(class_="style-scope ytd-c4-tabbed-header-renderer")
    hopefully_it_works = class_[0]
    print(hopefully_it_works.prettify())

Answer 1

BS 和网络抓取不是获取 youtube 数据的正确方法。 请考虑使用官方的 youtube api，它提供了您需要的这些数据以及更多:) https://developers.google.com/youtube/v3/docs/

你可以在这里https://developers.google.com/youtube/v3/docs/channels/list#try-it尝试你的请求

在您的情况下，您需要填写： 部分：统计 编号：UC57EgpLB1Q0tXc5tWDhttoQ (https://www.googleapis.com/youtube/v3/channelspart=statistics&id=channel_id&key=your_key)

回应是

{
  "kind": "youtube#channelListResponse",
  "etag": "eQRUDH-2j1eYIpexSuSOsz12tc8",
  "pageInfo": {
    "totalResults": 1,
    "resultsPerPage": 1
  },
  "items": [
    {
      "kind": "youtube#channel",
      "etag": "D-yZ896UMFRcDDSrfATBaiygDkc",
      "id": "UC57EgpLB1Q0tXc5tWDhttoQ",
      "statistics": {
        "viewCount": "9",
        "commentCount": "0",
        "subscriberCount": "3",
        "hiddenSubscriberCount": false,
        "videoCount": "1"
      }
    }
  ]
}

编辑： 如果你真的想使用 BS，有你的解决方案：

from bs4 import BeautifulSoup as bs
import requests as r

content = r.get("https://www.youtube.com/channel/UC57EgpLB1Q0tXc5tWDhttoQ")
soup = bs(content.content, "html.parser")
channel_subscribers = soup.find("span", attrs={"class": "channel-header-subscription-button-container yt-uix-button-subscription-container with-preferences"}).find("span", attrs={"class": "yt-subscription-button-subscriber-count-branded-horizontal subscribed yt-uix-tooltip"}).text
print(channel_subscribers)