bs4 loop stop on the Mid of the links 为什么？

Question

我有一个 python 脚本 bs4 scraper，它从我从文本文件中提供给它的 web 链接中抓取 mp4 播放器链接。循环正常运行，但在其中一个链接处停止。就像我在 6 个链接下面传递它一样，它们运行 3 个然后停止而没有任何错误。

这些是链接：link1、link2、link3、link4、link5、link6

这是我的代码：

from bs4 import BeautifulSoup
import requests

text_file = open(r"Python\Anime_Episodes_Links\Links2.txt","r",encoding="utf-8")


num_link = 1

for a in text_file:

    source = requests.get(text_file.readline())

    soup = BeautifulSoup(source.text, 'lxml')


    contener = soup.find('div', {'id': 'episode-watch-content'})

    server_links = contener.find('ul', {'id': 'episode-servers'})

    epi_link = server_links.find('a')['data-ep-url']

    print(str(num_link) + '-' + str(epi_link))
    num_link = num_link + 1


print('DONE')

需要帮助来了解我的代码中的问题所在，即它没有针对所有 6 个问题完成。

Answer 1

我稍微修改了你的代码，希望这是你想要的结果：

from bs4 import BeautifulSoup
import requests

text_file = open(r"a.txt", "r")

num_link = 1

for line in text_file.readlines():
   source = requests.get(line)
   soup = BeautifulSoup(source.text, 'lxml')
   contener = soup.find('div', {'id': 'episode-watch-content'})
   server_links = contener.find('ul', {'id': 'episode-servers'})
   epi_link = server_links.find('a')['data-ep-url']
   print(str(num_link) + ' - ' + str(epi_link))
   num_link = num_link + 1

print('DONE')

当我运行程序时，它设法打印了 6 个链接：

1 - https://moshahda.online/embed-fk3xtl0vsec3.html
2 - https://moshahda.online/embed-awer88vmgnx7.html
3 - https://moshahda.online/embed-50hnaf9p7qyq.html
4 - https://moshahda.online/embed-2gd52ruefqyt.html
5 - https://moshahda.online/embed-sz2mcl9r1nhz.html
6 - https://moshahda.online/embed-48u0cit7d0ef.html
DONE