在 <p> 标签之间提取一段文本[重复]

Question

我有一些示例 html，我正在尝试从中解析和提取数据。这是数据的样子：

<div class="content">
<h1 class = “heading1”>MOVIE TITLE<h1>
<h2 class="heading2”>Synopsis</h2>
<div>
<p>this text is the synopsis of the movie.</p>
</div>
<h2 class="heading2”>Cast</h2>
<div>
<p>The cast includes</p>
<ol>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
</ol>
</div>
</div>

<div class="content">
<h1 class = “heading1”>MOVIE TITLE<h1>
<h2 class="heading2”>Synopsis</h2>
<div>
<p>this text is the synopsis of the movie.</p>
</div>
<h2 class="heading2”>Cast</h2>
<div>
<p>The cast includes</p>
<ol>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
</ol>
</div>
</div>

我想理想地提取四个部分，标题、概要和演员表。至此，解析它并使用美丽的汤提取每个电影实例：

from bs4 import BeautifulSoup

data = open("movies.txt",'r').read()
soup = BeautifulSoup(data, "html.parser")

我已经像这样提取了每部电影：

movies = soup.find_all('div', attrs={'class':'content'})

以及每部电影的片名

movies.find_all('h1', attrs={'class':'heading1'})

相当容易，因为它们具有独特的类属性。

我也想提取概要；只是<p> 标签之间的那一行；和演员名单分开，就像我对标题所做的那样。但是，到目前为止我能够做到

movies.find_all('h2', attrs={'class':'heading2'})

你可以想象，这只是给了我“概要”和“演员表”

Answer 1

您的内容有 Right Double Quotes Marks - 请先替换它们。
替换错误字符；找到概要标题；提取下一个div。

# s = your html
trans = str.maketrans({8221:34})    
soup = BeautifulSoup(s.translate(trans),"html.parser")
contents = soup.find_all('div', attrs={'class':'content'})
for content in contents:
    syn = content.find('h2', text='Synopsis')
    print(syn, syn.fetchNextSiblings()[0].text)

Answer 2

这是使用 Beautiful Soup 4.7+。您应该可以使用 CSS 选择器轻松定位 p 元素。

为了获得概要，我们将使用 4 级选择器功能 :nth-child(an+b of s)。这将允许我们选择与选择器s 匹配的第一个孩子，这将是第一个h2.heading2 标记，然后我们将使用+ div 选择下一个div 兄弟和​​> p 来选择直接pchild。

from bs4 import BeautifulSoup

html = """
<div class="content">
<h1 class="heading1">MOVIE TITLE</h1>
<h2 class="heading2">Synopsis</h2>
<div>
<p>this text is the synopsis of the movie.</p>
</div>
<h2 class="heading2">Cast</h2>
<div>
<p>The cast includes</p>
<ol>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
</ol>
</div>
</div>

<div class="content">
<h1 class="heading1">MOVIE TITLE</h1>
<h2 class="heading2">Synopsis</h2>
<div>
<p>this text is the synopsis of the movie.</p>
</div>
<h2 class="heading2">Cast</h2>
<div>
<p>The cast includes</p>
<ol>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
<li>Actor</li>
</ol>
</div>
</div>
"""

soup = BeautifulSoup(html, "html.parser")

for movie in soup.select('div.content'):
    print(movie.select_one('h1.heading1').text)
    print(movie.select_one(':nth-child(1 of h2.heading2) + div > p').text)
    for actor in movie.select('ol > li'):
        print(actor.text)

输出：

MOVIE TITLE
this text is the synopsis of the movie.
Actor
Actor
Actor
Actor
Actor
MOVIE TITLE
this text is the synopsis of the movie.
Actor
Actor
Actor
Actor
Actor