【发布时间】:2014-11-11 12:48:29
【问题描述】:
我正在编写一个脚本,它应该依次打开 10 个文本文件(它们是来自不同网页的源代码)。然后我希望脚本通过并将<br /> 的任何实例替换为\n。然后我希望它基本上删除整个标题。在任何情况下,文档总是以DOCTYPE 开头,并且我想要的信息之前的最后一行结束
"decoration:underline">no year</span><br />
据我所知,正则表达式 /.../s 表示“忽略换行符”,并且我已经转义了出现在 </span> 标记中的 HTML /。
到目前为止,我有以下内容
import re
def create_linebreaks(l):
l = l.replace('<br />', r'\n')
return l
def clean_up(line):
line = re.sub(r'/^<!DOCTYPE.+no year<\/span>/s', '', line)
return line
data = """<!DOCTYPE html><html class='v2' dir='ltr' xmlns='http://www.w3.org/1999/xhtml' xmlns:b='http://www.google.com/2005/gml/b' movie/file/show/episodes is 2763.</p>A LOAD OF OTHER HTML I DON'T WANT TO BE IN THE OUTPUT
<!-- google_ad_section_start(weight=ignore) --><span class="listings"><span style="font-size:large;font-weight:bold; text-decoration:underline">no year</span><br /> <b><a target="_blank" href="http://movies.netflixable.com/224599">Beautiful Game, The</a> (no year)</b> <i style="font-size:small"> 3.5 stars, 1hr 24m <a target="_blank" href="http://www.imdb.com/search/title?title=The Beautiful Game">imdb</a></i> <img class="cc_img" src="http://bit.ly/VqRKtD" border="0" style="padding:0px !important;" title="Closed Captions: --- - Danish - Swedish - Finnish - Norwegian Bokm��l - English " alt="Closed Captions: --- - Danish - Swedish - Finnish - Norwegian Bokm��l - English " /> <br /> <br /> <b><a target="_blank" href="http://movies.netflixable.com/224278">Brave Miss World</a> (no year)</b> <i style="font-size:small"> 3.7 stars, 1hr 28m <a target="_blank" href="http://www.imdb.com/search/title?title=Brave Miss World">imdb</a></i> <img class="cc_img" src="http://bit.ly/VqRKtD" border="0" style="padding:0px !important;" title="Closed Captions: --- - Danish - Swedish - Finnish - Norwegian Bokm��l " alt="Closed Captions: --- - Danish - Swedish - Finnish - Norwegian Bokm��l " /> <br /> <br />"""
create_linebreaks(data)
clean_up(data)
print data
raw_input()
我得到的只是相同的字符串。
所需的输出类似于:
""" <b><a target="_blank" href="http://movies.netflixable.com/224599">Beautiful Game, The</a> (no year)</b> <i style="font-size:small"> 3.5 stars, 1hr 24m <a target="_blank" href="http://www.imdb.com/search/title?title=The Beautiful Game">imdb</a></i> <img class="cc_img" src="http://bit.ly/VqRKtD" border="0" style="padding:0px !important;" title="Closed Captions: --- - Danish - Swedish - Finnish - Norwegian Bokm��l - English " alt="Closed Captions: --- - Danish - Swedish - Finnish - Norwegian Bokm��l - English " />
<b><a target="_blank" href="http://movies.netflixable.com/224278">Brave Miss World</a> (no year)</b> <i style="font-size:small"> 3.7 stars, 1hr 28m <a target="_blank" href="http://www.imdb.com/search/title?title=Brave Miss World">imdb</a></i> <img class="cc_img" src="http://bit.ly/VqRKtD" border="0" style="padding:0px !important;" title="Closed Captions: --- - Danish - Swedish - Finnish - Norwegian Bokm��l " alt="Closed Captions: --- - Danish - Swedish - Finnish - Norwegian Bokm��l " /> """
【问题讨论】:
-
不要使用正则表达式进行 html 解析。
-
使用正则表达式解析 HTML is unwise - 您是否考虑过使用实际的解析器(例如,BeautifulSoup)?
-
如果你只是想替换一个标签,使用 str.replace("
", "whateveryouwant); -
在这个阶段,我真的不考虑它的解析。我实际上只是想删除文档开头和关键字之间的所有文本。我实际上只是想停止手动进入 Notepad ++。我已经想出了如何从剩下的内容中提取我想要的信息,这是缺少的步骤。
-
当你打印可变数据时,你为什么会期望它改变呢?您正在通过您的函数传递该数据并将其作为 l?似乎您想打印 clean_data(data) ......如果您想实际更改数据的值,您需要在您的函数中这样做。 (记住全局范围)
标签: python html regex python-2.7