Python XML删除标签内的换行符答案

【问题标题】：Python XML remove newlines inside tagPython XML删除标签内的换行符
【发布时间】：2021-08-12 12:57:39
【问题描述】：

问题是，在我从 SEC 抓取的一些 xml 文件中，标签内有换行符。因此，那些 xml 文件格式不正确。

<footnote id="F4">Shares sold on the open market are reported as an average sell price per share of $56.87; breakdown of shares sold and per share sale prices are as follows; 100 at $56.31; 200 at $56.32; 100 at $56.33; 198 at $56.39; 600 at $56.40; 100 at $56.41; 102 at $56.42; 600 at $56.44; 320 at $56.45; 100 at $56.46; 900 at $56.47; 480 at $56.48; 300 at $56.49; 1,200 at $56.50; 400 at $56.51; 1,130 at $56.52; 600 at $56.53; 100 at $56.54; 1,500 at $56.55; 600 at $56.56; 644 at $56.57; 1,656 at $56.58; 1,070 at $56.59; 2069 at $56.60; 1,831 at $56.61; 1,000 at $56.62; 1,000 at $56.63; 492 at $56.64; 1,400 at $56.65; 920 at $56.66; 1,000 at $56.67; 600 at $56.68; 500 at $56.69; 1,200 at $56.70; 500 at $56.71; 582 at $56.72; 400 at $56.73; 1,108 at $56.74; 37 at $56.75; 710 at $56.76; 630 at $56.77; 1,600 at $56.78; 400 at $56.79; 400 at $56.80; 1,500 at $56.81; 1,100 at $56.82; 100 at $56.83; 800 at $56.84; 200 at $56.85; 1,300 at $56.87; additional shares sold continued on Footnote (5).</footnot
e>

我的第一个想法是这是因为utf-8和ISO-8859-1的编码不同，但是改了编码后问题依旧。我的下一个解决方案是一个正则表达式，它检测标签内的那些换行符，但由于它们可能出现在任何地方，这个解决方案不是很可靠。

你们对如何解决这个问题有什么想法吗？

【问题讨论】：

你能分享一个这样的xml文件的链接吗？
当然，sec.gov/Archives/edgar/data/1200483/0001112679-10-000086.txt
问题是一行的长度。在 1024 个字符之后，该行在下一行继续，因此请尝试提出逻辑，其中一行是 1024 个字符，下一行以 > 结尾并将它们粘合在一起。
由于这种缺陷，这些文件实际上不是 XML；它们是看起来有点像 XML 的文本文件。祝你好运！

标签： python regex xml well-formed

【解决方案1】：

对于this txt file with xml part inside，可以这样做：

import re

# open the txt file
with open("0001112679-10-000086.txt", "r", encoding="utf8") as f:
    txt = f.read();

# cut out the xml part from the txt file
start = txt.find("<XML>")
end = txt.find("</XML>") + 6
xml = txt[start:end]

# process the xml part
xml = re.sub(r"([^\n]{1023})\n", r"\1", xml)

# combine a new txt back from the parts
new_txt = txt[:start] + xml + txt[end:]

# save the new txt in file
with open("0001112679-10-000086_output.txt", "w", encoding="utf8") as f:
    f.write(new_txt)

【讨论】：