【问题标题】:Python how to use split delimiter to remove white-space on csvPython如何使用拆分分隔符删除csv上的空格
【发布时间】:2019-09-26 17:22:06
【问题描述】:

我正在编写一段将 html 表格转换为 csv 文件的代码。我无法弄清楚如何使用字符串拆分删除我打印到终端的信息之间的空白。我最好的结果是终端打印信息之间的巨大差距,这使得导航变得困难。任何信息将不胜感激。

import csv
from bs4 import BeautifulSoup
from termcolor import cprint

html = open("recallist.html").read()
soup = BeautifulSoup(html)
table = soup.find_all('div', {'id': 'PrintArea'})
output_rows = []
recals = 'recallist.csv'
cprint('READING TABLES', 'green')
for table_row in table:
    columns = table_row.findAll('td')
    output_row = []
    for column in columns:
        output_row.append(column.text)
    output_rows.append(output_row)
    with open('recallist.csv', 'w', newline='') as csvfile:
        writer = csv.writer(csvfile)
        writer.writerows(output_rows)
    with open(recals, 'r') as f:
        contents = f.read()
        for item in contents.split("Date,Customer,Phone,Cell Phone,Removal,Notes"):
            for refine in item.split('",,'):
                print(refine)

下面列出的 CSV 示例:

Location,,,Date,Customer,Phone,Cell Phone,Removal,Notes,�,�,�,,04/29/19 | 03:00 PM,[9999] FIRST LAST,999-999-9999***,999-999-9999,,"
",,"
","

$127.92
                 ",,04/29/19 | 03:30 PM,[123456] FIRST LAST,999-999-9999***,999-999-9999,04/13/2020,"
",,"
","

$0.02
                 ",,04/29/19 | 04:00 PM,[123456] FIRST LAST,999-999-9999***,,09/10/2019,"
",,"
","

($212.10)
                 ",,04/29/19 | 04:15 PM,[123456] FIRST LAST,999-999-9999***,,01/09/2020,"
",,"
","

$16.23
                 ",,04/29/19 | 04:30 PM,[123456] FIRST LAST,999-999-9999***,,05/30/2019,"
",,"
","

$0.24
                 ",,04/29/19 | 05:00 PM,[123456] FIRST LAST,999-999-9999***,,07/26/2019,"
",,"
","

($0.30)
                 ",,04/29/19 | 07:00 PM,[123456] FIRST LAST,999-999-9999***,999-999-9999,11/15/2019,"
",,"
","

$0.06
                 ",,04/29/19 | 07:30 PM,[123456] FIRST LAST,999-999-9999***,,12/12/2019,"
",,"
","

我想要实现的格式:

04/29/19 | 03:00 PM,[9999] FIRST LAST,999-999-9999***,999-999-9999,$127.92
04/29/19 | 03:30 PM,[99999] FIRST LAST,999-999-9999***,999-999-9999,$0.02
ETC.

html 示例,以备不时之需:

<tbody><tr class="alt">
            <td colspan="5" align="left" style="background-color:668cd9;">Location</td>
            <td colspan="5" align="left" style="background-color:668cd9;"></td>
            </tr>
            <tr align="left" class="GrayBLOCK">
              <td></td>
              <td>Date</td>
              <td>Customer</td>
              <td>Phone</td>
              <td>Cell Phone</td>
              <td>Removal</td>
              <td>Notes</td>
              <td> </td>
              <td> </td>
              <td> </td>
            </tr>












               <tr class="alt">
                <td></td>
                <td>04/29/19 | 03:00 PM</td>
                <td><a href="../code/c_newClient.cfm?theID=99999" target="_blank">[9999]</a> FIRST LAST</td>
                <td>999-999-9999***</td>
                <td>999-999-9999</td>
                <td></td>
                <td>

                </td>
                <td></td>
                <td>
    </td>
                <td align="right" class="RedMED">

$127.92
                 </td>
              </tr>











               <tr>
                <td></td>
                <td>04/29/19 | 03:30 PM</td>
                <td><a href="../code/c_newClient.cfm?theID=99999" target="_blank">[999999]</a> FIRST LAST</td>
                <td>999-999-9999***</td>
                <td>999-999-9999</td>
                <td>04/13/2020</td>
                <td>

                </td>
                <td></td>
                <td>
    </td>
                <td align="right" class="RedMED">

$0.02
                 </td>
              </tr>











               <tr class="alt">
                <td></td>
                <td>04/29/19 | 04:00 PM</td>
                <td><a href="../code/c_newClient.cfm?theID=99999" target="_blank">[999999]</a> FIRST LAST</td>
                <td>999-999-9999***</td>
                <td></td>
                <td>09/10/2019</td>
                <td>

                </td>
                <td></td>
                <td>
    </td>
                <td align="right" class="RedMED">

($212.10)
                 </td>
              </tr>











               <tr>
                <td></td>
                <td>04/29/19 | 04:15 PM</td>
                <td><a href="../code/c_newClient.cfm?theID=99999" target="_blank">[999999]</a> FIRST LAST</td>
                <td>999-999-9999***</td>
                <td></td>
                <td>01/09/2020</td>
                <td>

                </td>
                <td></td>
                <td>
    </td>
                <td align="right" class="RedMED">

$16.23
                 </td>
              </tr>











               <tr class="alt">
                <td></td>
                <td>04/29/19 | 04:30 PM</td>
                <td><a href="../code/c_newClient.cfm?theID=99999" target="_blank">[999999]</a> FIRST LAST</td>
                <td>999-999-9999***</td>
                <td></td>
                <td>05/30/2019</td>
                <td>

                </td>
                <td></td>
                <td>
    </td>
                <td align="right" class="RedMED">

$0.24
                 </td>
              </tr>











               <tr>
                <td></td>
                <td>04/29/19 | 05:00 PM</td>
                <td><a href="../code/c_newClient.cfm?theID=99999" target="_blank">[999999]</a> FIRST LAST</td>
                <td>999-999-9999***</td>
                <td></td>
                <td>07/26/2019</td>
                <td>

                </td>
                <td></td>
                <td>
    </td>
                <td align="right" class="RedMED">

($0.30)
                 </td>
              </tr>











               <tr class="alt">
                <td></td>
                <td>04/29/19 | 07:00 PM</td>
                <td><a href="../code/c_newClient.cfm?theID=99999" target="_blank">[999999]</a> FIRST LAST</td>
                <td>999-999-9999***</td>
                <td>999-999-9999</td>
                <td>11/15/2019</td>
                <td>

                </td>
                <td></td>
                <td>
    </td>
                <td align="right" class="RedMED">

$0.06
                 </td>
              </tr>

【问题讨论】:

  • 试试strip()函数,它会去掉空格。
  • 目前还没有运气,不过感谢您的建议。
  • 我的笔记本电脑离我很远。一旦我靠近它就会测试它并让你知道。

标签: python regex csv beautifulsoup delimiter


【解决方案1】:

更新:我在原始帖子中发现了一个问题,这里有更好的版本。空的&lt;td&gt; 标签创建了一些额外的列。版本 1 保留了这些列,版本 2 删除了它们,但它非常特定于您提供的格式,如果格式更改,则必须修改切片。

版本 1

import csv
from bs4 import BeautifulSoup

with open("recallist.html") as f:
    soup = BeautifulSoup(f.read(), features="html.parser")

rows = soup.find_all('tr')
with open('recallist.csv', 'w', newline='') as csvfile:
    writer = csv.writer(csvfile)
    for row in rows:
        columns = row.find_all('td')
        writer.writerow([column.get_text(strip=True) for column in columns])

第 2 版

import csv
from bs4 import BeautifulSoup

with open("recallist.html") as f:
    soup = BeautifulSoup(f.read(), features="html.parser")

rows = soup.find_all('tr')
with open('recallist.csv', 'w', newline='') as csvfile:
    writer = csv.writer(csvfile)
    #alt: 'for row in rows[2:]:' to slice off the two header rows
    for row in rows: 
        columns = row.find_all('td')
        del columns[0]
        del columns[-4:-1]
        writer.writerow([column.get_text(strip=True) for column in columns])

如果您的真实 HTML 实际上有多个包含各种列的表格,则需要对其进行调整。希望对您有所帮助!

【讨论】:

  • 非常感谢,第 2 版运行良好。你真的为我省了无数的麻烦。
  • 很高兴它符合您的要求! @evolve710
猜你喜欢
  • 1970-01-01
  • 2022-12-26
  • 2014-02-11
  • 1970-01-01
  • 1970-01-01
  • 2013-06-27
  • 1970-01-01
  • 1970-01-01
  • 2014-01-06
相关资源
最近更新 更多