使用 Python 将 HTML 表格数据从电子邮件提取到 csv 文件，将第一列值提取到行标题

Question

我正在尝试通读 Outlook 文件夹并获取 ReceivedTime、CC、Subject、HTMLBody，但将表格提取到列中。我可以将 1) ReceivedTime,CC,Subject,HTMLBody 拉到一个数据框中，我可以这样做 2) 将 HTMLBody 表提取到一个数据框中，但我无法同时执行 1) 和 2)。

当前代码：

import win32com.client
import pandas as pd
from bs4 import BeautifulSoup


outlook = win32com.client.Dispatch("Outlook.Application")
mapi = outlook.GetNamespace("MAPI")

inbox = mapi.Folders[User@email.com'].Folders['Inbox'].Folders['Subfolder Name']
Mail_Messages = inbox.Items

for mail in Mail_Messages:
     receivedtime = mail.ReceivedTime.strftime('%Y-%m-%d %H:%M:%S')
     cc = mail.CC
     body = mail.HTMLBody
     html_body = BeautifulSoup(body,"lxml")
     html_tables = html_body.find_all('table')[0]

df = pd.read_html(str(html_tables),header=None)[0]
display(df)

当前数据框显示如下。但我也想要相关的 ReceivedTime、CC 和主题。

	0	1
0	Report Name	Report.pdf
1	Team Name	Team A
2	Project Name	Project A
3	Unique ID Number	123456789
4	Due Date	1/1/2021

但希望列 [0] 改为行标题。因此，当每封电子邮件被读取时，它会为收件箱子文件夹中的所有电子邮件生成一个如下所示的数据框：

0	Report Name	Team Name	Project Name	Unique ID Number	Due Date	ReceivedTime	CC	Subject
1	Report.pdf	Team A	Project A	123456789	1/5/2021	1/1/2021 4:38:44 AM	User1@email.com, User2@email.com	Action Required:Report A Coming due
2
3
4

但是我被卡住了，仍然是一个初学者，但是我看到的所有其他帖子并没有完全让我明白我正在尝试做的事情。我很感激这方面的任何帮助。

Answer 1

试试这个：

import win32com.client
import pandas as pd
from bs4 import BeautifulSoup
from pprint import pprint

outlook = win32com.client.Dispatch("Outlook.Application")
mapi = outlook.GetNamespace("MAPI")

inbox = mapi.Folders['User@email.com'].Folders['Inbox'].Folders['Subfolder Name']
Mail_Messages = inbox.Items

# a list where contents of each e-mail - CC, receiv.time and subject will have been put
contents = []
column_names = ['Report Name', 'Team Name', 'Project Name', 'Unique ID Number', 'Due Date', 'ReceivedTime', 'CC', 'Subject']

for mail in Mail_Messages:

    body = mail.HTMLBody
    html_body = BeautifulSoup(body, "lxml")
    html_tables = html_body.find_all('table')

    # uncomment following lines if you want to have column names defined programatically rather than hardcoded
    # column_names = pd.read_html(str(html_tables), header=None)[0][0]
    # column_names = column_names.tolist()
    # column_names.append("CC")
    # column_names.append("Received Time")
    # column_names.append("Subject")

    # a list containing a single e-mail data - html table, CC, receivedTime and subject
    row = pd.read_html(str(html_tables), header=None)[0][1]
    row = row.tolist()
    row.append(mail.CC)
    row.append(mail.ReceivedTime.strftime('%Y-%m-%d %H:%M:%S'))
    row.append(mail.Subject)

    # appending each full row to a list
    contents.append(row)


# and finally converting a list into dataframe
df = pd.DataFrame(contents, columns=column_names)

pprint(df)