【发布时间】：2021-11-07 12:04:35
【问题描述】：
我正在抓取一个 HMTL 表，最终数据框创建了一个需要清理和格式化的“日期”列。
我的范围是将此列转换为数据列。
在我的数据框下方：
这一步之后我想做的就是清理Datecolumn 并将此列转换为pandas 日期列。
有什么帮助吗？
这里是如何产生这个表：
## web scrapping
import requests
import lxml.html as lh
import pandas as pd
url='https://markets.ft.com/data/funds/tearsheet/historical?s=LU0841585341:GBP'
#Create a handle, page, to handle the contents of the website
page = requests.get(url)
#Store the contents of the website under doc
doc = lh.fromstring(page.content)
#Parse data that are stored between <tr>..</tr> of HTML
tr_elements = doc.xpath('//tr')
#Create empty list
col=[]
i=0
#For each row, store each first element (header) and an empty list
for t in tr_elements[0]:
i+=1
name=t.text_content()
# print '%d:"%s"'%(i,name)
col.append((name,[]))
#Since out first row is the header, data is stored on the second row onwards
for j in range(1,len(tr_elements)):
#T is our j'th row
T=tr_elements[j]
#If row is not of size 10, the //tr data is not from our table
if len(T)!=6:
break
#i is the index of our column
i=0
#Iterate through each element of the row
for t in T.iterchildren():
data=t.text_content()
#Check if row is empty
if i>0:
#Convert any numerical value to integers
try:
data=int(data)
except:
pass
#Append the data to the empty list of the i'th column
col[i][1].append(data)
#Increment i for the next column
i+=1
Dict={title:column for (title,column) in col}
df=pd.DataFrame(Dict)
df.head()
【问题讨论】：
-
请do not post images您的数据或错误。您可以包含code that creates a dataframe such as
df.to_dict()or the output ofprint(df)（至少包含允许重现您的问题的几行和几列）
标签： pandas datetime web-scraping data-cleaning