【发布时间】：2019-03-22 20:33:47
【问题描述】：
我的主要目标是从网站中提取内容。我想把它保存在本地。内容应在网站上更新后，它也应反映本地数据。
我能够从代码中使用的网页读取数据，现在我想将结果保存到数据框中，以便我可以导出结果。我希望 x6 的值应该输入到数据框 df 中，以便我可以将数据框结果导出到文本文件或 excel 文件中，或者您可以建议任何其他方式从代码中使用的网页中提取数据（网页抓取）。在此我希望我的 for 循环不起作用，所以请任何人帮助我。
library(rvest)
library(dplyr)
library(qdapRegex) # install.packages("qdapRegex")
google <- read_html("https://bidplus.gem.gov.in/bidresultlists")
(x <- google %>%
html_nodes(".block") %>%
html_text())
class(x)
(x1 <- gsub(" ", "", x))
(x2 <- gsub(" ", "", x1))
(x3 <- gsub(" ", "", x2))
(x4 <- gsub(" ", "", x3))
(x5 <- gsub(" ", "", x4))
(x6 <- gsub("\n", "", x5))
class(x6)
length(x6[i])
typeof(x6)
for (i in x6) {
BIDNO <- rm_between(x6[i], "BID NO:", "Status", extract = TRUE)
Status <- rm_between(x6[i], "Status:", "Quantity Required", extract = TRUE)
Quantity_Required <- rm_between(x6[i], "Quantity Required:", "Department Name And Address", extract = TRUE)
Department_Name_And_Address <- rm_between(x6[i], "Department Name And Address:", "Start Date", extract = TRUE)
Start_Date <- rm_between(x6[i], "Start Date:", "End Date", extract = TRUE)
# End_Date <- rm_between(x6[i], "End Date: ", "Technical Evaluation", extract=TRUE)
df <- data.frame("BID_NO", "Status", "Quantity_Required", "Department_Name_Address", "Start_Date")
}
df
View(df)
【问题讨论】：
标签： r web-scraping rvest removing-whitespace