【发布时间】:2017-09-20 13:12:21
【问题描述】:
我能够打印出表格,但无法将其提取到 .csv 文件中。我每天都是抓取和学习的新手。
如何将这些数据截屏到 CSV 文件?
标准库模块 导入操作系统 导入系统
# The wget module
import wget
# The BeautifulSoup module
from bs4 import BeautifulSoup
# The selenium module
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.by import By
driver = webdriver.Chrome() # if you want to use chrome, replace Firefox() with Chrome()
driver.get("https://www.arcountydata.com/county.asp?county=Benton") # load the web page
search_begin = driver.find_element_by_xpath("//*[@id='Assessor']/div/div[2]/a/i").click()
# for websites that need you to login to access the information
elem = driver.find_element_by_id("OwnerName") # Find the email input field of the login form
elem.send_keys("Roth Family Inc") # Send the users email
search_exeute = driver.find_element_by_xpath("//*[@id='Search']").click()
src = driver.page_source # gets the html source of the page
parser = BeautifulSoup(src,"lxml") # initialize the parser and parse the source "src"
table = parser.find("table", attrs={"class" : "table table-striped-yellow table-hover table-bordered table-condensed table-responsive"}) # A list of attributes that you want to check in a tag)
f = open('/output.csv', 'w')
parcel=""
owner=""
ptype=""
site_address=""
location=""
acres=""
summons =[]
#print table
list_of_rows = []
for row in table.findAll('tr')[1:]:
list_of_cells = []
for cell in row.findAll('td'):
text = cell.text.replace(" ", "")
list_of_cells.append(text)
list_of_rows.append(list_of_cells)
print list_of_rows
driver.close() # closes the driver ?>
【问题讨论】:
标签: python python-2.7 selenium web-scraping beautifulsoup