【发布时间】:2021-03-01 11:47:20
【问题描述】:
如何获取所有产品详细信息,它打印相同的内容,但我希望其他产品也详细说明 这是我要获取所有产品数据的链接:https://www.nike.com/gb/w/womens-lifestyle-shoes-13jrmz5e1x6zy7ok
import requests
from bs4 import BeautifulSoup
import pandas as pd
import numpy as np
from selenium import webdriver
url= "https://www.nike.com/gb/w/womens-lifestyle-shoes-13jrmz5e1x6zy7ok"
driver = webdriver.Chrome('D:/chromedriver')
driver.get(url)
pageSource = driver.page_source
for n in range(10):
driver.execute_script("window.scrollTo(0, document.body.scrollHeight);")
soup = BeautifulSoup(pageSource, 'lxml')
content= soup.findAll('div',class_='product-grid')
content
for item in content:
title= item.find('div',class_ = 'product-card__title').text
link = item.find('a', {'class': 'product-card__link-overlay'})['href']
price=item.find('div',class_ ='product-price css-11s12ax is--current-price').text
print(title,price,link)
【问题讨论】:
标签: python selenium beautifulsoup python-requests