【问题标题】:How to get images from link?如何从链接中获取图像?
【发布时间】:2016-06-11 06:56:10
【问题描述】:

当我尝试通过此代码访问图像标签时,我得到以下输出。

url = 'https://paytm.com/shop/p/pepe-jeans-blue-slim-fit-t-shirts-APPPEPE-JEANS-BSETU2010438B648267'

def soup_maker(url):
    r = requests.get(url)
    markup = r.content
    soup = bs(markup, "html.parser")
    return soup

def get_images(url):
    soup = soup_maker(url)
    divs = soup.find_all('div', {'class': 'fixed-height'})
    print(divs)
    images = soup.find_all('img')
    print(images)

输出

[]
[<img alt="{{::product.text}}" ng-src="{{::product.image_url}}"/>, 
 <img alt="{{item.title}}" ng-src='{{cart.imgResized(item.image_url,"50x50") }}'/>, 
 <img ng-src="{{pixelSource}}"/>]

但是当我通过 Inspect Element 看到它时。我不知道如何保存这些图像。

更新

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

def soup_maker(url):
    driver = webdriver.Chrome()
    driver.get(url)
    try:
        element = WebDriverWait(driver, 20).until(
        EC.presence_of_element_located((By.CLASS_NAME, "fixed-height"))
        )
        markup = driver.page_source
        soup = bs(markup, "html.parser")
        return soup
    finally:
        driver.quit()
    driver.close()

以上对我有用。

【问题讨论】:

    标签: python selenium selenium-webdriver beautifulsoup bs4


    【解决方案1】:

    这看起来像一个带有定义绑定的 AngularJS 模板,这意味着该站点需要一个带有 javascript 引擎的真实浏览器才能呈现。让我们保留解析部分,但不是 requests,而是通过 @987654321 获取源代码@:

    from selenium import webdriver
    
    def soup_maker(url):
        driver = webdriver.Firefox()  # could also be Chrome(), PhantomJS() or other
        driver.get(url)
    
        # you might also need an Explicit Wait here to wait for the page to load
        # see http://selenium-python.readthedocs.org/waits.html#explicit-waits
    
        markup = driver.page_source
        driver.close()
        soup = bs(markup, "html.parser")
        return soup
    

    【讨论】:

      猜你喜欢
      • 2013-11-25
      • 2012-02-07
      • 2012-05-05
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多