【问题标题】:requests_html render method continues to result in timeoutrequests_html 渲染方法继续导致超时
【发布时间】:2020-09-18 19:00:30
【问题描述】:

我不确定是不是我电脑的设置(Windows 7,Python3.8,刚刚安装了requests_html),但是无论我选择哪个站点,render 方法都会导致timeout error 我玩过超时参数,但没有运气。

import os
import sys
import requests_html
import requests
import pyppeteer



def get_request(url, render = False):

    session = requests_html.HTMLSession()
    res = session.get(url)

    try:
        res.raise_for_status()
    except ValueError as e:
        raise('Dead link')

    if render:
        res.html.render(sleep = 2, timeout = 20)

    return res, session


def test_render():
    url = 'https://www.yahoo.com/'
    res, session = get_request(url, render = True)

【问题讨论】:

    标签: python-3.x python-requests-html pyppeteer


    【解决方案1】:

    我试过了,效果很好:

    import os
    import sys
    import requests_html
    import requests
    import pyppeteer
    
    
    
    def get_request(url, render = False):
    
        session = requests_html.HTMLSession()
        res = session.get(url)
    
        try:
            res.raise_for_status()
        except ValueError as e:
            raise('Dead link')
    
        if render:
            res.html.render(sleep = 2, timeout = 20)
    
        return res, session
    
    
    def test_render():
        url = 'https://www.yahoo.com/'
        res, session = get_request(url, render = True)
    
    #test_render()
    [res, session]= get_request('https://www.yahoo.com/', render=True)
    print(res.text)
    

    检查您的设置,因为我没有更改刚刚调试的任何内容

    【讨论】:

    猜你喜欢
    • 2020-07-19
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2016-06-04
    • 2018-07-12
    • 1970-01-01
    • 2019-01-02
    相关资源
    最近更新 更多