python scrapy 报错 DEBUG: Ignoring response  403

DEBUG: Ignoring response <403 http://movie.douban.com/top250>: HTTP status code is not handled or not allowed

怎么回事呢,被屏蔽了,我们来伪装一下,在settings.py里加上USER_AGENT:

 

解决方法:

在setting.py文件中增加USER_AGENT配置:(随便写一条就可以了)

USER_AGENT = 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36' 

or

USER_AGENT = 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_3) AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.54 Safari/536.5'

相关文章:

  • 2021-07-17
  • 2022-12-23
  • 2021-08-06
  • 2022-12-23
  • 2023-03-20
  • 2022-02-22
  • 2022-01-29
猜你喜欢
  • 2022-12-23
  • 2022-03-07
  • 2022-12-23
  • 2021-04-22
  • 2022-12-23
  • 2021-04-06
  • 2022-12-23
相关资源
相似解决方案