为了测试我的技能，我正在编写一个 Python 软件，它应该转到网页 https://www.solebox.com/de_DE，选择产品并将名称、标签和价格保存在 .txt 文件中（或将其转换为未来）使用 Selenium 库。问题是该站点检测到我正在使用自动软件，并且不允许我访问这些产品。我已经尝试过使用undetected_chromedriver 库，但它没有用。有人知道工作方法吗？谢谢。
更多信息：操作系统：Windows 10，Chrome 版本：88.0.4324.150 64 位，Python 版本：3.9.1，编写软件：Visual Studio Code
【问题讨论】：
options=webdriver.ChromeOptions()
options.add_experimental_option(
"excludeSwitches", ['enable-automation'])
driver = webdriver.Chrome(options=options)
driver.get("https://www.solebox.com/de_DE")
只需排除将禁用 navigator.webdriver 对象的自动化开关
https://developer.mozilla.org/en-US/docs/Web/API/Navigator/webdriver
【讨论】：
有多种方法可以规避Selenium 自动化的检测。
--disable-blink-features=AutomationControlled
代码块：
options = webdriver.ChromeOptions()
options.add_argument("start-maximized")
options.add_argument('--disable-blink-features=AutomationControlled')
driver = webdriver.Chrome(options=options, executable_path=r'C:\WebDrivers\chromedriver.exe')
driver.get('https://www.solebox.com/de_DE')
print(driver.page_source)
控制台输出：
<!-- =============== This snippet of JavaScript handles fetching the dynamic recommendations from the remote recommendations server
and then makes a call to render the configured template with the returned recommended products: ================= -->
<script>
(function(){
// window.CQuotient is provided on the page by the Analytics code:
var cq = window.CQuotient;
if (cq && ('function' == typeof cq.getCQUserId)
&& ('function' == typeof cq.getCQCookieId)
&& ('function' == typeof cq.getCQHashedEmail)
&& ('function' == typeof cq.getCQHashedLogin)) {
var recommender = '[["Homepage_Topseller"]]';
// cleaning up the leading/trailing brackets and quotes:
recommender=recommender.slice(8, recommender.length-8);
var separator = '|||';
.
</script>
<script type="text/javascript">//<!--
/* <![CDATA[ (viewProduct-active_data.js) */
dw.ac._capture({id: "01900289", type: "recommendation"});
/* ]]> */
// -->
</script>
.
<script type="text/javascript" id="" src="//static.criteo.net/js/ld/ld.js"></script>
<script type="text/javascript" id="">window.criteo_q=window.criteo_q||[];window.criteo_q.push({event:"setAccount",account:google_tag_manager["GTM-M9TMD24"].macro(24)},{event:"setEmail",email:""},{event:"setSiteType",type:"d"},{event:"viewHome"});</script><div id="criteo-tags-div" style="display: none;"><iframe src="https://gum.criteo.com/syncframe?topUrl=www.solebox.com#{"bundle":{"origin":0,"value":null},"cw":true,"lwid":{"origin":0,"value":null},"optout":{"origin":0,"value":null},"origin":"onetag","pm":0,"sid":{"origin":0,"value":null},"tld":"solebox.com","topUrl":"www.solebox.com","uid":null,"version":"5_6_2"}" id="criteo-syncframe" width="0" height="0" frameborder="0" style="border-width:0px; margin:0px; display:none" title="Criteo GUM iframe"></iframe></div></body></html>
您可以在Selenium can't open a second page找到相关的详细讨论
代码块：
import undetected_chromedriver as uc
from selenium import webdriver
options = webdriver.ChromeOptions()
options.add_argument("start-maximized")
driver = uc.Chrome(options=options)
driver.get("https://www.solebox.com/de_DE")
print(driver.page_source)
控制台输出：
.
.
<script type="text/javascript" id="">!function(b,e,f,g,a,c,d){b.fbq||(a=b.fbq=function(){a.callMethod?a.callMethod.apply(a,arguments):a.queue.push(arguments)},b._fbq||(b._fbq=a),a.push=a,a.loaded=!0,a.version="2.0",a.queue=[],c=e.createElement(f),c.async=!0,c.src=g,d=e.getElementsByTagName(f)[0],d.parentNode.insertBefore(c,d))}(window,document,"script","https://connect.facebook.net/en_US/fbevents.js");fbq("init",google_tag_manager["GTM-M9TMD24"].macro(19));fbq("track","PageView");</script>
<noscript><img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=238536633211197&ev=PageView&noscript=1"></noscript>
<script type="text/javascript" id="" src="//static.criteo.net/js/ld/ld.js"></script></body></html>
您可以在Undetected Chromedriver not loading correctly找到相关的详细讨论
【讨论】：