HtmlUnit Android：NoSuchFieldError：没有 Lorg/apache/http/conn/ssl/AllowAllHostnameVerifier 类型的静态字段实例

Question

我正在尝试在 Android 上运行 HtmlUnit。我认为this answer 曾经使用较旧的库，但现在不再使用了。与此问题相关的其他线程与 Android 上的 Kotlin 无关或已过时。

考虑下面的代码：

https://github.com/JimClermonts/HtmlUnit-for-Android

override fun onCreate(savedInstanceState: Bundle?) {
    super.onCreate(savedInstanceState)
    setContentView(R.layout.activity_main)

    doAsync {
        val webClient = WebClient()
        var page: HtmlPage = webClient.getPage<HtmlPage>("http://www.google.com")
        val searchBox = page.getElementByName<HtmlInput>("q")
        searchBox.valueAttribute = "htmlunit"

        val googleSearchSubmitButton: HtmlSubmitInput = page.getElementByName("btnG") // sometimes it's "btnK"
        page = googleSearchSubmitButton.click()

        val resultStatsDiv: HtmlDivision = page.getFirstByXPath("//div[@id='resultStats']")

        System.out.println(resultStatsDiv.asText()) // About 309,000 results

        webClient.close()
    }
}

这是我的项目依赖项：

dependencies {
    implementation group: 'commons-io', name: 'commons-io', version: '2.6'
//    implementation group: 'commons-logging', name: 'commons-logging', version: '1.2'
    implementation group: 'commons-net', name: 'commons-net', version: '3.6'
    implementation group: 'net.sourceforge.htmlunit', name: 'htmlunit-core-js', version: '2.34.0'
    implementation group: 'net.sourceforge.htmlunit', name: 'htmlunit-cssparser', version: '1.3.0'
    implementation group: 'net.sourceforge.htmlunit', name: 'neko-htmlunit', version: '2.34.0'
    implementation group: 'org.apache.commons', name: 'commons-lang3', version: '3.8.1'
    implementation group: 'org.apache.commons', name: 'commons-text', version: '1.6'
    implementation group: 'org.eclipse.jetty.websocket', name: 'websocket-client', version: '9.4.15.v20190215'
    implementation group: 'xalan', name: 'xalan', version: '2.7.2'

    //Project Transitive Dependencies
    implementation('org.apache.httpcomponents:httpmime:4.5.7') {
        exclude module: 'httpclient'
    }
    implementation 'org.apache.httpcomponents:httpclient-android:4.3.5.1'
//    implementation group: 'commons-codec', name: 'commons-codec', version: '1.11'
//    implementation('org.apache.httpcomponents:httpmime:4.5.7') {
//        exclude module: 'httpclient'
//    }
//    implementation 'org.apache.httpcomponents:httpclient-android:4.3.5'
////    implementation group: 'org.apache.httpcomponents', name: 'httpcore', version: '4.4.11'
//    implementation group: 'org.eclipse.jetty', name: 'jetty-client', version: '9.4.15.v20190215'
//    implementation group: 'org.eclipse.jetty', name: 'jetty-http', version: '9.4.15.v20190215'
//    implementation group: 'org.eclipse.jetty', name: 'jetty-io', version: '9.4.15.v20190215'
//    implementation group: 'org.eclipse.jetty', name: 'jetty-util', version: '9.4.15.v20190215'
//    implementation group: 'org.eclipse.jetty', name: 'jetty-xml', version: '9.4.15.v20190215'
//    implementation group: 'org.eclipse.jetty.websocket', name: 'websocket-api', version: '9.4.15.v20190215'
//    implementation group: 'org.eclipse.jetty.websocket', name: 'websocket-common', version: '9.4.15.v20190215'
//    implementation group: 'xalan', name: 'serializer', version: '2.7.2'
//    implementation group: 'xerces', name: 'xercesImpl', version: '2.12.0'
//    implementation group: 'xml-apis', name: 'xml-apis', version: '1.4.01'


    implementation "org.jetbrains.anko:anko-commons:0.10.1"
    implementation "org.jetbrains.anko:anko-design:0.10.1"
    implementation "org.jetbrains.anko:anko-coroutines:0.10.1"
}

Android 清单：

<uses-permission android:name="android.permission.INTERNET" />

错误信息：

W/System.err: java.lang.NoSuchFieldError: No static field INSTANCE of type Lorg/apache/http/conn/ssl/AllowAllHostnameVerifier; in class Lorg/apache/http/conn/ssl/AllowAllHostnameVerifier; or its superclasses (declaration of 'org.apache.http.conn.ssl.AllowAllHostnameVerifier' appears in /system/framework/framework.jar:classes3.dex)
2019-04-12 09:17:06.712 5110-5140/eu.theappfactory.myapplication W/System.err:     at org.apache.http.conn.ssl.SSLConnectionSocketFactory.<clinit>(SSLConnectionSocketFactory.java:149)
2019-04-12 09:17:06.712 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.httpclient.HtmlUnitSSLConnectionSocketFactory.buildSSLSocketFactory(HtmlUnitSSLConnectionSocketFactory.java:89)
2019-04-12 09:17:06.712 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.HttpWebConnection.configureHttpsScheme(HttpWebConnection.java:626)
2019-04-12 09:17:06.712 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.HttpWebConnection.createHttpClient(HttpWebConnection.java:558)
2019-04-12 09:17:06.712 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.HttpWebConnection.getHttpClientBuilder(HttpWebConnection.java:519)
2019-04-12 09:17:06.712 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:171)
2019-04-12 09:17:06.712 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1402)
2019-04-12 09:17:06.712 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1321)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:394)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:315)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:466)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:448)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at eu.theappfactory.myapplication.MainActivity$onCreate$1.invoke(MainActivity.kt:20)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at eu.theappfactory.myapplication.MainActivity$onCreate$1.invoke(MainActivity.kt:12)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at org.jetbrains.anko.AsyncKt$doAsync$1.invoke(Async.kt:140)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at org.jetbrains.anko.AsyncKt$doAsync$1.invoke(Unknown Source:0)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at org.jetbrains.anko.AsyncKt$sam$Callable$761a5578.call(Unknown Source:2)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:301)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1162)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:636)
2019-04-12 09:17:06.713 5110-5140/eu.theappfactory.myapplication W/System.err:     at java.lang.Thread.run(Thread.java:764)

Answer 1

在 github 上有修改过的 android，或者说只是 android 工作版本，称为 'htmlunit android'。 您面临的问题是由于 http 客户端，它已经是 android 框架的一部分，但 google 已修改。 对于 ssl 操作 htmlunit 库需要完整的 apache http 库。 有消息来自。 经过一天的调试，我发现缺少一些 htmlunit webrequest 需要完成调用的类。 使用这个库： https://github.com/null-dev/HtmlUnit-Android

Answer 2

从版本 2.52.0 开始，依赖于 java.awt 的类的数量现在要少得多。如果您喜欢其余的解决方案，请在 github 上打开一个问题，我将尝试为剩余的依赖项找到一种方法。

Answer 3

此错误的原因是 HtmlUnit（使用 HttpClient）和部分集成在 android jdk 中的 HttpClient 版本之间的类版本冲突。

现在https://github.com/HtmlUnit/htmlunit-android 有一个特殊的 HtmlUnit 分发版可以解决这个问题。

请尝试报告任何问题。

Answer 4

我不知道你为什么要指定传递依赖，除非你想以某种方式配置它，否则你不需要。

我将它们注释掉，然后将应用编译并部署到设备上。