jsoup 搜索表单结果解析

Question

我想将结果页面放入 doc，但我进入 doc starturl 页面

doc=Jsoup.connect(startUrl).data("search_text", search)
                            .data("charset", "utf-8")
                            .data("top-search-button", "submit")
                            .timeout(0)
                            .post();

搜索表单html：

<div class="b-top-search">
    <form method="post" action="http://startUrl/search/" id="globalSearch" name="globalSearch">
        <div class="b-top-search-box">
            <i class="icon top-search-spinner"></i>
            <input type="text" class="top-search-input unfocus" value="Insert search text" autocomplete="off" id="g-search-input" name="search_text" longdesc="Insert search text">
            <button class="top-search-button" type="submit"><span>Find</span></button>
            <input type="hidden" name="charset" value="utf-8">
        </div>

        <!--Top-search-results-->
        <div class="b-top-search-results" id="g-search-result">
        <ul class="b-top-search-results__list"></ul>
        </div>
        <!--/Top-search-results-->
    </form>
</div>

Answer 1

不需要data("top-search-button", "submit")，因为top-search-button 是元素的class，而不是name。它没有name，因此它没有任何价值。也许服务器期望一些关于客户端的元数据（用户代理和引荐标头）。试试这个

doc=Jsoup.connect(startUrl).userAgent("Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:25.0) Gecko/20100101 Firefox/25.0")  
                           .referrer("http://www.google.com")   
                           .data("search_text", search)
                           .data("charset", "utf-8")
                           .timeout(0)
                           .post();