无法从 html 获取链接 - jsoup答案

【问题标题】：Unable to get links from html - jsoup无法从 html 获取链接 - jsoup
【发布时间】：2018-03-11 18:39:53
【问题描述】：

使用以下代码，我可以从网站上获取所需的文本，但无法获取文本的关联链接。尝试了几种方法排列和组合。我最多得到的是整个外部 html，如下所示：

<li class="list-item">
<h4><a class="bold" href="abacavir.htm">Abacavir </a>   </h4>

Abacavir is an antiviral drug that is effective against the HIV-1 virus.</li>

代码如下：

   public static void main(String[] args) throws Exception {
        Map<String,String> drugLinks = new LinkedHashMap<String,String>();
        final int OK = 200;
        //String currentURL;
        //int page = 1;
        int status = OK;
        Connection.Response response = null;
        Document doc = null;
        String[] keywords = {"a","b","c","d","e","f","g","h","i","j","k","l","m","n","o","p","q","r","s","t","u","v","w","x","y","z"};
        //String keyword = "a";
        for (String keyword : keywords){
            final String url = "https://www.medindia.net/doctors/drug_information/home.asp?alpha=" + keyword;
                response = Jsoup.connect(url)
                        .userAgent("Mozilla/5.0")
                        .execute();
                status = response.statusCode();

                    doc = response.parse();


                            Element tds = doc.select("div.related-links.top-gray.col-list.clear-fix").first();

                            Elements links = tds.select("li[class=list-item]");

                                for (Element link : links){
                                    System.out.println("generic::"+link.select("a[href]").text());
                                    System.out.println("link::"+link.attr("abs:a"));
                }

            }
        }

输出

generic::Abacavir
link::
generic::Abacavir Sulfate and Lamivudine
link::
generic::Abacavir Sulfate, Lamivudine and Zidovudine
link::
generic::Abaloparatide
link::
generic::Abarelix
link::

如何从给定的 HTML 中获取绝对链接？

【问题讨论】：

标签： java web-scraping jsoup

【解决方案1】：

要从元素中获取链接，可以使用：

link.select("a").attr("href")

但是，这只会为您提供相对链接。完整链接为：

"https://www.medindia.net/doctors/drug_information/" + link.select("a").attr("href")

【讨论】：