使用谷歌等人工智能搜索 MySQL 的最佳方法

Question

我正在构建一个网络爬虫，它将爬取的结果收集到 MySQL 表中。

有五个主要列：URL, TITLE, DESCRIPTION, KEYWORDS, BODY。

目前我正在使用MySQL的FULLTEXT搜索功能如下：

SELECT URL,title, description, MATCH (description, keywords, title, URL) AGAINST ('$keyword' in boolean mode) 
AS score FROM record
WHERE MATCH (description, keywords, title, URL) AGAINST ('$keyword' in boolean mode) order by score desc;";

但这并没有给我带来好的结果。考虑下图。

这里，Facebook 在搜索 "Facebook" 时排名第 23 位。(?)

我可以根据列名优先搜索吗？例如，我希望查询将最大优先级分配给URL，然后是description，然后是title，keywords.. 最后是body。

有什么建议吗？

Answer 1

SELECT URL,title, description, MATCH (description, keywords, title, URL) AGAINST ('$keyword' in boolean mode) AS score FROM record WHERE URL LIKE '%$keyword%' OR MATCH (description, keywords, title, URL) AGAINST ('$keyword' in boolean mode) order by score desc;";

只需使用 LIKE 运算符进行 URL 匹配。见上面的代码。谢谢你！

Answer 2

看看像 SoundEx 这样的东西：

见：http://www.madirish.net/?article=85

另外你能不考虑自己做权重吗：（我没有本地 MySQL，很抱歉半伪代码）

SELECT 
    URL
    ,title
    , description
    , MATCH (URL) AGAINST ('$keyword' in boolean mode) AS urlscore 
    , MATCH (description) AGAINST ('$keyword' in boolean mode) AS descscore 
    , MATCH (title) AGAINST ('$keyword' in boolean mode) AS titlescore 
    , MATCH (body) AGAINST ('$keyword' in boolean mode) AS bodyscore 

    ,((MATCH (URL) AGAINST ('$keyword' in boolean mode))*4) 
    + ((MATCH (description) AGAINST ('$keyword' in boolean mode))*3) 
    + ((MATCH (title) AGAINST ('$keyword' in boolean mode))*2) 
    + ((MATCH (body) AGAINST ('$keyword' in boolean mode))*1)  as weightedscore
FROM    
    record
WHERE 
    MATCH (description, keywords, title, URL) AGAINST ('$keyword' in boolean mode) 
order by 
    ((MATCH (URL) AGAINST ('$keyword' in boolean mode))*4) 
    + ((MATCH (description) AGAINST ('$keyword' in boolean mode))*3) 
    + ((MATCH (title) AGAINST ('$keyword' in boolean mode))*2) 
    + ((MATCH (body) AGAINST ('$keyword' in boolean mode))*1)  desc;";