Field-length norm

How long is the field? body field. The field length norm is calculated as follows:

norm(d) = 1 / √numTerms 
ES搜索排序,文档相关度评分介绍——Field-length norm

ES搜索排序,文档相关度评分介绍——Field-length norm

The field-length norm (norm) is the inverse square root of the number of terms in the field.

While the field-length analyzed fields as well:

PUT /my_index
{
  "mappings": {
    "doc": {
      "properties": {
        "text": {
          "type": "string",
          "norms": { "enabled": false } 
        }
      }
    }
  }
}

ES搜索排序,文档相关度评分介绍——Field-length norm

This field will not take the field-length norm into account. A long field and a short field will be scored as if they were the same length.

For use cases such as logging, norms are not useful. All you care about is whether a field contains a particular error code or a particular browser identifier. The length of the field does not affect the outcome. Disabling norms can save a significant amount of memory.

Putting it together

These three factors—term frequency, inverse document frequency, and field-length norm—are calculated and stored at index time.weight of a single term in a particular document.

ES搜索排序,文档相关度评分介绍——Field-length norm

When we refer to documents in the preceding formulae, we are actually talking about a field within a document. Each field has its own inverted index and thus, for TF/IDF purposes, the value of the field is the value of the document.

When we run a simple term query with explain set to true (see Understanding the Score), you will see that the only factors involved in calculating the score are the ones explained in the preceding sections:

PUT /my_index/doc/1
{ "text" : "quick brown fox" }

GET /my_index/doc/_search?explain
{
  "query": {
    "term": {
      "text": "fox"
    }
  }
}

The (abbreviated) explanation from the preceding request is as follows:

weight(text:fox in 0) [PerFieldSimilarity]:  0.15342641 
ES搜索排序,文档相关度评分介绍——Field-length norm
result of:
    fieldWeight in 0                         0.15342641
    product of:
        tf(freq=1.0), with freq of 1:        1.0 
ES搜索排序,文档相关度评分介绍——Field-length norm
        idf(docFreq=1, maxDocs=1):           0.30685282 
ES搜索排序,文档相关度评分介绍——Field-length norm
        fieldNorm(doc=0):                    0.5 
ES搜索排序,文档相关度评分介绍——Field-length norm

ES搜索排序,文档相关度评分介绍——Field-length norm

The final score for term fox in field text in the document with internal Lucene doc ID 0.

ES搜索排序,文档相关度评分介绍——Field-length norm

The term fox appears once in the text field in this document.

ES搜索排序,文档相关度评分介绍——Field-length norm

The inverse document frequency of fox in the text field in all documents in this index.

ES搜索排序,文档相关度评分介绍——Field-length norm

The field-length normalization factor for this field.

Of course, queries usually consist of more than one term, so we need a way of combining the weights of multiple terms. For this, we turn to the vector space model.

 

 

相关文章: