devbox
编程谜题解决者
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

干货：23 个示例，吃透ES！

作者：编程谜题解决者 | 2024-01-30 08:37:12

赞

踩

es示例

8d01448b319aaab3b00c679bddba3590.gif

为了说明Elasticsearch的不同查询类型，我们将搜索一个图书文档集合，其中有以下字段：标题、作者、摘要、发布日期和评论数量。但首先，让我们创建一个新的索引，并使用批量API索引一些文档：

  1. PUT /bookdb_index
  2.     { "settings": { "number_of_shards": 1 }}
  1. POST /bookdb_index/book/_bulk
  2.     { "index": { "_id": 1 }}
  3.     { "title": "Elasticsearch: The Definitive Guide", "authors": ["clinton gormley", "zachary tong"], "summary" : "A distibuted real-time search and analytics engine", "publish_date" : "2015-02-07", "num_reviews": 20, "publisher": "oreilly" }
  4.     { "index": { "_id": 2 }}
  5.     { "title": "Taming Text: How to Find, Organize, and Manipulate It", "authors": ["grant ingersoll", "thomas morton", "drew farris"], "summary" : "organize text using approaches such as full-text search, proper name recognition, clustering, tagging, information extraction, and summarization", "publish_date" : "2013-01-24", "num_reviews": 12, "publisher": "manning" }
  6.     { "index": { "_id": 3 }}
  7.     { "title": "Elasticsearch in Action", "authors": ["radu gheorge", "matthew lee hinman", "roy russo"], "summary" : "build scalable search applications using Elasticsearch without having to do complex low-level programming or understand advanced data science algorithms", "publish_date" : "2015-12-03", "num_reviews": 18, "publisher": "manning" }
  8.     { "index": { "_id": 4 }}
  9.     { "title": "Solr in Action", "authors": ["trey grainger", "timothy potter"], "summary" : "Comprehensive guide to implementing a scalable search engine using Apache Solr", "publish_date" : "2014-04-05", "num_reviews": 23, "publisher": "manning" }

实例

基本匹配查询

有两种执行基本全文（匹配）查询的方法：使用 Search Lite API，它希望所有搜索参数都作为 URL 的一部分传入，或者使用完整的 JSON 请求正文，它允许您使用完整的 Elasticsearch DSL。

这是一个在所有字段中搜索字符串“guide”的基本匹配查询：

  1. GET /bookdb_index/book/_search?q=guide
  2.  
  3.  
  4. [Results]
  5. "hits": [
  6.   {
  7.     "_index": "bookdb_index",
  8.     "_type": "book",
  9.     "_id": "4",
  10.     "_score": 1.3278645,
  11.     "_source": {
  12.       "title": "Solr in Action",
  13.       "authors": [
  14.         "trey grainger",
  15.         "timothy potter"
  16.       ],
  17.       "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  18.       "publish_date": "2014-04-05",
  19.       "num_reviews": 23,
  20.       "publisher": "manning"
  21.     }
  22.   },
  23.   {
  24.     "_index": "bookdb_index",
  25.     "_type": "book",
  26.     "_id": "1",
  27.     "_score": 1.2871116,
  28.     "_source": {
  29.       "title": "Elasticsearch: The Definitive Guide",
  30.       "authors": [
  31.         "clinton gormley",
  32.         "zachary tong"
  33.       ],
  34.       "summary": "A distibuted real-time search and analytics engine",
  35.       "publish_date": "2015-02-07",
  36.       "num_reviews": 20,
  37.       "publisher": "oreilly"
  38.     }
  39.   }
  40. ]

该查询的完整体版本如下所示，产生的结果与上述搜索精简版相同：

  1. {
  2.     "query": {
  3.         "multi_match" : {
  4.             "query" : "guide",
  5.             "fields" : ["title", "authors", "summary", "publish_date", "num_reviews", "publisher"]
  6.         }
  7.     }
  8. }

multi_match 关键字用于代替 match 关键字，作为对多个字段运行相同查询的便捷简写方式。 该 fields 属性指定要查询的字段，在这种情况下，我们要查询文档中的所有字段。

注意：在 ElasticSearch 6 之前，您可以使用“ _all”字段在所有字段中查找匹配项，而不必指定每个字段。" _all" 字段的工作原理是将所有字段连接成一个大字段，使用空格作为分隔符，然后对该字段进行分析和索引。在 ES6 中，默认情况下已弃用并禁用此功能。copy_to如果您有兴趣创建自定义“ _all”字段， ES6 提供了“ ”参数。有关详细信息，请参阅ElasticSearch 指南。

SearchLite API 还允许您指定要搜索的字段。例如，要搜索标题字段中带有“in Action”字样的书籍：

  1. GET /bookdb_index/book/_search?q=title:in action
  2. [Results]
  3. "hits": [
  4.   {
  5.     "_index": "bookdb_index",
  6.     "_type": "book",
  7.     "_id": "3",
  8.     "_score": 1.6323128,
  9.     "_source": {
  10.       "title": "Elasticsearch in Action",
  11.       "authors": [
  12.         "radu gheorge",
  13.         "matthew lee hinman",
  14.         "roy russo"
  15.       ],
  16.       "summary": "build scalable search applications using Elasticsearch without having to do complex low-level programming or understand advanced data science algorithms",
  17.       "publish_date": "2015-12-03",
  18.       "num_reviews": 18,
  19.       "publisher": "manning"
  20.     }
  21.   },
  22.   {
  23.     "_index": "bookdb_index",
  24.     "_type": "book",
  25.     "_id": "4",
  26.     "_score": 1.6323128,
  27.     "_source": {
  28.       "title": "Solr in Action",
  29.       "authors": [
  30.         "trey grainger",
  31.         "timothy potter"
  32.       ],
  33.       "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  34.       "publish_date": "2014-04-05",
  35.       "num_reviews": 23,
  36.       "publisher": "manning"
  37.     }
  38.   }
  39. ]

但是，完整的 DSL 在创建更复杂的查询（我们将在后面看到）和指定如何返回结果方面为您提供了更大的灵活性。在下面的示例中，我们指定了我们想要返回的结果的数量、开始的偏移量（用于分页）、我们想要返回的文档字段以及术语突出显示。请注意，我们使用“ match”查询而不是“ multi_match”查询，因为我们只关心在标题字段中进行搜索。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "match" : {
  5.             "title" : "in action"
  6.         }
  7.     },
  8.     "size": 2,
  9.     "from": 0,
  10.     "_source": [ "title", "summary", "publish_date" ],
  11.     "highlight": {
  12.         "fields" : {
  13.             "title" : {}
  14.         }
  15.     }
  16. }
  17.  
  18.  
  19. [Results]
  20. "hits": {
  21.   "total": 2,
  22.   "max_score": 1.6323128,
  23.   "hits": [
  24.     {
  25.       "_index": "bookdb_index",
  26.       "_type": "book",
  27.       "_id": "3",
  28.       "_score": 1.6323128,
  29.       "_source": {
  30.         "summary": "build scalable search applications using Elasticsearch without having to do complex low-level programming or understand advanced data science algorithms",
  31.         "title": "Elasticsearch in Action",
  32.         "publish_date": "2015-12-03"
  33.       },
  34.       "highlight": {
  35.         "title": [
  36.           "Elasticsearch <em>in</em> <em>Action</em>"
  37.         ]
  38.       }
  39.     },
  40.     {
  41.       "_index": "bookdb_index",
  42.       "_type": "book",
  43.       "_id": "4",
  44.       "_score": 1.6323128,
  45.       "_source": {
  46.         "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  47.         "title": "Solr in Action",
  48.         "publish_date": "2014-04-05"
  49.       },
  50.       "highlight": {
  51.         "title": [
  52.           "Solr <em>in</em> <em>Action</em>"
  53.         ]
  54.       }
  55.     }
  56.   ]

注意：对于多词查询， match 查询允许您指定是否使用 and 运算符而不是默认 or 运算符。您还可以指定 minimum_should_match 选项来调整返回结果的相关性。详细信息可以在 Elasticsearch 指南中找到。

提升

由于我们正在跨多个领域进行搜索，因此我们可能希望提高某个领域的分数。在下面的人为示例中，我们将摘要字段的分数提高了 3 倍，以增加摘要字段的重要性，这反过来又会增加文档的相关性 _id 4。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "multi_match" : {
  5.             "query" : "elasticsearch guide",
  6.             "fields": ["title", "summary^3"]
  7.         }
  8.     },
  9.     "_source": ["title", "summary", "publish_date"]
  10. }
  11.  
  12.  
  13. [Results]
  14. "hits": {
  15.   "total": 3,
  16.   "max_score": 3.9835935,
  17.   "hits": [
  18.     {
  19.       "_index": "bookdb_index",
  20.       "_type": "book",
  21.       "_id": "4",
  22.       "_score": 3.9835935,
  23.       "_source": {
  24.         "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  25.         "title": "Solr in Action",
  26.         "publish_date": "2014-04-05"
  27.       }
  28.     },
  29.     {
  30.       "_index": "bookdb_index",
  31.       "_type": "book",
  32.       "_id": "3",
  33.       "_score": 3.1001682,
  34.       "_source": {
  35.         "summary": "build scalable search applications using Elasticsearch without having to do complex low-level programming or understand advanced data science algorithms",
  36.         "title": "Elasticsearch in Action",
  37.         "publish_date": "2015-12-03"
  38.       }
  39.     },
  40.     {
  41.       "_index": "bookdb_index",
  42.       "_type": "book",
  43.       "_id": "1",
  44.       "_score": 2.0281231,
  45.       "_source": {
  46.         "summary": "A distibuted real-time search and analytics engine",
  47.         "title": "Elasticsearch: The Definitive Guide",
  48.         "publish_date": "2015-02-07"
  49.       }
  50.     }
  51.   ]

注意：提升不仅仅意味着计算的分数乘以提升因子。应用的实际提升值经过标准化和一些内部优化。有关提升工作原理的更多信息，请参阅Elasticsearch 指南。

布尔查询

AND/OR/NOT 运算符可用于微调我们的搜索查询，以提供更相关或更具体的结果。这是在搜索 API 中作为 bool 查询实现的。该 bool 查询接受一个 must 参数（相当于 AND）、一个 must_not 参数（相当于 NOT）和一个 should 参数（相当于 OR）。例如，如果我想搜索标题中包含“Elasticsearch”或“Solr”一词的书，并且作者是“clinton gormley”，但不是“radu gheorge”：

  1. POST /bookdb_index/book/_search
  2. {
  3.   "query": {
  4.     "bool": {
  5.       "must": {
  6.         "bool" : { 
  7.           "should": [
  8.             { "match": { "title": "Elasticsearch" }},
  9.             { "match": { "title": "Solr" }} 
  10.           ],
  11.           "must": { "match": { "authors": "clinton gormely" }} 
  12.         }
  13.       },
  14.       "must_not": { "match": {"authors": "radu gheorge" }}
  15.     }
  16.   }
  17. }
  18.  
  19.  
  20. [Results]
  21. "hits": [
  22.   {
  23.     "_index": "bookdb_index",
  24.     "_type": "book",
  25.     "_id": "1",
  26.     "_score": 2.0749094,
  27.     "_source": {
  28.       "title": "Elasticsearch: The Definitive Guide",
  29.       "authors": [
  30.         "clinton gormley",
  31.         "zachary tong"
  32.       ],
  33.       "summary": "A distibuted real-time search and analytics engine",
  34.       "publish_date": "2015-02-07",
  35.       "num_reviews": 20,
  36.       "publisher": "oreilly"
  37.     }
  38.   }
  39. ]

注意：如您所见，bool 查询可以包装任何其他查询类型，包括其他 bool 查询，以创建任意复杂或深度嵌套的查询。

模糊查询

可以在 Match 和 Multi-Match 查询上启用模糊匹配以捕获拼写错误。模糊程度是根据与原始单词的Levenshtein 距离来指定的，即需要对一个字符串进行单个字符更改以使其与另一个字符串相同的次数。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "multi_match" : {
  5.             "query" : "comprihensiv guide",
  6.             "fields": ["title", "summary"],
  7.             "fuzziness": "AUTO"
  8.         }
  9.     },
  10.     "_source": ["title", "summary", "publish_date"],
  11.     "size": 1
  12. }
  13.  
  14.  
  15. [Results]
  16. "hits": [
  17.   {
  18.     "_index": "bookdb_index",
  19.     "_type": "book",
  20.     "_id": "4",
  21.     "_score": 2.4344182,
  22.     "_source": {
  23.       "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  24.       "title": "Solr in Action",
  25.       "publish_date": "2014-04-05"
  26.     }
  27.   }
  28. ]

注意： 您可以指定数字 0、1 或 2 而不是指定“AUTO”，以指示可以对字符串进行的最大编辑次数以找到匹配项。使用“AUTO”的好处是它考虑了字符串的长度。对于只有 3 个字符长的字符串，允许模糊度为 2 将导致搜索性能不佳。因此，建议在大多数情况下坚持“自动”。

通配符查询

通配符查询允许您指定要匹配的模式而不是整个术语。 ? 匹配任何字符并 * 匹配零个或多个字符。例如，要查找作者姓名以字母“t”开头的所有记录：

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "wildcard" : {
  5.             "authors" : "t*"
  6.         }
  7.     },
  8.     "_source": ["title", "authors"],
  9.     "highlight": {
  10.         "fields" : {
  11.             "authors" : {}
  12.         }
  13.     }
  14. }
  15.  
  16.  
  17. [Results]
  18. "hits": [
  19.   {
  20.     "_index": "bookdb_index",
  21.     "_type": "book",
  22.     "_id": "1",
  23.     "_score": 1,
  24.     "_source": {
  25.       "title": "Elasticsearch: The Definitive Guide",
  26.       "authors": [
  27.         "clinton gormley",
  28.         "zachary tong"
  29.       ]
  30.     },
  31.     "highlight": {
  32.       "authors": [
  33.         "zachary <em>tong</em>"
  34.       ]
  35.     }
  36.   },
  37.   {
  38.     "_index": "bookdb_index",
  39.     "_type": "book",
  40.     "_id": "2",
  41.     "_score": 1,
  42.     "_source": {
  43.       "title": "Taming Text: How to Find, Organize, and Manipulate It",
  44.       "authors": [
  45.         "grant ingersoll",
  46.         "thomas morton",
  47.         "drew farris"
  48.       ]
  49.     },
  50.     "highlight": {
  51.       "authors": [
  52.         "<em>thomas</em> morton"
  53.       ]
  54.     }
  55.   },
  56.   {
  57.     "_index": "bookdb_index",
  58.     "_type": "book",
  59.     "_id": "4",
  60.     "_score": 1,
  61.     "_source": {
  62.       "title": "Solr in Action",
  63.       "authors": [
  64.         "trey grainger",
  65.         "timothy potter"
  66.       ]
  67.     },
  68.     "highlight": {
  69.       "authors": [
  70.         "<em>trey</em> grainger",
  71.         "<em>timothy</em> potter"
  72.       ]
  73.     }
  74.   }
  75. ]

正则表达式查询

正则表达式查询允许您指定比通配符查询更复杂的模式。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "regexp" : {
  5.             "authors" : "t[a-z]*y"
  6.         }
  7.     },
  8.     "_source": ["title", "authors"],
  9.     "highlight": {
  10.         "fields" : {
  11.             "authors" : {}
  12.         }
  13.     }
  14. }
  15.  
  16.  
  17. [Results]
  18. "hits": [
  19.   {
  20.     "_index": "bookdb_index",
  21.     "_type": "book",
  22.     "_id": "4",
  23.     "_score": 1,
  24.     "_source": {
  25.       "title": "Solr in Action",
  26.       "authors": [
  27.         "trey grainger",
  28.         "timothy potter"
  29.       ]
  30.     },
  31.     "highlight": {
  32.       "authors": [
  33.         "<em>trey</em> grainger",
  34.         "<em>timothy</em> potter"
  35.       ]
  36.     }
  37.   }
  38. ]

匹配词组查询

匹配短语查询要求查询字符串中的所有术语都存在于文档中，按照查询字符串中指定的顺序并且彼此靠近。默认情况下，这些术语需要彼此完全相邻，但您可以指定一个值，该 slop 值指示在仍将文档视为匹配项的同时允许术语相距多远。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "multi_match" : {
  5.             "query": "search engine",
  6.             "fields": ["title", "summary"],
  7.             "type": "phrase",
  8.             "slop": 3
  9.         }
  10.     },
  11.     "_source": [ "title", "summary", "publish_date" ]
  12. }
  13.  
  14.  
  15. [Results]
  16. "hits": [
  17.       {
  18.         "_index": "bookdb_index",
  19.         "_type": "book",
  20.         "_id": "4",
  21.         "_score": 0.22327082,
  22.         "_source": {
  23.           "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  24.           "title": "Solr in Action",
  25.           "publish_date": "2014-04-05"
  26.         }
  27.       },
  28.       {
  29.         "_index": "bookdb_index",
  30.         "_type": "book",
  31.         "_id": "1",
  32.         "_score": 0.16113183,
  33.         "_source": {
  34.           "summary": "A distibuted real-time search and analytics engine",
  35.           "title": "Elasticsearch: The Definitive Guide",
  36.           "publish_date": "2015-02-07"
  37.         }
  38.       }
  39.     ]

注意：在上面的例子中，对于一个非短语类型的查询，文档 _id 1 通常会有更高的分数并且出现在文档之前， _id 4 因为它的字段长度更短。然而，作为一个短语查询，术语的接近度被考虑在内，因此文档 _id 4 得分更好。

注意：还要注意，如果 slop 参数减少到 1 个文档 _id 1 将不再出现在结果集中。

匹配短语前缀

匹配短语前缀查询在查询时提供“即用型搜索”或“穷人版本”的自动完成功能，无需以任何方式准备数据。像 match_phrase 查询一样，它接受一个 slop 参数来使词序和相对位置不那么严格。它还接受 max_expansions 参数来限制匹配的术语数量，以降低资源强度。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "match_phrase_prefix" : {
  5.             "summary": {
  6.                 "query": "search en",
  7.                 "slop": 3,
  8.                 "max_expansions": 10
  9.             }
  10.         }
  11.     },
  12.     "_source": [ "title", "summary", "publish_date" ]
  13. }
  14.  
  15.  
  16. [Results]
  17. "hits": [
  18.       {
  19.         "_index": "bookdb_index",
  20.         "_type": "book",
  21.         "_id": "4",
  22.         "_score": 0.5161346,
  23.         "_source": {
  24.           "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  25.           "title": "Solr in Action",
  26.           "publish_date": "2014-04-05"
  27.         }
  28.       },
  29.       {
  30.         "_index": "bookdb_index",
  31.         "_type": "book",
  32.         "_id": "1",
  33.         "_score": 0.37248808,
  34.         "_source": {
  35.           "summary": "A distibuted real-time search and analytics engine",
  36.           "title": "Elasticsearch: The Definitive Guide",
  37.           "publish_date": "2015-02-07"
  38.         }
  39.       }
  40.     ]

注意：查询时搜索即键入会产生性能成本。更好的解决方案是索引时搜索，即键入。查看Completion Suggester API或使用Edge-Ngram 过滤器了解更多信息。

请求参数

该 query_string 查询提供了一种以简洁的速记语法执行 multi_match 查询、布尔查询、提升、模糊匹配、通配符、正则表达式和范围查询的方法。在下面的示例中，我们对术语“搜索算法”执行模糊搜索，其中书籍作者之一是“grant ingersoll”或“tom morton”。我们搜索所有字段，但对汇总字段应用 2 的提升。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "query_string" : {
  5.             "query": "(saerch~1 algorithm~1) AND (grant ingersoll)  OR (tom morton)",
  6.             "fields": ["title", "authors" , "summary^2"]
  7.         }
  8.     },
  9.     "_source": [ "title", "summary", "authors" ],
  10.     "highlight": {
  11.         "fields" : {
  12.             "summary" : {}
  13.         }
  14.     }
  15. }
  16.  
  17.  
  18. [Results]
  19. "hits": [
  20.   {
  21.     "_index": "bookdb_index",
  22.     "_type": "book",
  23.     "_id": "2",
  24.     "_score": 3.571021,
  25.     "_source": {
  26.       "summary": "organize text using approaches such as full-text search, proper name recognition, clustering, tagging, information extraction, and summarization",
  27.       "title": "Taming Text: How to Find, Organize, and Manipulate It",
  28.       "authors": [
  29.         "grant ingersoll",
  30.         "thomas morton",
  31.         "drew farris"
  32.       ]
  33.     },
  34.     "highlight": {
  35.       "summary": [
  36.         "organize text using approaches such as full-text <em>search</em>, proper name recognition, clustering, tagging"
  37.       ]
  38.     }
  39.   }
  40. ]

简单查询字符串

 查询是更适合在向用户公开的单个搜索框中使用的查询版本，因为它将 AND/OR/NOT 的使用分别替换为 +/|/-，并丢弃了无效 simple_query_string 部分 query_string如果用户出错，则查询而不是抛出异常。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "simple_query_string" : {
  5.             "query": "(saerch~1 algorithm~1) + (grant ingersoll)  | (tom morton)",
  6.             "fields": ["title", "authors" , "summary^2"]
  7.         }
  8.     },
  9.     "_source": [ "title", "summary", "authors" ],
  10.     "highlight": {
  11.         "fields" : {
  12.             "summary" : {}
  13.         }
  14.     }
  15. }

名词/术语查询

上面的例子都是全文搜索的例子。有时我们对结构化搜索更感兴趣，我们希望在其中找到完全匹配并返回结果。term 和 查询在 terms 这里帮助我们。在下面的示例中，我们正在搜索由 Manning Publications 出版的索引中的所有书籍。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "term" : {
  5.             "publisher": "manning"
  6.         }
  7.     },
  8.     "_source" : ["title","publish_date","publisher"]
  9. }
  10.  
  11.  
  12. [Results]
  13. "hits": [
  14.       {
  15.         "_index": "bookdb_index",
  16.         "_type": "book",
  17.         "_id": "2",
  18.         "_score": 1.2231436,
  19.         "_source": {
  20.           "publisher": "manning",
  21.           "title": "Taming Text: How to Find, Organize, and Manipulate It",
  22.           "publish_date": "2013-01-24"
  23.         }
  24.       },
  25.       {
  26.         "_index": "bookdb_index",
  27.         "_type": "book",
  28.         "_id": "3",
  29.         "_score": 1.2231436,
  30.         "_source": {
  31.           "publisher": "manning",
  32.           "title": "Elasticsearch in Action",
  33.           "publish_date": "2015-12-03"
  34.         }
  35.       },
  36.       {
  37.         "_index": "bookdb_index",
  38.         "_type": "book",
  39.         "_id": "4",
  40.         "_score": 1.2231436,
  41.         "_source": {
  42.           "publisher": "manning",
  43.           "title": "Solr in Action",
  44.           "publish_date": "2014-04-05"
  45.         }
  46.       }
  47.     ]

可以通过使用 terms 关键字并传入搜索词数组来指定多个词。

  1. {
  2.     "query": {
  3.         "terms" : {
  4.             "publisher": ["oreilly", "packt"]
  5.         }
  6.     }
  7. }

术语查询 - 排序

术语查询结果（与任何其他查询结果一样）可以轻松排序。也允许多级排序。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "term" : {
  5.             "publisher": "manning"
  6.         }
  7.     },
  8.     "_source" : ["title","publish_date","publisher"],
  9.     "sort": [
  10.         { "publish_date": {"order":"desc"}}
  11.     ]
  12. }
  13.  
  14.  
  15. [Results]
  16. "hits": [
  17.   {
  18.     "_index": "bookdb_index",
  19.     "_type": "book",
  20.     "_id": "3",
  21.     "_score": null,
  22.     "_source": {
  23.       "publisher": "manning",
  24.       "title": "Elasticsearch in Action",
  25.       "publish_date": "2015-12-03"
  26.     },
  27.     "sort": [
  28.       1449100800000
  29.     ]
  30.   },
  31.   {
  32.     "_index": "bookdb_index",
  33.     "_type": "book",
  34.     "_id": "4",
  35.     "_score": null,
  36.     "_source": {
  37.       "publisher": "manning",
  38.       "title": "Solr in Action",
  39.       "publish_date": "2014-04-05"
  40.     },
  41.     "sort": [
  42.       1396656000000
  43.     ]
  44.   },
  45.   {
  46.     "_index": "bookdb_index",
  47.     "_type": "book",
  48.     "_id": "2",
  49.     "_score": null,
  50.     "_source": {
  51.       "publisher": "manning",
  52.       "title": "Taming Text: How to Find, Organize, and Manipulate It",
  53.       "publish_date": "2013-01-24"
  54.     },
  55.     "sort": [
  56.       1358985600000
  57.     ]
  58.   }
  59. ]

注意：在 ES6 中，要按文本字段（例如标题）进行排序或聚合，您需要在该字段上启用 fielddata。有关这方面的更多详细信息，请参阅ElasticSearch 指南。 

范围查询

另一个结构化查询示例是范围查询。在此示例中，我们搜索 2015 年出版的书籍。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "range" : {
  5.             "publish_date": {
  6.                 "gte": "2015-01-01",
  7.                 "lte": "2015-12-31"
  8.             }
  9.         }
  10.     },
  11.     "_source" : ["title","publish_date","publisher"]
  12. }
  13.  
  14.  
  15. [Results]
  16. "hits": [
  17.       {
  18.         "_index": "bookdb_index",
  19.         "_type": "book",
  20.         "_id": "1",
  21.         "_score": 1,
  22.         "_source": {
  23.           "publisher": "oreilly",
  24.           "title": "Elasticsearch: The Definitive Guide",
  25.           "publish_date": "2015-02-07"
  26.         }
  27.       },
  28.       {
  29.         "_index": "bookdb_index",
  30.         "_type": "book",
  31.         "_id": "3",
  32.         "_score": 1,
  33.         "_source": {
  34.           "publisher": "manning",
  35.           "title": "Elasticsearch in Action",
  36.           "publish_date": "2015-12-03"
  37.         }
  38.       }
  39.     ]

注意：范围查询适用于日期、数字和字符串类型字段。

过滤布尔查询

使用 bool 查询时，您可以使用 filter 子句来过滤查询结果。在我们的示例中，我们正在查询标题或摘要中包含“Elasticsearch”一词的书籍，但我们希望将结果过滤为仅包含 20 条或更多评论的书籍。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "filtered": {
  5.             "query" : {
  6.                 "multi_match": {
  7.                     "query": "elasticsearch",
  8.                     "fields": ["title","summary"]
  9.                 }
  10.             },
  11.             "filter": {
  12.                 "range" : {
  13.                     "num_reviews": {
  14.                         "gte": 20
  15.                     }
  16.                 }
  17.             }
  18.         }
  19.     },
  20.     "_source" : ["title","summary","publisher", "num_reviews"]
  21. }
  22.  
  23.  
  24. [Results]
  25. "hits": [
  26.       {
  27.         "_index": "bookdb_index",
  28.         "_type": "book",
  29.         "_id": "1",
  30.         "_score": 0.5955761,
  31.         "_source": {
  32.           "summary": "A distibuted real-time search and analytics engine",
  33.           "publisher": "oreilly",
  34.           "num_reviews": 20,
  35.           "title": "Elasticsearch: The Definitive Guide"
  36.         }
  37.       }
  38.     ]

通过使用过滤器可以组合多个过滤 bool 器。在下一个示例中，过滤器确定返回的结果必须至少有 20 条评论，不得在 2015 年之前发布，并且应该由 O'Reilly 发布。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "filtered": {
  5.             "query" : {
  6.                 "multi_match": {
  7.                     "query": "elasticsearch",
  8.                     "fields": ["title","summary"]
  9.                 }
  10.             },
  11.             "filter": {
  12.                 "bool": {
  13.                     "must": {
  14.                         "range" : { "num_reviews": { "gte": 20 } }
  15.                     },
  16.                     "must_not": {
  17.                         "range" : { "publish_date": { "lte": "2014-12-31" } }
  18.                     },
  19.                     "should": {
  20.                         "term": { "publisher": "oreilly" }
  21.                     }
  22.                 }
  23.             }
  24.         }
  25.     },
  26.     "_source" : ["title","summary","publisher", "num_reviews", "publish_date"]
  27. }
  28.  
  29.  
  30. [Results]
  31. "hits": [
  32.       {
  33.         "_index": "bookdb_index",
  34.         "_type": "book",
  35.         "_id": "1",
  36.         "_score": 0.5955761,
  37.         "_source": {
  38.           "summary": "A distibuted real-time search and analytics engine",
  39.           "publisher": "oreilly",
  40.           "num_reviews": 20,
  41.           "title": "Elasticsearch: The Definitive Guide",
  42.           "publish_date": "2015-02-07"
  43.         }
  44.       }
  45.     ]

功能得分：字段值因子

在某些情况下，您可能希望将文档中特定字段的值考虑到相关性分数的计算中。这在您希望根据其受欢迎程度提高文档相关性的情况下很典型。在我们的示例中，我们希望提升更受欢迎的书籍（根据评论数量来判断）。这可以使用 field_value_factor 函数 score。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "function_score": {
  5.             "query": {
  6.                 "multi_match" : {
  7.                     "query" : "search engine",
  8.                     "fields": ["title", "summary"]
  9.                 }
  10.             },
  11.             "field_value_factor": {
  12.                 "field" : "num_reviews",
  13.                 "modifier": "log1p",
  14.                 "factor" : 2
  15.             }
  16.         }
  17.     },
  18.     "_source": ["title", "summary", "publish_date", "num_reviews"]
  19. }
  20.  
  21.  
  22. [Results]
  23. "hits": [
  24.       {
  25.         "_index": "bookdb_index",
  26.         "_type": "book",
  27.         "_id": "1",
  28.         "_score": 0.44831306,
  29.         "_source": {
  30.           "summary": "A distibuted real-time search and analytics engine",
  31.           "num_reviews": 20,
  32.           "title": "Elasticsearch: The Definitive Guide",
  33.           "publish_date": "2015-02-07"
  34.         }
  35.       },
  36.       {
  37.         "_index": "bookdb_index",
  38.         "_type": "book",
  39.         "_id": "4",
  40.         "_score": 0.3718407,
  41.         "_source": {
  42.           "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  43.           "num_reviews": 23,
  44.           "title": "Solr in Action",
  45.           "publish_date": "2014-04-05"
  46.         }
  47.       },
  48.       {
  49.         "_index": "bookdb_index",
  50.         "_type": "book",
  51.         "_id": "3",
  52.         "_score": 0.046479136,
  53.         "_source": {
  54.           "summary": "build scalable search applications using Elasticsearch without having to do complex low-level programming or understand advanced data science algorithms",
  55.           "num_reviews": 18,
  56.           "title": "Elasticsearch in Action",
  57.           "publish_date": "2015-12-03"
  58.         }
  59.       },
  60.       {
  61.         "_index": "bookdb_index",
  62.         "_type": "book",
  63.         "_id": "2",
  64.         "_score": 0.041432835,
  65.         "_source": {
  66.           "summary": "organize text using approaches such as full-text search, proper name recognition, clustering, tagging, information extraction, and summarization",
  67.           "num_reviews": 12,
  68.           "title": "Taming Text: How to Find, Organize, and Manipulate It",
  69.           "publish_date": "2013-01-24"
  70.         }
  71.       }
  72.     ]

注意 1：我们可以只运行常规 multi_match 查询并按 num_reviews 字段排序，但随后我们失去了相关性评分的好处。

注意 2：还有许多附加参数可以调整对原始相关性分数的提升效果，例如“修饰符”、“因子”、“提升模式”等。这些在Elasticsearch 指南中进行了详细探讨。

函数得分：衰减函数

假设您不想通过字段的值递增地提升，而是有一个想要定位的理想值，并且您希望提升因子随着您远离该值而衰减。这通常在基于纬度/经度、价格或日期等数字字段的提升中很有用。在我们设计的示例中，我们正在搜索最好在 2014 年 6 月左右出版的关于“搜索引擎”的书籍。

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "function_score": {
  5.             "query": {
  6.                 "multi_match" : {
  7.                     "query" : "search engine",
  8.                     "fields": ["title", "summary"]
  9.                 }
  10.             },
  11.             "functions": [
  12.                 {
  13.                     "exp": {
  14.                         "publish_date" : {
  15.                             "origin": "2014-06-15",
  16.                             "offset": "7d",
  17.                             "scale" : "30d"
  18.                         }
  19.                     }
  20.                 }
  21.             ],
  22.             "boost_mode" : "replace"
  23.         }
  24.     },
  25.     "_source": ["title", "summary", "publish_date", "num_reviews"]
  26. }
  27.  
  28.  
  29. [Results]
  30. "hits": [
  31.       {
  32.         "_index": "bookdb_index",
  33.         "_type": "book",
  34.         "_id": "4",
  35.         "_score": 0.27420625,
  36.         "_source": {
  37.           "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  38.           "num_reviews": 23,
  39.           "title": "Solr in Action",
  40.           "publish_date": "2014-04-05"
  41.         }
  42.       },
  43.       {
  44.         "_index": "bookdb_index",
  45.         "_type": "book",
  46.         "_id": "1",
  47.         "_score": 0.005920768,
  48.         "_source": {
  49.           "summary": "A distibuted real-time search and analytics engine",
  50.           "num_reviews": 20,
  51.           "title": "Elasticsearch: The Definitive Guide",
  52.           "publish_date": "2015-02-07"
  53.         }
  54.       },
  55.       {
  56.         "_index": "bookdb_index",
  57.         "_type": "book",
  58.         "_id": "2",
  59.         "_score": 0.000011564,
  60.         "_source": {
  61.           "summary": "organize text using approaches such as full-text search, proper name recognition, clustering, tagging, information extraction, and summarization",
  62.           "num_reviews": 12,
  63.           "title": "Taming Text: How to Find, Organize, and Manipulate It",
  64.           "publish_date": "2013-01-24"
  65.         }
  66.       },
  67.       {
  68.         "_index": "bookdb_index",
  69.         "_type": "book",
  70.         "_id": "3",
  71.         "_score": 0.0000059171475,
  72.         "_source": {
  73.           "summary": "build scalable search applications using Elasticsearch without having to do complex low-level programming or understand advanced data science algorithms",
  74.           "num_reviews": 18,
  75.           "title": "Elasticsearch in Action",
  76.           "publish_date": "2015-12-03"
  77.         }
  78.       }
  79.     ]


功能评分：脚本评分

如果内置评分功能不能满足您的需求，可以选择指定一个 Groovy 脚本用于评分。在我们的示例中，我们希望指定一个脚本， publish_date 在决定将多少因素考虑到评论数量之前将其考虑在内。较新的书籍可能还没有那么多评论，所以他们不应该因此受到惩罚。

评分脚本如下所示：

  1. publish_date = doc['publish_date'].value
  2. num_reviews = doc['num_reviews'].value
  3.  
  4.  
  5. if (publish_date > Date.parse('yyyy-MM-dd', threshold).getTime()) {
  6.   my_score = Math.log(2.5 + num_reviews)
  7. } else {
  8.   my_score = Math.log(1 + num_reviews)
  9. }
  10. return my_score

要动态使用评分脚本，我们使用以下 script_score 参数：

  1. POST /bookdb_index/book/_search
  2. {
  3.     "query": {
  4.         "function_score": {
  5.             "query": {
  6.                 "multi_match" : {
  7.                     "query" : "search engine",
  8.                     "fields": ["title", "summary"]
  9.                 }
  10.             },
  11.             "functions": [
  12.                 {
  13.                     "script_score": {
  14.                         "params" : {
  15.                             "threshold": "2015-07-30"
  16.                         },
  17.                         "script": "publish_date = doc['publish_date'].value; num_reviews = doc['num_reviews'].value; if (publish_date > Date.parse('yyyy-MM-dd', threshold).getTime()) { return log(2.5 + num_reviews) }; return log(1 + num_reviews);"
  18.                     }
  19.                 }
  20.             ]
  21.         }
  22.     },
  23.     "_source": ["title", "summary", "publish_date", "num_reviews"]
  24. }
  25.  
  26.  
  27. [Results]
  28. "hits": {
  29.     "total": 4,
  30.     "max_score": 0.8463001,
  31.     "hits": [
  32.       {
  33.         "_index": "bookdb_index",
  34.         "_type": "book",
  35.         "_id": "1",
  36.         "_score": 0.8463001,
  37.         "_source": {
  38.           "summary": "A distibuted real-time search and analytics engine",
  39.           "num_reviews": 20,
  40.           "title": "Elasticsearch: The Definitive Guide",
  41.           "publish_date": "2015-02-07"
  42.         }
  43.       },
  44.       {
  45.         "_index": "bookdb_index",
  46.         "_type": "book",
  47.         "_id": "4",
  48.         "_score": 0.7067348,
  49.         "_source": {
  50.           "summary": "Comprehensive guide to implementing a scalable search engine using Apache Solr",
  51.           "num_reviews": 23,
  52.           "title": "Solr in Action",
  53.           "publish_date": "2014-04-05"
  54.         }
  55.       },
  56.       {
  57.         "_index": "bookdb_index",
  58.         "_type": "book",
  59.         "_id": "3",
  60.         "_score": 0.08952084,
  61.         "_source": {
  62.           "summary": "build scalable search applications using Elasticsearch without having to do complex low-level programming or understand advanced data science algorithms",
  63.           "num_reviews": 18,
  64.           "title": "Elasticsearch in Action",
  65.           "publish_date": "2015-12-03"
  66.         }
  67.       },
  68.       {
  69.         "_index": "bookdb_index",
  70.         "_type": "book",
  71.         "_id": "2",
  72.         "_score": 0.07602123,
  73.         "_source": {
  74.           "summary": "organize text using approaches such as full-text search, proper name recognition, clustering, tagging, information extraction, and summarization",
  75.           "num_reviews": 12,
  76.           "title": "Taming Text: How to Find, Organize, and Manipulate It",
  77.           "publish_date": "2013-01-24"
  78.         }
  79.       }
  80.     ]
  81.   }

注意 1：要使用动态脚本，必须在 config/elasticsearch.yaml 文件中为您的 Elasticsearch 实例启用它。也可以使用存储在 Elasticsearch 服务器上的脚本。查看Elasticsearch 参考文档了解更多信息。

注意 2： JSON 不能包含嵌入的换行符，因此分号用于分隔语句。

推荐阅读：《深入理解Elasticsearch》


推荐理由：资深软件开发专家、架构师撰写，从设计原理、部署调优、高级特性、扩展开发等方面助你全面进阶。

75149ad2315de4e0544a5bc482637885.gif

更多精彩回顾

  1. 书讯 |8月书讯（上） | 重磅新书来袭！书讯 |8月书讯（下） | 重磅新书来袭！资讯 |《Java核心技术》基于Java 17全面升级！干货 |再见了Java8，Java17：我要取代你干货 | 李三红：Java版本升级需要纳入到可持续性维度
  2. 干货 |市面上的大前端岗位到底是做什么的？

667735e85f1cb0768b37cc7fcd98b66c.gif

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/article/detail/45829
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号