devbox
爱喝兽奶帝天荒
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

Elasticsearch8搭建及Springboot中集成使用_springboot elasticsearch8

作者：爱喝兽奶帝天荒 | 2024-08-13 11:02:23

赞

踩

springboot elasticsearch8

1.搭建

1.1.下载地址

Elasticsearch：https://www.elastic.co/cn/downloads/elasticsearch
Kibana：https://www.elastic.co/cn/downloads/kibana

1.2.具体过程

下载安装包：访问上述链接，下载适合你操作系统的Elasticsearch和Kibana安装包。

1.3.安装Elasticsearch

解压下载的安装包。
进入解压后的目录。
如果是Windows系统，直接进入bin目录，双击elasticsearch.bat文件。看到命令行中打印日志中出现“started”，说明Elasticsearch启动完成。

linux中进入bin目录，然后执行./elasticsearch命令

详情参见linux系统安装elasticsearch教程_linux安装es-CSDN博客

1.4.配置Elasticsearch集群

修改elasticsearch.yml文件，设置集群名称、节点名称、网络主机和种子节点等。
对于集群中的其他节点，重复上述步骤，并确保每个节点的配置文件中都有所有节点的IP地址。

启动其他节点：在每个节点上重复上述安装步骤，并启动Elasticsearch服务。

检查集群健康状态：通过访问Elasticsearch的API或使用Kibana界面，查看集群的健康状态。

请注意，这只是一个基本的搭建指南。在生产环境中，你可能需要更详细的配置和优化。此外，确保你的网络设置允许Elasticsearch集群通信所需的端口。

1.5.注意点

1.不能用root权限启动，需要新建用户，如：

更改文件夹的用户为user1  chown -R user1:user1 /local
修改user1对文件夹的权限  chmod 777 /local

2.获取账号密码

elasticsearch的bin目录下，输入命令行：elasticsearch-reset-password -u elastic

2.springboot中集成ES8

2.1.依赖

  1. <dependency>
  2.     <groupId>co.elastic.clients</groupId>
  3.     <artifactId>elasticsearch-java</artifactId>
  4.     <version>8.1.0</version>
  5. </dependency>
  6. <dependency>
  7.     <groupId>com.fasterxml.jackson.core</groupId>
  8.     <artifactId>jackson-databind</artifactId>
  9.     <version>2.12.3</version>
  10. </dependency>
  11. <dependency>
  12.     <groupId>jakarta.json</groupId>
  13.     <artifactId>jakarta.json-api</artifactId>
  14.     <version>2.0.1</version>
  15. </dependency>

2.2.elasticsearch.properties

  1. spring.elasticsearch.uris = IP:port
  2. spring.elasticsearch.username = 用户名
  3. spring.elasticsearch.password = 密码

2.3.ElasticSearchConfig

  1. @Configuration
  2. public class ElasticSearchConfig {
  3.  
  4.     @Value("${spring.elasticsearch.uris}")
  5.     private String hosts;
  6.  
  7.     @Value("${spring.elasticsearch.username}")
  8.     private String userName;
  9.  
  10.     @Value("${spring.elasticsearch.password}")
  11.     private String passWord;
  12.  
  13.     @Bean(name="elasticsearchClient")
  14.     public ElasticsearchClient elasticsearchClient(){
  15.         HttpHost[] httpHosts = toHttpHost();
  16.         final CredentialsProvider credentialsProvider = new BasicCredentialsProvider();
  17.         credentialsProvider.setCredentials(
  18.                 AuthScope.ANY, new UsernamePasswordCredentials(userName, passWord));
  19.  
  20.         RestClientBuilder builder = RestClient.builder(httpHosts);
  21.         builder.setRequestConfigCallback(
  22.                 new RestClientBuilder.RequestConfigCallback() {
  23.                     @Override
  24.                     public RequestConfig.Builder customizeRequestConfig(
  25.                             RequestConfig.Builder requestConfigBuilder) {
  26.                         return requestConfigBuilder.setSocketTimeout(60000).setConnectTimeout(5000);
  27.                     }
  28.                 });
  29.         builder.setHttpClientConfigCallback(new RestClientBuilder.HttpClientConfigCallback() {
  30.             @Override
  31.             public HttpAsyncClientBuilder customizeHttpClient(HttpAsyncClientBuilder httpAsyncClientBuilder) {
  32.  
  33.                 return httpAsyncClientBuilder.setDefaultCredentialsProvider(credentialsProvider);
  34.             }
  35.         });
  36.         RestClient restClient = builder.build();
  37.         ElasticsearchTransport transport = new RestClientTransport(restClient,new JacksonJsonpMapper());
  38.         return new ElasticsearchClient(transport);
  39.     }
  40.  
  41.     private HttpHost[] toHttpHost() {
  42.         if (!StringUtils.hasLength(hosts)) {
  43.             throw new RuntimeException("invalid elasticsearch configuration. elasticsearch.hosts不能为空！");
  44.         }
  45.         // 多个IP逗号隔开
  46.         String[] hostArray = hosts.split(",");
  47.         HttpHost[] httpHosts = new HttpHost[hostArray.length];
  48.         HttpHost httpHost;
  49.         for (int i = 0; i < hostArray.length; i++) {
  50.             String[] strings = hostArray[i].split(":");
  51.             httpHost = new HttpHost(strings[0], Integer.parseInt(strings[1]), "http");
  52.             httpHosts[i] = httpHost;
  53.         }
  54.         return httpHosts;
  55.     }
  56. }

2.4.通用类

2.4.1.枚举类，ES实体类注解

  1. @Target({ElemantType.METHOD, ElementType.TYPE})
  2. @Retention(RetentionPolicy.RUNTIME)
  3. public @interface ElasticSearchDocument {
  4.    String index() default "";
  5.    int shards() default 0;
  6.    int replicas() default 0;
  7. }

2.4.2.查询实体类

  1. @Data
  2. public class EsQueryDTO {
  3.  
  4.     private String indexName;//索引名称
  5.     private String field;//关键字属性
  6.     private String word;//关键字值
  7.     private List<String> words;//关键字值数组
  8.     private Integer from;//起始行
  9.     private Integer index;//当前页
  10.     private Integer size;//分页条数
  11.     private String order;//排序字段
  12.     private String orderType;//排序方式 Asc/Desc
  13.     private String dateField;//时间字段
  14.     private String startTime;//时间范围-开始时间
  15.     private String endTime;//时间范围-开始时间
  16.  
  17.     public String getOrderType() {
  18.         if (StringUtils.isBlank(orderType)) {
  19.             orderType = SortOrder.Desc.name();
  20.         }
  21.         return orderType;
  22.     }
  23.  
  24.     public Integer getSize() {
  25.         return size == 0 ? 30 : size;
  26.     }
  27.  
  28.     public Integer getFrom() {
  29.         return getIndex() != 0 ? ((getIndex() - 1) * getSize()) : 0;
  30.     }
  31.  
  32.     public Integer getIndex() {
  33.         return null == index ? 0 : index;
  34.     }
  35.  
  36.     public String getStartTime(int offset) {
  37.         if (StringUtils.isBlank(startTime)) {
  38.             startTime = DateUtil.format(DateUtil.offsetDay(new Date(), offset), "yyyy-MM-dd 00:00:00");
  39.             return String.valueOf(DateUtil.parse(startTime, "yyyy-MM-dd 00:00:00").getTime());
  40.         }
  41.         return startTime;
  42.     }
  43.  
  44.     public String getEndTime() {
  45.         if (StringUtils.isBlank(endTime)) {
  46.             endTime = String.valueOf(System.currentTimeMillis());
  47.         }
  48.         return endTime;
  49.     }
  50. }

2.4.3.查询工具类

  1. @Component
  2. public class ElasticClientUtils<T> {
  3.  
  4.     /**
  5.      * @param
  6.      * @param client
  7.      * @param dto
  8.      * @param target
  9.      * @return java.util.List<T>
  10.      * @author liuch
  11.      * @description 根据关键字查询
  12.      * @date 2022/4/2 17:15
  13.      */
  14.     public List<T> queryByFiled(ElasticsearchClient client, EsQueryDTO dto, Class<T> target) throws Exception {
  15.         List<T> result = new ArrayList<>();
  16.         List<SortOptions> sorts = new ArrayList<>();
  17.         if (StringUtils.isNotBlank(dto.getOrder())) {
  18.             SortOptions sortOptions = SortOptions.of(s -> s.field(f -> f.field(dto.getOrder()).order(SortOrder.valueOf(dto.getOrderType()))));
  19.             sorts.add(sortOptions);
  20.         }
  21.         SearchResponse<HashMap> search = client.search(s -> s
  22.                         .index(dto.getIndexName())
  23.                         .query(q -> q.term(t -> t
  24.                                 .field(dto.getField())
  25.                                 .value(dto.getWord())
  26.                         )).sort(sorts),
  27.                 HashMap.class);
  28.         return getResult(target, result, search);
  29.     }
  30.  
  31.     /**
  32.      * @param
  33.      * @param client
  34.      * @param dto
  35.      * @param target
  36.      * @return java.util.List<T>
  37.      * @author liuch
  38.      * @description 根据关键字查询，基于游标查询scroll
  39.      * @date 2022/4/2 17:15
  40.      */
  41.     public List<T> queryByFileds(ElasticsearchClient client, EsQueryDTO dto, List<Query> queries, Class<T> target) throws Exception {
  42.         List<T> result = new ArrayList<>();
  43.         List<SortOptions> sorts = new ArrayList<>();
  44.         if (StringUtils.isNotBlank(dto.getOrder())) {
  45.             SortOptions sortOptions = SortOptions.of(s -> s.field(f -> f.field(dto.getOrder()).order(SortOrder.valueOf(dto.getOrderType()))));
  46.             sorts.add(sortOptions);
  47.         }
  48.         getFieldValues(dto, queries);
  49.         //使用scroll深度分页查询
  50.         SearchResponse<HashMap> search = client.search(s -> s
  51.                         .index(dto.getIndexName()).query(q -> q.bool(b -> b.must(queries))).size(5000).scroll(t -> t.time("5s"))
  52.                         .sort(sorts),
  53.                 HashMap.class);
  54.         StringBuffer scrollId = new StringBuffer(search.scrollId());
  55.         //循环查询，直到查不到数据
  56.         do {
  57.             getResult(target, result, search);
  58.             StringBuffer finalScrollId = scrollId;
  59.             search = client.scroll(s -> s.scrollId(finalScrollId.toString()).scroll(t -> t.time("5s")), HashMap.class);
  60.             scrollId = new StringBuffer(search.scrollId());
  61.         } while (!search.hits().hits().isEmpty());
  62.         //getResult(target, result, search)
  63.         return result;
  64.     }
  65.  
  66.     /**
  67.      * @param
  68.      * @param client
  69.      * @param dto
  70.      * @param target
  71.      * @return java.util.List<T>
  72.      * @author liuch
  73.      * @description 根据关键字分页查询
  74.      * @date 2022/4/2 17:15
  75.      */
  76.     public List<T> queryByFiledWithPage(ElasticsearchClient client, EsQueryDTO dto, Class<T> target) throws Exception {
  77.         List<T> result = new ArrayList<>();
  78.         List<SortOptions> sorts = new ArrayList<>();
  79.         if (StringUtils.isNotBlank(dto.getOrder())) {
  80.             SortOptions sortOptions = SortOptions.of(s -> s.field(f -> f.field(dto.getOrder()).order(SortOrder.valueOf(dto.getOrderType()))));
  81.             sorts.add(sortOptions);
  82.         }
  83.         SearchResponse<HashMap> search = client.search(s -> s
  84.                         .index(dto.getIndexName())
  85.                         .query(q -> q.term(t -> t
  86.                                 .field(dto.getField())
  87.                                 .value(dto.getWord())
  88.                         )).sort(sorts).from(dto.getFrom()).size(dto.getSize()),
  89.                 HashMap.class);
  90.         return getResult(target, result, search);
  91.     }
  92.  
  93.  
  94.     private List<T> getResult(Class<T> target, List<T> result, SearchResponse<HashMap> search) {
  95.         List<Hit<HashMap>> hits = search.hits().hits();
  96.         Iterator<Hit<HashMap>> iterator = hits.iterator();
  97.         while (iterator.hasNext()) {
  98.             Hit<HashMap> decodeBeanHit = iterator.next();
  99.             Map<String, Object> docMap = decodeBeanHit.source();
  100.             docMap.put("id", decodeBeanHit.id());
  101.             String json = JSON.toJSONString(docMap);
  102.             T obj = JSON.parseObject(json, target);
  103.             result.add(obj);
  104.         }
  105.         return result;
  106.     }
  107.  
  108.     /**
  109.      * @param
  110.      * @param client
  111.      * @param dto
  112.      * @return long
  113.      * @author liuch
  114.      * @description 根据关键字查询总条数
  115.      * @date 2022/4/2 17:15
  116.      */
  117.     public static long queryCountByFiled(ElasticsearchClient client, EsQueryDTO dto) throws Exception {
  118.         CountResponse count = client.count(c -> c.index(dto.getIndexName()).query(q -> q.term(t -> t
  119.                 .field(dto.getField())
  120.                 .value(dto.getWord())
  121.         )));
  122.         long total = count.count();
  123.         return total;
  124.     }
  125.  
  126.     /**
  127.      * @param
  128.      * @param client
  129.      * @param dto
  130.      * @return long
  131.      * @author liuch
  132.      * @description 根据关键字查询总条数-复合查询
  133.      * @date 2022/4/2 17:15
  134.      */
  135.     public static long queryCountByFileds(ElasticsearchClient client, List<Query> queries, EsQueryDTO dto) throws Exception {
  136.         getFieldValues(dto, queries);
  137.         CountResponse count = client.count(c -> c.index(dto.getIndexName()).query(q -> q.bool(b -> b.must(queries))));
  138.         long total = count.count();
  139.         return total;
  140.     }
  141.  
  142.  
  143.     /**
  144.      * @param client
  145.      * @param dto
  146.      * @param target
  147.      * @return java.util.List<T>
  148.      * @author liuch
  149.      * @description 根据关键字分页查询- 复合查询  must
  150.      * @date 2022/4/2 17:15
  151.      */
  152.     public List<T> queryMustByFiledsWithPage(ElasticsearchClient client, EsQueryDTO dto, List<Query> queries, Class<T> target) throws Exception {
  153.         List<T> result = new ArrayList<>();
  154.         List<SortOptions> sorts = new ArrayList<>();
  155.         if (StringUtils.isNotBlank(dto.getOrder())) {
  156.             SortOptions sortOptions = SortOptions.of(s -> s
  157.                     .field(f -> f.field(dto.getOrder()).order(SortOrder.valueOf(dto.getOrderType()))));
  158.             sorts.add(sortOptions);
  159.         }
  160.         SearchResponse<HashMap> search = client.search(s -> s
  161.                         .index(dto.getIndexName())
  162.                         .query(q -> q.bool(b -> b.must(queries)))
  163.                         .sort(sorts).from(dto.getFrom()).size(dto.getSize()),
  164.                 HashMap.class);
  165.         return getResult(target, result, search);
  166.     }
  167.  
  168. /**
  169.      * @param client
  170.      * @param dto
  171.      * @param target
  172.      * @return java.util.List<T>
  173.      * @author liuch
  174.      * @description 根据关键字分页查询- 复合查询  must 过滤
  175.      * @date 2022/4/2 17:15
  176.      */
  177.     public List<T> queryMustByFiledsWithPage(ElasticsearchClient client, EsQueryDTO dto, List<Query> queries, List<Query> filters, Class<T> target) throws Exception {
  178.         List<T> result = new ArrayList<>();
  179.         List<SortOptions> sorts = new ArrayList<>();
  180.         if (StringUtils.isNotBlank(dto.getOrder())) {
  181.             SortOptions sortOptions = SortOptions.of(s -> s
  182.                     .field(f -> f.field(dto.getOrder()).order(SortOrder.valueOf(dto.getOrderType()))));
  183.             sorts.add(sortOptions);
  184.         }
  185.         SearchResponse<HashMap> search = client.search(s -> s
  186.                         .index(dto.getIndexName())
  187.                         .query(q -> q.bool(b -> b.must(queries).filter(filters)))
  188.                         .sort(sorts).from(dto.getFrom()).size(dto.getSize()),
  189.                 HashMap.class);
  190.         return getResult(target, result, search);
  191.     }
  192.  
  193.  
  194.     /**
  195.      * @param client
  196.      * @param dto
  197.      * @param target
  198.      * @return java.util.List<T>
  199.      * @author liuch
  200.      * @description 根据关键字分页查询- 复合查询  should
  201.      * @date 2022/4/2 17:15
  202.      */
  203.     public List<T> queryShouldByFiledsWithPage(ElasticsearchClient client, EsQueryDTO dto, List<Query> queries, Class<T> target) throws Exception {
  204.         List<T> result = new ArrayList<>();
  205.         List<SortOptions> sorts = new ArrayList<>();
  206.         if (StringUtils.isNotBlank(dto.getOrder())) {
  207.             SortOptions sortOptions = SortOptions.of(s -> s
  208.                     .field(f -> f.field(dto.getOrder()).order(SortOrder.valueOf(dto.getOrderType()))));
  209.             sorts.add(sortOptions);
  210.         }
  211.         SearchResponse<HashMap> search = client.search(s -> s
  212.                         .index(dto.getIndexName())
  213.                         .query(q -> q.bool(b -> b.should(queries)))
  214.                         .sort(sorts).from(dto.getFrom()).size(dto.getSize()),
  215.                 HashMap.class);
  216.         return getResult(target, result, search);
  217.     }
  218.  
  219.     /**
  220.      * 构件复合查询条件
  221.      *
  222.      * @param dto
  223.      * @param queries
  224.      */
  225.     private static void getFieldValues(EsQueryDTO dto, List<Query> queries) {
  226.         List<FieldValue> fieldValues = new ArrayList<>();
  227.         //根据关键字列表构件复合查询的值
  228.         dto.getWords().stream().forEach(word -> fieldValues.add(FieldValue.of(word)));
  229.         //查询条件列表
  230.         queries.add(Query.of(q -> q.terms(t -> t.field(dto.getField()).terms(v -> v.value(fieldValues)))));
  231.     }
  232.  
  233.  
  234.     /**
  235.      * @param
  236.      * @param client
  237.      * @param dto
  238.      * @param target
  239.      * @return java.lang.Object
  240.      * @author liuch
  241.      * @description 根据文档id查询
  242.      * @date 2022/4/2 17:16
  243.      */
  244.     public Object queryByDocumentId(ElasticsearchClient client, EsQueryDTO dto, Class<T> target) throws Exception {
  245.         GetResponse<HashMap> getResponse = client.get(s -> s
  246.                         .index(dto.getIndexName()).id(dto.getWord()),
  247.                 HashMap.class);
  248.         getResponse.source();
  249.         Map<String, Object> docMap = getResponse.source();
  250.         String json = JSON.toJSONString(docMap);
  251.         T obj = JSON.parseObject(json, target);
  252.         return obj;
  253.     }
  254.  
  255. }

2.4.4.基础操作接口

  1. /**
  2.  * 基础操作---接口
  3.  */
  4. public interface IElasticSearchIRepository<T, V> {
  5.  
  6.  
  7.     int delete(V id);
  8.  
  9.     int update(T entity);
  10.  
  11.     T getById(V id);
  12.    
  13.     List<T> getAll();
  14.  
  15.     long count();
  16.  
  17.     PageInfo<T> getListByPage(int pageIndex, int pageSize);
  18.  
  19.     /**
  20.      * 新增一个文档
  21.      *
  22.      * @param entity 实体类
  23.      * @return
  24.      */
  25.     IndexResponse createByFluentDSL(T entity);
  26.  
  27.     /**
  28.      * 新增一个文档
  29.      *
  30.      * @param entity 实体类
  31.      * @return
  32.      */
  33.     IndexResponse createByBuilderPattern(T entity);
  34.  
  35.     /**
  36.      * 批量增加文档
  37.      *
  38.      * @param list 对象集合
  39.      * @return 批量操作的结果
  40.      */
  41.     BulkResponse bulkCreate(List<T> list);
  42.  
  43.    /**
  44.      * 根据文档id查找文档，返回类型是ObjectNode
  45.      *
  46.      * @param id  文档id
  47.      * @return ObjectNode类型的查找结果
  48.      */
  49.     ObjectNode getObjectNodeById(V id);
  50.  
  51.  
  52.     /**
  53.      * 批量删除文档
  54.      *
  55.      * @param docIds  要删除的文档id集合
  56.      * @return
  57.      * @throws Exception
  58.      */
  59.     BulkResponse bulkDeleteByIds(List<V> docIds);
  60.  
  61.     /**
  62.      * 根据文档id删除文档
  63.      *
  64.      * @param idxName 索引名
  65.      * @param docId   文档id
  66.      * @return Object类型的查找结果
  67.      * @throws Exception
  68.      */
  69.     Boolean deleteById(String idxName, String docId) throws IOException;
  70.  
  71.     
  72.     /**
  73.      * 新建索引，指定索引名称
  74.      *
  75.      */
  76.     Boolean createIndex();
  77.  
  78.     /**
  79.      * 创建索引，指定索引名称和setting和mapping
  80.      *
  81.      * @param settingFn - 索引参数
  82.      * @param mappingFn - 索引结构
  83.      */
  84.     Boolean createIndex(Function<IndexSettings.Builder, ObjectBuilder<IndexSettings>> settingFn,
  85.                      Function<TypeMapping.Builder, ObjectBuilder<TypeMapping>> mappingFn);
  86.  
  87.     /**
  88.      * 删除索引
  89.      * @throws IOException
  90.      */
  91.     Boolean deleteIndex();
  92.  
  93.     /**
  94.      * 修改索引字段信息 <br/>
  95.      * 字段可以新增，已有的字段只能修改字段的 search_analyzer 属性。
  96.      *
  97.      * @param propertyMap - 索引字段，每个字段都有自己的property
  98.      * @throws IOException
  99.      */
  100.     Boolean updateIndexProperty(HashMap<String, Property> propertyMap);
  101.  
  102.     
  103.  
  104.     /**
  105.      * 查询索引列表
  106.      *
  107.      * @return
  108.      * @throws IOException
  109.      */
  110.     GetIndexResponse getIndexList();
  111.  
  112.     /**
  113.      * 查询索引详情
  114.      *
  115.      * @return
  116.      * @throws IOException
  117.      */
  118.     GetIndexResponse getIndexDetail();
  119.  
  120.     /**
  121.      * 检查指定名称的索引是否存在
  122.      *
  123.      * @return - true：存在
  124.      * @throws IOException
  125.      */
  126.     boolean indexExists();
  127.  
  128. }

2.4.5.基础操作接口实现类

  1. public abstract class ElasticSearchIRepository<T,V> implements IElasticSearchIRepository<T,V> {
  2.  
  3.     @Autowired(required =false)
  4.     @Qualifier("elasticsearchClient")
  5.     private ElasticsearchClient elasticsearchClient;
  6.  
  7.     protected ElasticSearchDocument getEntityProperties() {
  8.         Class<T> cls = getEntityClass();
  9.         ElasticSearchDocument esDoc = cls.getAnnotation(ElasticSearchDocument .calss);
  10.         return esDoc;
  11.     }
  12.  
  13.     /**设置索引全局配置*/
  14.     protected abstract Function<IndexSettings.builder, ObjectBuilder<IndexSettings>> getIndexSettings();
  15.  
  16.     /**手动设置映射（不手动设置会自动创建映射，同时在插入时若手动映射时没有的字段也会自动创建）*/
  17.     protected abstract Function<TypeMapping.builder, ObjectBuilder<TypeMapping>> getIndexMappings();
  18.  
  19.     protected abstract Class<T> getEntityClass();
  20.  
  21.  
  22.     @Override
  23.     public int update(T entity) {
  24.          try {
  25.             ElasticSearchDocument doc = getEntityProperties();
  26.             UpdateRequest updateRequest = new UpdateRequest.Builder()
  27.                     .index(doc.index())
  28.                     .id(entity.getId().toString())
  29.                     .doc(entity)
  30.                     .build();
  31.             UpdateResponse updateResponse = elasticsearchClient.update(updateRequest, entity.getClass());
  32.             return updateResponse != null && StringUtils.isNotEmpty(updateResponse.id()) ? 1 : 0;
  33.          }
  34.          catch (IOException e) {
  35.             log.error(e);
  36.          }
  37.          return 0;
  38.     }
  39.  
  40.    @Override
  41.     public PageInfo<T> getListByPage(int pageIndex, int pageSize) {
  42.          List<T> list = new ArrayList<>();
  43.          try {
  44.             ElasticSearchDocument doc = getEntityProperties();
  45.             ElasticClientUtils elasticClientUtils = new ElasticClientUtils();
  46.             EsQueryDTO dto = new EsQueryDTO();
  47.             dto.setIndex(paeIndex);
  48.             dto.setSize(pageSize);
  49.             dto.setIndexName(doc.index());
  50.             list = elasticClientUtils.queryPage(elasticsearchClient, dto, getEntityClass());
  51.             return new PageInde<T>(pageIndex, pageSize, (long)list.size(), list);
  52.          }
  53.          catch (IOException e) {
  54.             log.error(e);
  55.          }
  56.          return new PageInde<T>(pageIndex, pageSize, 0L, list);
  57.     }
  58.  
  59.    @Override
  60.     public int delete(V id) {
  61.          try {
  62.             ElasticSearchDocument doc = getEntityProperties();
  63.             DeleteResponse delete = elasticsearchClient.delete(d -> d
  64.                     .index(doc.index())
  65.                     .id(id.toString()));
  66.             return delete.forcedRefresh() ? 1 : 0;
  67.          }
  68.          catch (IOException e) {
  69.             log.error(e);
  70.          }
  71.          return 0;
  72.     }
  73.  
  74.     @Override
  75.     public List<T> getAll() {
  76.          try {
  77.             ElasticSearchDocument doc = getEntityProperties();
  78.             ElasticClientUtils elasticClientUtils = new ElasticClientUtils();
  79.             EsQueryDTO dto = new EsQueryDTO();
  80.             dto.setIndexName(doc.index());
  81.             return elasticClientUtils.queryAll(elasticsearchClient, dto, getEntityClass());
  82.          }
  83.          catch (IOException e) {
  84.             log.error(e);
  85.          }
  86.          return null;
  87.     }
  88.  
  89.     @Override
  90.     public long count() {
  91.          try {
  92.             ElasticSearchDocument doc = getEntityProperties();
  93.             EsQueryDTO dto = new EsQueryDTO();
  94.             dto.setIndexName(doc.index());
  95.             return ElasticClientUtils.queryCountByFiled(elasticsearchClient, dto);
  96.          }
  97.          catch (IOException e) {
  98.             log.error(e);
  99.          }
  100.          return 0;
  101.     }
  102.  
  103.     @Override
  104.     public IndexResponse createByFluentDSL(T entity) {
  105.         try {
  106.             ElasticSearchDocument doc = getEntityProperties();
  107.             IndexResponse response = elasticsearchClient.index(index -> idx
  108.                      .index(doc.index())
  109.                      .id(entity.getId().toString())
  110.                      .document(entity));
  111.             return response;
  112.          }
  113.          catch (IOException e) {
  114.             log.error(e);
  115.          }
  116.          return null;
  117.     }
  118.  
  119.     @Override
  120.     public IndexResponse createByBuilderPattern(T entity) {
  121.         try {
  122.             ElasticSearchDocument doc = getEntityProperties();
  123.             IndexRequest.Builder<Object> indexReqBuilder = new IndexRequest.Builder<>();
  124.  
  125.             indexReqBuilder.index(doc.index());
  126.             indexReqBuilder.id(entity.getId().toString());
  127.             indexReqBuilder.document(entity);
  128.             return elasticsearchClient.index(indexReqBuilder.build());
  129.          }
  130.          catch (IOException e) {
  131.             log.error(e);
  132.          }
  133.          return null;
  134.     }
  135.  
  136.     @Override
  137.     public BulkResponse bulkCreate(List<T> documents) {
  138.         try {
  139.             ElasticSearchDocument doc = getEntityProperties();
  140.             BulkRequest.Builder br = new BulkRequest.Builder();
  141.             documents.stream()
  142.                 .forEach(esDocument -> br
  143.                         .operations(op -> op
  144.                                 .index(idx -> idx
  145.                                         .index(doc.index())
  146.                                         .id(esDocument.getId().toString())
  147.                                         .document(esDocument))));
  148.  
  149.             return elasticsearchClient.bulk(br.build());
  150.          }
  151.          catch (IOException e) {
  152.             log.error(e);
  153.          }
  154.          return null;
  155.     }
  156.  
  157.     @Override
  158.     public T getById(V id) {
  159.         try {
  160.             ElasticSearchDocument doc = getEntityProperties();
  161.             GetResponse<Object> response = elasticsearchClient.get(g -> g
  162.                         .index(doc.index())
  163.                         .id(id.toString()),
  164.                 Object.class);
  165.         return response.found() ? FastJsonUtil.fromJson(response.source().toString(), getEntityClass()) : null;
  166.          }
  167.          catch (IOException e) {
  168.             log.error(e);
  169.          }
  170.          return null;
  171.     }
  172.  
  173.     @Override
  174.     public ObjectNode getObjectNodeById(V id) {
  175.         try {
  176.             ElasticSearchDocument doc = getEntityProperties();
  177.             GetResponse<ObjectNode> response = elasticsearchClient.get(g -> g
  178.                         .index(doc.index())
  179.                         .id(id.toString()),
  180.                 ObjectNode.class);
  181.  
  182.         return response.found() ? response.source() : null;
  183.          }
  184.          catch (IOException e) {
  185.             log.error(e);
  186.          }
  187.          return null;
  188.     }
  189.  
  190.    
  191.  
  192.     @Override
  193.     public BulkResponse bulkDeleteByIds(List<V> docIds) {
  194.  
  195.         try {
  196.             ElasticSearchDocument doc = getEntityProperties();
  197.             BulkRequest.Builder br = new BulkRequest.Builder();
  198.  
  199.              // 将每一个对象都放入builder中
  200.              docIds.stream().forEach(id -> br
  201.                 .operations(op -> op
  202.                         .delete(d -> d
  203.                                 .index(doc.index())
  204.                                 .id(id.toString()))));
  205.  
  206.              return elasticsearchClient.bulk(br.build());
  207.          }
  208.          catch (IOException e) {
  209.             log.error(e);
  210.          }
  211.          return null;
  212.     }
  213.  
  214.    /**自动创建映射*/
  215.     @Override
  216.     public Boolean createIndex() {
  217.         try {
  218.             ElasticSearchDocument doc = getEntityProperties();
  219.             CreateIndexResponse response = elasticsearchClient.indices().create(c -> c.index(doc.index()));
  220.         log.info("createIndex方法，acknowledged={}", response.acknowledged());
  221.         return response.acknowledged();
  222.          }
  223.          catch (IOException e) {
  224.             log.error(e);
  225.          }
  226.          return false;
  227.     }
  228.  
  229.     /**手动创建映射*/
  230.     @Override
  231.     public Boolean createIndex(Function<IndexSettings.Builder, ObjectBuilder<IndexSettings>> settingFn,
  232.                             Function<TypeMapping.Builder, ObjectBuilder<TypeMapping>> mappingFn) {
  233.  
  234.         try {
  235.             ElasticSearchDocument doc = getEntityProperties();
  236.             CreateIndexResponse response = elasticsearchClient
  237.                 .indices()
  238.                 .create(c -> c
  239.                         .index(doc.index())
  240.                         .settings(settingFn)
  241.                         .mappings(mappingFn)
  242.                 );
  243.         log.info("createIndex方法，acknowledged={}", response.acknowledged());
  244.           return response.acknowledged();
  245.          }
  246.          catch (IOException e) {
  247.             log.error(e);
  248.          }
  249.          return false;
  250.         
  251.     }
  252.  
  253.     @Override
  254.     public Boolean deleteIndex() {
  255.         try {
  256.             ElasticSearchDocument doc = getEntityProperties();
  257.             DeleteIndexResponse response = elasticsearchClient.indices().delete(c -> c.index(doc.index()));
  258.         log.info("deleteIndex方法，acknowledged={}", response.acknowledged());
  259.         return response.acknowledged();
  260.          }
  261.          catch (IOException e) {
  262.             log.error(e);
  263.          }
  264.          return false;
  265.         
  266.     }
  267.  
  268.     @Override
  269.     public Boolean updateIndexProperty(HashMap<String, Property> propertyMap) {
  270.         try {
  271.             ElasticSearchDocument doc = getEntityProperties();
  272.             PutMappingResponse response = elasticsearchClient.indices()
  273.                 .putMapping(typeMappingBuilder ->
  274.                         typeMappingBuilder
  275.                                 .index(doc.index())
  276.                                 .properties(propertyMap)
  277.                 );
  278.         log.info("updateIndexMapping方法，acknowledged={}", response.acknowledged());
  279.         return response.acknowledged();
  280.          }
  281.          catch (IOException e) {
  282.             log.error(e);
  283.          }
  284.          return false;
  285.     }
  286.  
  287.     @Override
  288.     public GetIndexResponse getIndexList() {
  289.         try {
  290.             ElasticSearchDocument doc = getEntityProperties();
  291.             //使用 * 或者 _all都可以
  292.         GetIndexResponse response = elasticsearchClient.indices().get(builder -> builder.index("_all"));
  293.         log.info("getIndexList方法，response.result()={}", response.result().toString());
  294.         return response;
  295.          }
  296.          catch (IOException e) {
  297.             log.error(e);
  298.          }
  299.          return null;
  300.     }
  301.  
  302.     @Override
  303.     public GetIndexResponse getIndexDetail() {
  304.         try {
  305.             ElasticSearchDocument doc = getEntityProperties();
  306.             GetIndexResponse response = elasticsearchClient.indices().get(builder -> builder.index(doc.index()));
  307.         log.info("getIndexDetail方法，response.result()={}", response.result().toString());
  308.         return response;
  309.          }
  310.          catch (IOException e) {
  311.             log.error(e);
  312.          }
  313.          return null;
  314.         
  315.     }
  316.  
  317.     @Override
  318.     public boolean indexExists() {
  319.         try {
  320.             ElasticSearchDocument doc = getEntityProperties();
  321.             return elasticsearchClient.indices().exists(b -> b.index(doc.index())).value();
  322.          }
  323.          catch (IOException e) {
  324.             log.error(e);
  325.          }
  326.          return null;
  327.     }  
  328.  
  329. }

2.5.业务

2.5.1.接口

  1. pulbic interface testRepo extends IElasticSearchIRepository<TestESDO, Long> {
  2.  
  3. }

2.5.2. 实现类

  1. @component
  2. pulbic calss testRepo extends ElasticSearchIRepository<TestESDO, Long> implements testRepo{
  3.     /**设置索引全局配置*/
  4.     @Override
  5.     protected Function<IndexSettings.builder, ObjectBuilder<IndexSettings>> getIndexSettings() {
  6.         return builder -> builder.numberOfShards("3").numberOfReplicas("1");
  7.      }
  8.  
  9.     /**手动设置映射（不手动设置会自动创建映射，同时在插入时若手动映射时没有的字段也会自动创建）*/
  10.     @Override
  11.     protected Function<TypeMapping.builder, ObjectBuilder<TypeMapping>> getIndexMappings() {
  12.     return builder -> {
  13.         HashMap<String, Property> propertiesMap = new HashMap<>();
  14.         propertiesMap.put("id", new Property.Builder().Long_(new LongNumberProperty.Builder().build()).build());
  15.         return builder.properties(propertiesMap);
  16.     }
  17.  }
  18.  
  19.     @Override
  20.     protected Class<T> getEntityClass() {
  21.     return TestESDO.clas;    
  22. }
  23. }

2.5.3. 实体类

  1. @Data
  2. @ElasticSearchCocument(index="test")
  3. public class TestESDO {
  4.  
  5.    private Long id;
  6. }

2.5.4. 常见查询方法

1.使用MultiMatch可以多字段，如果想要把搜索词当成一个整体来匹配查询还需要增加TextQueryType.Phrase，如

  1. //must复合查询
  2. List<Query> queries = new ArrayLict<>();
  3. MultiMatchQuery multiMatchQuery = new MultiMatchQuery.Builder()
  4.         .query("搜索词")
  5.          .type(TextQueryType.Phrase)
  6.          .fields("字段1", "字段2")
  7.          .build();
  8. Query query = new Query.Builder()
  9.          .multiMatch(multiMatchQuery).build();
  10. queries.add(multiMatchQuery);

2.使用TermsQuery进行数组过滤，如对某个字段[1,2,3,4]进行过滤，要求只有搜索词中包含这些数字就进行匹配，如4,5或者1,2,3或者1，代码如下

  1. //过滤
  2. List<Query> filters = new ArrayLict<>();
  3. List<FieldValue> fieldValueList = new ArrayList<>();
  4. fieldValueList.add(new FieldValue.Builder().longValue(1).buld());
  5. TermsQuery termsQuery = new TermsQuery .Builder()
  6.          .field("字段1")
  7.          .terms(new TermsQueryField.Builder().value(fieldValueList).build())
  8.          .build();
  9. Query filter = new Query.Builder()
  10.          .terms(termsQuery).build();
  11. filters.add(filter);

3.更多查询参见：ElasticSearch使用教程、设计到实战-CSDN博客 

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/爱喝兽奶帝天荒/article/detail/974487
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号