Elasticsearch 快速入门实践

Elasticsearch是一个基于Lucene的搜索服务器。它提供了一个分布式多用户能力的全文搜索引擎，基于RESTful web接口。Elasticsearch是用Java语言开发的，并作为Apache许可条款下的开放源码发布，是一种流行的企业级搜索引擎。Elasticsearch用于云计算中，能够达到实时搜索，稳定，可靠，快速，安装使用方便。官方客户端在Java、.NET（C#）、PHP、Python、Apache Groovy、Ruby和许多其他语言中都是可用的。根据DB-Engines的排名显示，Elasticsearch是最受欢迎的企业搜索引擎，其次是Apache Solr，也是基于Lucene。

Elasticsearch实际上也可以看做是一个数据库，但是和传统的数据库在结构式有区别：

database(数据库)	index(索引库)
table(表)	type(类型)
row(行)	document(文档)
column(列)	field(字段)

Elasticsearch 可以通过Rustful Api 来操作索引库

method	url地址	描述)
PUT	http://localhost:9200/索引名称/类型名称/文档Id	创建文档，指定文档Id
POST	http://localhost:9200/索引名称/类型名称	创建文档，随机文档Id
POST	http://localhost:9200/索引名称/类型名称/文档Id/_update	修改文档
DELETE	http://localhost:9200/索引名称/类型名称/文档Id	删除文档
GET	http://localhost:9200/索引名称/类型名称/_search/文档Id	通过文档Id查询
POST	http://localhost:9200/索引名称/类型名称/_search	查询所有数据

ELK三件套下载地址

windows 安装注意如果你的电脑配置不是很好，请修改 jvm.options 文件，将下面2个配置改小点

image-20220505161142887.png

然后双击 elasticsearch.bat 输入 http://localhost:9200 验证是否成功

image-20220505161449151.png

出现上面的图片代表windows elasticsearch 服务开启成功

IK 分词器安装

下载地址：https://github.com/medcl/elasticsearch-analysis-ik

在 elasticsearch > plugins 文件夹下创建 ik 文件夹，将ik内容复制到新创建的ik目录即可。重启elasticsearch 服务。查看日志ik分词器插件是否被加载。

[图片上传失败...(image-b15b7b-1651740381336)]E:\学习笔记\Kafka\ES

kibana 安装

kibana 汉化配置

打开 kibana.yml 配置文件，将 i18n.locale: "zh-CN" 即可，

image-20220505161720619.png

双击 kibana.bat 开启 kibana 输入http://localhost:5601 ,查看 kibana 是否被正常启动。

image-20220505162438617.png

数据基本操作

数据准备

#准备数据  
DELETE /clayindex
PUT /clayindex
{
  "mappings": {
    "properties": {
    "name":{
      "type": "keyword"
    },
    "address":{
       "type": "text"
    },
    "age":{
       "type": "integer"
    }
    }
  }
}

#插入数据 可以自己生成id //  
POST  /clayindex/_doc
{
   "name":"曹操",
   "address":"魏国",
   "age":18

}
POST  /clayindex/_doc
{
   "name":"贾诩",
   "address":"魏国",
   "age":19

}
POST  /clayindex/_doc
{
   "name":"诸葛亮",
   "address":"蜀国",
   "age":37

}
POST  /clayindex/_doc
{
   "name":"关羽",
   "address":"蜀国",
   "age":35

}
POST  /clayindex/_doc
{
   "name":"周瑜",
   "address":["吴国","蜀国"],
   "age":25
}

排序

GET clayindex/_doc/_search
{
  "query":{     
     "match": {
       "address": "魏国"
     }
  },
  "_source":["name"],
  "sort":[
    {"age":{"order":"desc"}},
    {"name":{"order":"asc"}}
    ]
}

分页查询

GET clayindex/_doc/_search
{ 
  "query":{ 
     "match": {
       "address": "魏国"
     }
  },
  "_source":["name"],
  "sort":[
    {"age":{"order":"desc"}},
    {"name":{"order":"asc"}}
    ],
   "from":0,
   "size":10
}

布尔值查询

条件1 and 条件2

GET clayindex/_doc/_search
{
  "query":{
      "bool": {
        "must": [
          {
     "match": {
       "address": "魏国"
     }            
          },{
            "match": {
       "name": "曹操"
     }            
          }
        ]        
      }
  },
  "_source":["name"],
  "sort":[
    {"age":{"order":"desc"}},
    {"name":{"order":"asc"}}
    ],
   "from":0,
   "size":2
}

条件1 or 条件2

GET clayindex/_doc/_search
{

  "query":{
      "bool": {
        "should": [
          {
     "match": {
       "address": "魏国"
     }
            
          },{
            "match": {
       "name": "曹操"
     }
            
          }
        ]
        
      }
  },
  "_source":["name"],
  "sort":[
    {"age":{"order":"desc"}},
    {"name":{"order":"asc"}}
    ],
   "from":0,
   "size":10
}

排除 MUST_NOT

#查询名字不是曹操的信息
GET clayindex/_doc/_search
{
  "query":{     
    "bool": {
      "must_not": [
        {
           "match": {
       "name": "曹操"        
     }
        }
      ]
    }    
  }
}

数据过滤FILTER

gt   大于
gte  大于等于
lt  小于
lte  小于等于！
# 查询名字是曹操，然后年龄大于等于10 小于等于30
GET clayindex/_doc/_search
{
  "query":{     
    "bool": {
      "must": [
        {
           "match": {
       "name": "曹操"        
     }
        }
      ],
      "filter": {
        "range": {
          "age": {
            "gte": 10,
            "lte": 20
          }
        }
      }
    }    
  }
}

配备多个条件查询

GET clayindex/_doc/_search
{  
  "query":{
    "match":{"address":"吴国 魏国 "}    
  }
}

高亮查询

GET clayindex/_doc/_search
{
  "query":{
  "match": {
    "name": "曹操"
  }
  },
  "highlight":{
    
    "fields": {
      "name": {}
    }
  }
}
GET clayindex/_doc/_search
{
  "query":{
  "match": {
    "address": "魏国"
  }
  },
  "highlight":{
    "fields": {
      "address": {}
    }
  }
}

自定义高亮的风格

GET clayindex/_doc/_search
{
  "query":{
  "match": {
    "name": "曹操"
    
  }
  },
  "highlight":{
    
    "pre_tags": "<p class='gaoliang'>", 
    "post_tags": "</p>", 
    "fields": {
      "name": {}
    }
  }
}

多个条件多个字段高亮查询

GET clayindex/_doc/_search
{
  "query":{
   "bool": {
        "must": [
          {
     "match": {
       "address": "魏国"
     }
          },{
            "match": {
       "name": "曹操"
     }  
          }
        ]
        
      }
  },
  "highlight":{
    
    "pre_tags": "<p class='gaoliang'>", 
    "post_tags": "</p>", 
    "fields": [
      {"name": {}},
       {"address": {}}
   ]
  }
}

聚合查询

bucket:
数据分组，一些数据按照某个字段进行bucket划分，这个字段值相同的数据放到一个bucket中。类似于Mysql中的group by后的查询结果。

metric：
对一个数据分组执行的统计，比如计算最大值，最小值，平均值等
类似于Mysql中的max(),min(),avg()函数的值，都是在group by后使用的。

数据准备


PUT /music
{
      "mappings": {
        "properties": {
          "id": {
            "type": "keyword"
          },
          "author": {
            "type": "text",
            "analyzer": "english",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "name": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "content": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "language": {
            "type": "text",
            "analyzer": "english",
            "fielddata": true
          },
          "tags": {
            "type": "text",
            "analyzer": "english"
          },
          "length": {
            "type": "long"
          },
          "likes": {
            "type": "long"
          },
          "isRelease": {
            "type": "boolean"
          },
          "releaseDate": {
            "type": "date"
          }
        }
      }
  }

POST /music/_doc/_bulk
{ "index": {}}
{ "author" : "zhangsan", "name" : "red", "content" : "honda", "language":"ch","tags":"tags","length":3,"likes":10,"isRelease":true,"releaseDate" : "2021-10-28" }
{ "index": {}}
{ "author" : "lisi", "name" : "blue", "content" : "honda", "language":"en","tags":"tags","length":3,"likes":100,"isRelease":true,"releaseDate" : "2021-10-28" }
{ "index": {}}
{ "author" : "zhangsan1", "name" : "red", "content" : "honda", "language":"ch","tags":"tags","length":30,"likes":10,"isRelease":true,"releaseDate" : "2021-11-28" }
{ "index": {}}
{ "author" : "lisi1", "name" : "blue", "content" : "honda", "language":"en","tags":"tags","length":30,"likes":100,"isRelease":true,"releaseDate" : "2021-11-28" }
{ "index": {}}
{ "author" : "zhangsan2", "name" : "red", "content" : "honda", "language":"ch","tags":"tags","length":80,"likes":10,"isRelease":true,"releaseDate" : "2021-11-28" }
{ "index": {}}
{ "author" : "lisi2", "name" : "blue", "content" : "honda", "language":"en","tags":"tags","length":80,"likes":100,"isRelease":true,"releaseDate" : "2022-10-28" }
{ "index": {}}
{ "author" : "zhangsan2", "name" : "red", "content" : "honda", "language":"ch","tags":"tags","length":80,"likes":10,"isRelease":true,"releaseDate" : "2022-10-28" }
{ "index": {}}
{ "author" : "lisi2", "name" : "blue", "content" : "honda", "language":"en","tags":"tags","length":80,"likes":100,"isRelease":true,"releaseDate" : "2022-10-28" }

1 统计目前收录的每种语言的歌曲数量

GET /music/_doc/_search
{
  "size": 0,
  "aggs": {
    "song_qty_by_language": {
      "terms": {
        "field": "language"
      }
    }
  }
}

返回结果


{
  "took" : 8,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 20,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "song_qty_by_language" : {
      "doc_count_error_upper_bound" : 0,
      "sum_other_doc_count" : 0,
      "buckets" : [
        {
          "key" : "ch",
          "doc_count" : 11
        },
        {
          "key" : "en",
          "doc_count" : 9
        }
      ]
    }
  }
}

语法解释：
size:0 表示只要统计后的结果，原始数据不展现,如果是大于0的，则会返回原数据
aggs：固定语法 ，聚合分析都要声明aggs
song_qty_by_language：聚合的名称，可以随便写，建议规范命名
terms：按什么字段进行分组
field：具体的字段名称

2 按语种统计每种语种歌曲的平均时长


GET /music/_doc/_search
{
  "size": 0,
  "aggs": {
    "lang": {
      "terms": {
        "field": "language"
      },
      "aggs": {
        "length_avg": {
          "avg": {
            "field": "length"
          }
        }
      }
    }
  }
}

返回结果


{
  "took" : 95,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 40,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "lang" : {
      "doc_count_error_upper_bound" : 0,
      "sum_other_doc_count" : 0,
      "buckets" : [
        {
          "key" : "ch",
          "doc_count" : 21,
          "length_avg" : {
            "value" : 9.428571428571429
          }
        },
        {
          "key" : "en",
          "doc_count" : 19,
          "length_avg" : {
            "value" : 10.105263157894736
          }
        }
      ]
    }
  }
}

PS 两层aggs聚合查询，先按语种统计，得到数据分组，再在数据分组里算平均时长。

3 统计最长时长、最短时长等的歌曲

GET /music/_doc/_search
{
  "size": 0,
  "aggs": {
    "color": {
      "terms": {
        "field": "language"
      },
      "aggs": {
        "length_avg": {
          "avg": {
            "field": "length"
          }
        },
        "length_max": {
          "max": {
            "field": "length"
          }
        },
        "length_min": {
          "min": {
            "field": "length"
          }
        },
        "length_sum": {
          "sum": {
            "field": "length"
          }
        }
      }
    }
  }
}

*** 返回结果***

#! [types removal] Specifying types in search requests is deprecated.
{
  "took" : 1,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 40,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "color" : {
      "doc_count_error_upper_bound" : 0,
      "sum_other_doc_count" : 0,
      "buckets" : [
        {
          "key" : "ch",
          "doc_count" : 21,
          "length_sum" : {
            "value" : 198.0
          },
          "length_max" : {
            "value" : 30.0
          },
          "length_min" : {
            "value" : 3.0
          },
          "length_avg" : {
            "value" : 9.428571428571429
          }
        },
        {
          "key" : "en",
          "doc_count" : 19,
          "length_sum" : {
            "value" : 192.0
          },
          "length_max" : {
            "value" : 30.0
          },
          "length_min" : {
            "value" : 3.0
          },
          "length_avg" : {
            "value" : 10.105263157894736
          }
        }
      ]
    }
  }
}

4 按时长分段统计歌曲平均时长


以30秒为一段，看各段区间的平均值。
 
histogram语法位置跟terms一样，作范围分区，搭配interval参数一起使用
interval:30表示分的区间段为[0,30),[30,60),[60,90),[90,120)
 
段的闭合关系是左开右闭，如果数据在某段区间内没有，也会返回空的区间。

GET /music/_doc/_search
{
  "size": 0,
  "aggs": {
    "sales_price_range": {
      "histogram": {
        "field": "length",
        "interval": 30
      },
      "aggs": {
        "length_avg": {
          "avg": {
            "field": "length"
          }
        }
      }
    }
  }
}

*** 返回结果***

#! [types removal] Specifying types in search requests is deprecated.
{
  "took" : 39,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 70,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "sales_price_range" : {
      "buckets" : [
        {
          "key" : 0.0,
          "doc_count" : 40,
          "length_avg" : {
            "value" : 3.0
          }
        },
        {
          "key" : 30.0,
          "doc_count" : 20,
          "length_avg" : {
            "value" : 30.0
          }
        },
        {
          "key" : 60.0,
          "doc_count" : 10,
          "length_avg" : {
            "value" : 80.0
          }
        }
      ]
    }
  }
}

5 按上架日期分段统计新歌数量


GET /music/_doc/_search
{
  "size": 0,
  "aggs": {
    "sales": {
      "date_histogram": {
        "field": "releaseDate",
        "interval": "month",
        "format": "yyyy-MM-dd",
        "min_doc_count": 0,
        "extended_bounds": {
          "min": "2000-10-01",
          "max": "2088-12-31"
        }
      }
    }
  }
}

返回结果

{
  "took" : 1,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 134,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "sales" : {
      "buckets" : [
        {
          "key_as_string" : "2020-10-01",
          "key" : 1601510400000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2020-11-01",
          "key" : 1604188800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2020-12-01",
          "key" : 1606780800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-01-01",
          "key" : 1609459200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-02-01",
          "key" : 1612137600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-03-01",
          "key" : 1614556800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-04-01",
          "key" : 1617235200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-05-01",
          "key" : 1619827200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-06-01",
          "key" : 1622505600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-07-01",
          "key" : 1625097600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-08-01",
          "key" : 1627776000000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-09-01",
          "key" : 1630454400000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2021-10-01",
          "key" : 1633046400000,
          "doc_count" : 86
        },
        {
          "key_as_string" : "2021-11-01",
          "key" : 1635724800000,
          "doc_count" : 24
        },
        {
          "key_as_string" : "2021-12-01",
          "key" : 1638316800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-01-01",
          "key" : 1640995200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-02-01",
          "key" : 1643673600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-03-01",
          "key" : 1646092800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-04-01",
          "key" : 1648771200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-05-01",
          "key" : 1651363200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-06-01",
          "key" : 1654041600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-07-01",
          "key" : 1656633600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-08-01",
          "key" : 1659312000000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-09-01",
          "key" : 1661990400000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-10-01",
          "key" : 1664582400000,
          "doc_count" : 24
        },
        {
          "key_as_string" : "2022-11-01",
          "key" : 1667260800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2022-12-01",
          "key" : 1669852800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-01-01",
          "key" : 1672531200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-02-01",
          "key" : 1675209600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-03-01",
          "key" : 1677628800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-04-01",
          "key" : 1680307200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-05-01",
          "key" : 1682899200000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-06-01",
          "key" : 1685577600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-07-01",
          "key" : 1688169600000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-08-01",
          "key" : 1690848000000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-09-01",
          "key" : 1693526400000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-10-01",
          "key" : 1696118400000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-11-01",
          "key" : 1698796800000,
          "doc_count" : 0
        },
        {
          "key_as_string" : "2023-12-01",
          "key" : 1701388800000,
          "doc_count" : 0
        }
      ]
    }
  }
}

6 统计今年每个季度新发布歌曲的点赞数量,以及每个语种的点赞数量

GET /music/_doc/_search
{
  "size": 0,
  "aggs": {
    "sales": {
      "date_histogram": {
        "field": "releaseDate",
        "interval": "quarter",
        "format": "yyyy-MM-dd",
        "min_doc_count": 0,
        "extended_bounds": {
          "min": "2022-01-01",
          "max": "2022-08-31"
        }
      },
      "aggs": {
        "lang_qty": {
          "terms": {
            "field": "language"
          },
          "aggs": {
            "like_sum": {
              "sum": {
                "field": "likes"
              }
            }
          }
        },
        "total" :{
          "sum": {
            "field": "likes"
          }
        }
      }
    }
  }
}

返回结果

{
  "took" : 1,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 134,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "sales" : {
      "buckets" : [
        {
          "key_as_string" : "2021-10-01",
          "key" : 1633046400000,
          "doc_count" : 110,
          "total" : {
            "value" : 5600.0
          },
          "lang_qty" : {
            "doc_count_error_upper_bound" : 0,
            "sum_other_doc_count" : 0,
            "buckets" : [
              {
                "key" : "ch",
                "doc_count" : 60,
                "like_sum" : {
                  "value" : 600.0
                }
              },
              {
                "key" : "en",
                "doc_count" : 50,
                "like_sum" : {
                  "value" : 5000.0
                }
              }
            ]
          }
        },
        {
          "key_as_string" : "2022-01-01",
          "key" : 1640995200000,
          "doc_count" : 0,
          "total" : {
            "value" : 0.0
          },
          "lang_qty" : {
            "doc_count_error_upper_bound" : 0,
            "sum_other_doc_count" : 0,
            "buckets" : [ ]
          }
        },
        {
          "key_as_string" : "2022-04-01",
          "key" : 1648771200000,
          "doc_count" : 0,
          "total" : {
            "value" : 0.0
          },
          "lang_qty" : {
            "doc_count_error_upper_bound" : 0,
            "sum_other_doc_count" : 0,
            "buckets" : [ ]
          }
        },
        {
          "key_as_string" : "2022-07-01",
          "key" : 1656633600000,
          "doc_count" : 0,
          "total" : {
            "value" : 0.0
          },
          "lang_qty" : {
            "doc_count_error_upper_bound" : 0,
            "sum_other_doc_count" : 0,
            "buckets" : [ ]
          }
        },
        {
          "key_as_string" : "2022-10-01",
          "key" : 1664582400000,
          "doc_count" : 24,
          "total" : {
            "value" : 1680.0
          },
          "lang_qty" : {
            "doc_count_error_upper_bound" : 0,
            "sum_other_doc_count" : 0,
            "buckets" : [
              {
                "key" : "en",
                "doc_count" : 16,
                "like_sum" : {
                  "value" : 1600.0
                }
              },
              {
                "key" : "ch",
                "doc_count" : 8,
                "like_sum" : {
                  "value" : 80.0
                }
              }
            ]
          }
        }
      ]
    }
  }
}

7 查询某种语种的歌曲数量

ps 相当于mysql中where与group by联合使用

GET /music/_doc/_search
{
  "size": 0,
  "query": {
    "match": {
      "language": "en"
    }
  },
  "aggs": {
    "sales": {
      "terms": {
        "field": "language"
      }
    }
  }
}

8 指定作者的歌与全部歌曲的点赞数量对比。


GET /music/_doc/_search
{
  "size": 0,
  "query": {
    "match": {
      "author": "zhangsan"
    }
  },
  "aggs": {
    "likes": {
      "sum": {
        "field": "likes"
      }
    },
    "all": {
      "global": {},
      "aggs": {
        "all_likes": {
          "sum": {
            "field": "likes"
          }
        }
      }
    }
  }
}

返回结果

{
  "took" : 0,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 28,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "all" : {
      "doc_count" : 134,
      "all_likes" : {
        "value" : 7280.0
      }
    },
    "likes" : {
      "value" : 280.0
    }
  }
}

9 统计近2月，近1月的点赞数


GET /music/_doc/_search
{
  "size": 0,
  "aggs": {
    "recent_60d": {
      "filter": {
        "range": {
          "releaseDate": {
            "gte": "now-60d"
          }
        }
      },
      "aggs": {
        "recent_60d_likes_sum": {
          "sum": {
            "field": "likes"
          }
        }
      }
    },
    "recent_30d": {
      "filter": {
        "range": {
          "releaseDate": {
            "gte": "now-30d"
          }
        }
      },
      "aggs": {
        "recent_30d_likes_sum": {
          "avg": {
            "field": "likes"
          }
        }
      }
    }
  }
}

返回结果

{
  "took" : 1,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 134,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "recent_30d" : {
      "meta" : { },
      "doc_count" : 134,
      "recent_30d_likes_sum" : {
        "value" : 54.32835820895522
      }
    },
    "recent_60d" : {
      "meta" : { },
      "doc_count" : 134,
      "recent_60d_likes_sum" : {
        "value" : 7280.0
      }
    }
  }
}

10 统计排序


默认按doc_count降序排序，排序规则可以改，order里面可以指定aggs的别名，如length_avg，类似于mysql的order by cnt asc。

计算每种语言的歌曲数量，和每种语言的歌曲平均时长


GET /music/_doc/_search
{
  "size": 0,
  "aggs": {
    "group_by_lang": {
      "terms": {
        "field": "language",
        "order": {
          "length_avg": "desc"
        }
      },
      "aggs": {
        "length_avg": {
          "avg": {
            "field": "length"
          }
        }
      }
    }
  }
}

返回结果


{
  "took" : 2,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 134,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  },
  "aggregations" : {
    "group_by_lang" : {
      "doc_count_error_upper_bound" : 0,
      "sum_other_doc_count" : 0,
      "buckets" : [
        {
          "key" : "en",
          "doc_count" : 66,
          "length_avg" : {
            "value" : 34.86363636363637
          }
        },
        {
          "key" : "ch",
          "doc_count" : 68,
          "length_avg" : {
            "value" : 33.9264705882353
          }
        }
      ]
    }
  }
}

人面猴
序言：七十年代末，一起剥皮案震惊了整个滨河市，随后出现的几起案子，更是在滨河造成了极大的恐慌，老刑警刘岩，带你破解...
沈念sama阅读 216,470评论 6赞 501
死咒
序言：滨河连续发生了三起死亡事件，死亡现场离奇诡异，居然都是意外死亡，警方通过查阅死者的电脑和手机，发现死者居然都...
沈念sama阅读 92,393评论 3赞 392
救了他两次的神仙让他今天三更去死
文/潘晓璐我一进店门，熙熙楼的掌柜王于贵愁眉苦脸地迎上来，“玉大人，你说我怎么就摊上这事。” “怎么了？”我有些...
开封第一讲书人阅读 162,577评论 0赞 353
道士缉凶录：失踪的卖姜人
文/不坏的土叔我叫张陵，是天一观的道长。经常有香客问我，道长，这世上最难降的妖魔是什么？我笑而不...
开封第一讲书人阅读 58,176评论 1赞 292
港岛之恋（遗憾婚礼）
正文为了忘掉前任，我火速办了婚礼，结果婚礼上，老公的妹妹穿的比我还像新娘。我一直安慰自己，他们只是感情好，可当我...
茶点故事阅读 67,189评论 6赞 388
恶毒庶女顶嫁案：这布局不是一般人想出来的
文/花漫我一把揭开白布。她就那样静静地躺着，像睡着了一般。火红的嫁衣衬着肌肤如雪。梳的纹丝不乱的头发上，一...
开封第一讲书人阅读 51,155评论 1赞 299
城市分裂传说
那天，我揣着相机与录音，去河边找鬼。笑死，一个胖子当着我的面吹牛，可吹牛的内容都是我干的。我是一名探鬼主播，决...
沈念sama阅读 40,041评论 3赞 418
双鸳鸯连环套：你想象不到人心有多黑
文/苍兰香墨我猛地睁开眼，长吁一口气：“原来是场噩梦啊……” “哼！你这毒妇竟也来了？” 一声冷哼从身侧响起，我...
开封第一讲书人阅读 38,903评论 0赞 274
万荣杀人案实录
序言：老挝万荣一对情侣失踪，失踪者是张志新（化名）和其女友刘颖，没想到半个月后，有当地人在树林里发现了一具尸体，经...
沈念sama阅读 45,319评论 1赞 310
护林员之死
正文独居荒郊野岭守林人离奇死亡，尸身上长有42处带血的脓包…… 初始之章·张勋以下内容为张勋视角年9月15日...
茶点故事阅读 37,539评论 2赞 332
白月光启示录
正文我和宋清朗相恋三年，在试婚纱的时候发现自己被绿了。大学时的朋友给我发了我未婚夫和他白月光在一起吃饭的照片。...
茶点故事阅读 39,703评论 1赞 348
活死人
序言：一个原本活蹦乱跳的男人离奇死亡，死状恐怖，灵堂内的尸体忽然破棺而出，到底是诈尸还是另有隐情，我是刑警宁泽，带...
沈念sama阅读 35,417评论 5赞 343
日本核电站爆炸内幕
正文年R本政府宣布，位于F岛的核电站，受9级特大地震影响，放射性物质发生泄漏。R本人自食恶果不足惜，却给世界环境...
茶点故事阅读 41,013评论 3赞 325
男人毒药：我在死后第九天来索命
文/蒙蒙一、第九天我趴在偏房一处隐蔽的房顶上张望。院中可真热闹，春花似锦、人声如沸。这庄子的主人今日做“春日...
开封第一讲书人阅读 31,664评论 0赞 22
一桩弑父案，背后竟有这般阴谋
文/苍兰香墨我抬头看了看天上的太阳。三九已至，却和暖如春，着一层夹袄步出监牢的瞬间，已是汗流浃背。一阵脚步声响...
开封第一讲书人阅读 32,818评论 1赞 269
情欲美人皮
我被黑心中介骗来泰国打工，没想到刚下飞机就差点儿被人妖公主榨干…… 1. 我叫王不留，地道东北人。一个月前我还...
沈念sama阅读 47,711评论 2赞 368
代替公主和亲
正文我出身青楼，却偏偏与公主长得像，于是被迫代替她去往敌国和亲。传闻我的和亲对象是个残疾皇子，可洞房花烛夜当晚...
茶点故事阅读 44,601评论 2赞 353

Elasticsearch 快速入门实践

ELK三件套 下载地址

IK 分词器安装

kibana 安装

数据基本操作

数据准备

排序

分页查询

布尔值查询

条件1 and 条件2

条件1 or 条件2

排除 MUST_NOT

数据过滤FILTER

配备多个条件查询

高亮查询

自定义高亮的风格

多个条件多个字段高亮查询

聚合查询

数据准备

1 统计目前收录的每种语言的歌曲数量

2 按语种统计每种语种歌曲的平均时长

3 统计最长时长、最短时长等的歌曲

4 按时长分段统计歌曲平均时长

5 按上架日期分段统计新歌数量

6 统计今年每个季度新发布歌曲的点赞数量,以及每个语种的点赞数量

7 查询某种语种的歌曲数量

8 指定作者的歌与全部歌曲的点赞数量对比。

9 统计近2月，近1月的点赞数

10 统计排序

推荐阅读更多精彩内容

ELK三件套下载地址