Elasticsearch_Logstash_Kibana:
Elastic Stack and Product Documentation
component of elk:
- elasticsearch
- logstash
- kibana
data stream:
[Data source] -> [Logstash]->[Elasticsearch]->[Kibana]
[Data source] is anything that contains data like files,log4net,rabbitmq...and so on.
Elasticsearch Engine
- the structure of elasticsearch engine
- basic config of elasticsearch
- basic get _cat put function to modify data
Kibana
- what kibana is and whats kibana can provide
- basic conifg of kibana to connect to a elasticsearch
- Dev tools in kibana
- set index pattern to modify data
- use filters
logstash
- three concepts of logstash
- basic config of logstash
- input plugin examples
- elastic search input plugin
- Log4j input plugin
- File input plugin
- rabbitmq input plugin
- filters examples
- date
- grok
- drop
- output plugin examples
- elastic serch output plugin
- File output plugin
- Email output plugin
- Http output plugin
- stdout
data
| timestamp | type | index | name | remark |
|---|---|---|---|---|
| 2017-11-14 | book | w1 | fkbook | \ |
| 2017-11-15 | table | w1 | fktable | \ |
| 2017-11-16 | pen | w2 | fkpen | \ |
- save type directly
- save type in header
- use [timestamp] if type is book
else use current time as [timestamp] - [@metadata][tag] set to filter data
- make image in kibana
