英文网站建设 论文,广州海珠区是市中心吗,平台推广员,合肥科技网站建设文章目录一.安装ELK 7.17二.为Elasticsearch设置密码三.配置logstash四.springboot整合logstash五.spring整合Elastic Search一.安装ELK 7.17
不要一股脑执行以下语句,请观察修改要修改的地方
安装logstash
# logstash安装docker run -d --name logstash \-p 5043:5043 -p 5…
文章目录一.安装ELK 7.17二.为Elasticsearch设置密码三.配置logstash四.springboot整合logstash五.spring整合Elastic Search一.安装ELK 7.17
不要一股脑执行以下语句,请观察修改要修改的地方
安装logstash
# logstash安装docker run -d --name logstash \-p 5043:5043 -p 5044:5044 --privilegedtrue \-v /mydata/logstash/logstash.conf:/usr/share/logstash/pipeline/logstash.conf \-v /mydata/logstash/logstash.yml:/usr/share/logstash/config/logstash.yml \logstash:7.17.3elasticsearch
# 安装es
docker pull elasticsearch:7.17.3
mkdir -p /mydata/elasticsearch/config
mkdir -p /mydata/elasticsearch/data
echo http.host: 0.0.0.0 /mydata/elasticsearch/config/elasticsearch.yml
chmod -R 777 /mydata/elasticsearch/docker run --name elasticsearch -p 9200:9200 -p 9300:9300 \
-e discovery.typesingle-node \
-e ES_JAVA_OPTS-Xms512m -Xmx512m \
--restartalways --privilegedtrue \
-v /mydata/elasticsearch/config/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
-v /mydata/elasticsearch/data:/usr/share/elasticsearch/data \
-v /mydata/elasticsearch/plugins:/usr/share/elasticsearch/plugins \
-d elasticsearch:7.17.3kibana
# 安装es可视化工具kibana
docker pull kibana:7.17.3# ELASTICSEARCH_HOSTShttp://本机ip:9200
docker run --name kibana -e ELASTICSEARCH_HOSTShttp://192.168.56.101:9200 -p 5601:5601 \
--restartalways --privilegedtrue -d kibana:7.17.3注意给logstash,elasticsearch,kibana释放端口,云服务器提供商和系统的端口 访问 http://ip:9200,http://ip:5601看es,kibana是否安装完成 二.为Elasticsearch设置密码
2.1进入到es挂载目录elasticsearch.yml的挂载目录添加以下内容
http.host: 0.0.0.0
http.cors.enabled: true
http.cors.allow-origin: *
http.cors.allow-headers: Authorization
xpack.security.enabled: true
# Enable encryption and mutual authentication between cluster nodes
xpack.security.transport.ssl.enabled: true
# Enable encryption for HTTP API client connections, such as Kibana, Logstash, and Agents
xpack.security.http.ssl.enabled: false2.重启es容器并进入es容器 3.进入容器后执行以下命令 傻瓜式设置账号密码
./bin/elasticsearch-setup-passwords interactive4.重启es容器 三.配置logstash
3.1 进入logstash容器执行以下命令:
docker exec -it logstash /bin/bash/usr/share/logstash/bin/logstash-plugin install logstash-codec-json_lines3.2 重启logstash 3.3 进入logstash容器的挂载目录logstash.conf
input {stdin { }tcp {mode serverhost 0.0.0.0port 5043codec json_lines}
}output {stdout {codec rubydebug}elasticsearch {hosts 192.168.1.1:9200index springboot-%{YYYY.MM.dd}user usernamepassword password}
}这里认证明文不安全.可以参考如下链接: 密文
四.springboot整合logstash
1.pom.xml
dependencygroupIdch.qos.logback/groupIdartifactIdlogback-classic/artifactId
/dependency
dependencygroupIdnet.logstash.logback/groupIdartifactIdlogstash-logback-encoder/artifactIdversion7.3/version
/dependency2. application.yml
server:port: 10500spring:profiles:active: devapplication:name: vector-searchthymeleaf:cache: false# jackson时间格式化jackson:time-zone: GMT8# elasticsearchdate-format: yyyy-MM-dd HH:mm:sslogging:level:root: info
3.application-dev.yml
logstash:host: 127.0.0.1port: 5043# 定义日志文件的存储地址 勿在 LogBack 的配置中使用相对路径path: /mydata/logstash
es:host: 127.0.0.1port: 9200username: 11111password: 111114.在resources文件夹下创建logback-spring.xml而不是logback.xml
?xml version1.0 encodingUTF-8?
configuration scantrue scanPeriod60 seconds debugfalseinclude resourceorg/springframework/boot/logging/logback/base.xml/include resourceorg/springframework/boot/logging/logback/defaults.xml/!--获取springboot的yml配置信息--springProperty scopecontext nameapplicationName sourcespring.application.name defaultValuedefault/springProperty scopecontext nameLOGSTASH_HOST sourcelogstash.host defaultValuedefault/springProperty scopecontext nameLOGSTASH_PORT sourcelogstash.port defaultValuedefault/springProperty scopecontext nameLOG_HOME sourcelogstash.path defaultValuedefault/!--输出到控制台--appender nameconsole classch.qos.logback.core.ConsoleAppenderfilter classch.qos.logback.classic.filter.ThresholdFilterlevelINFO/level/filterwithJansifalse/withJansiencoder!--pattern%d %p (%file:%line)- %m%n/pattern--!--格式化输出%d:表示日期 %thread:表示线程名 %-5level:级别从左显示5个字符宽度 %msg:日志消xx息 %n:是换行符--pattern%d{yyyy-MM-dd HH:mm:ss} %highlight(%-5level) -- %boldMagenta([%thread]) %boldCyan(%logger) :%msg%n/patterncharsetUTF-8/charset/encoder/appenderspringProfile namedev,test!-- 日志发送至logstash --appender nameLOGSTASH classnet.logstash.logback.appender.LogstashTcpSocketAppenderdestination${LOGSTASH_HOST:- }:${LOGSTASH_PORT:- }/destination!-- encoder is required --encoder charsetUTF-8 classnet.logstash.logback.encoder.LogstashEncoder!-- 在elasticsearch的index中追加applicationName字段 --customFields{applicationName:${applicationName}}/customFields/encoder/appender/springProfile!-- 按照每天生成日志文件 --appender nameFILE classch.qos.logback.core.rolling.RollingFileAppenderrollingPolicy classch.qos.logback.core.rolling.TimeBasedRollingPolicy!--日志文件输出的文件名--FileNamePattern${LOG_HOME}/TestWeb.log.%d{yyyy-MM-dd}.log/FileNamePattern!--日志文件保留天数--MaxHistory30/MaxHistory/rollingPolicyencoder charsetUTF-8 classch.qos.logback.classic.encoder.PatternLayoutEncoder!--格式化输出%d表示日期%thread表示线程名%-5level级别从左显示5个字符宽度%msg日志消息%n是换行符--pattern%d{yyyy-MM-dd HH:mm:ss.SSS} [%thread] %-5level %logger{50} - %msg%n/pattern/encoder!--日志文件最大的大小--triggeringPolicy classch.qos.logback.core.rolling.SizeBasedTriggeringPolicyMaxFileSize10MB/MaxFileSize/triggeringPolicy/appender!-- 日志输出级别 --!-- 线上环境日志配置 --springProfile nameprodroot levelINFOappender-ref refLOGSTASH//root/springProfile!-- 本地、开发环境日志配置 可以写logback支持的所有节点 --springProfile namedev,testroot levelINFOappender-ref refLOGSTASH/appender-ref refconsole//root/springProfile/configuration五.spring整合Elastic Search
详见本篇文章
