网站建设如何查看后台数据库,小白用网站建设工具,生成器在线制作免费,wordpress哪里查看id一、说明
二、思路
三、部署
1、建nfs服务器
2、建持久卷
3、部署elasticsearch
四、附件
?pv.yaml内容
elasticsearch.yaml内容 一、说明
本文章内容主要的参考来源是https://www.cnblogs.com/javashop-docs/p/12410845.html#xff0c;但参考文献中的elasticsearc…一、说明
二、思路
三、部署
1、建nfs服务器
2、建持久卷
3、部署elasticsearch
四、附件
?pv.yaml内容
elasticsearch.yaml内容 一、说明
本文章内容主要的参考来源是https://www.cnblogs.com/javashop-docs/p/12410845.html但参考文献中的elasticsearch是用的6.x版本7.x与6.x有些配置上的差异因此有必要在此基础上记录一下。
二、思路
数据的存储
在k8s中的持久化部署不可避免的要用到持久卷我们采用nfs方式的持久卷来存储es数据。持久卷的详细介绍请见这里 https://kubernetes.io/docs/concepts/storage/persistent-volumes/
节点规划
默认启动5个节点3主2数据。根据es官方推荐每个节点的智能要分离因此maseter节点不存储数据只用来协调。
3、多节点的权限问题
es的数据目录默认只允许一个节点访问但在k8s上采用了持久卷所有节点的数据都存储在这个卷上这会导致es的访问权限问题。报错如下
java.io.IOException: failed to obtain lock on /usr/share/elasticsearch/data/nodes/0
1
当然可以通过更改es的配置max_local_storage_nodes来允许多个节点访问同一个数据目录但es官方不推荐这样做。
所以我们的方案是更改每个节点的数据存储目录来解决 _ps:指定es配置项path.data来实现。_举例说明
节点名
存储目录
es-data-1
/usr/share/elasticsearch/data/es-data-1
es-data-2
/usr/share/elasticsearch/data/es-data-2
三、部署
1、建nfs服务器
对于持久卷的结构规划如下
/nfs/data/esmaster
es master节点的数据
/nfs/data/esdata
es 数据节点的数据
关于索引的磁盘占用请根据业务的数据量情况来规划持久卷硬件的情况根据我们实际测算1000个商品大约需要1MB/每节点 在默认的规划中我们使用k8s的master节点作为nfs服务器为上述卷准备了10G的空间请确保k8s master node 不少于10G的空闲磁盘。请根据您的具体业务情况选择nfs服务器如果条件允许最好是独立的nfs服务器。根据如上规划建立nfs服务
#master节点安装nfs yum -y install nfs-utils #创建nfs目录 mkdir -p /nfs/data/{mqdata,esmaster,esdata} #修改权限 chmod -R 777 /nfs/data/
#编辑export文件 vim /etc/exports
粘贴如下内容 /nfs/data/esmaster *(rw,no_root_squash,sync) /nfs/data/esdata *(rw,no_root_squash,sync)
#配置生效 exportfs -r #查看生效 exportfs
#启动rpcbind、nfs服务 systemctl restart rpcbind systemctl enable rpcbind systemctl restart nfs systemctl enable nfs
#查看 RPC 服务的注册状况 rpcinfo -p localhost
#showmount测试这里的ip输入master节点的局域网ip showmount -e
如果以看到可被挂载的目录 # showmount -e 172.17.14.73
Export list for 172.17.14.73: /nfs/data/esmaster * /nfs/data/mqdata * 接下来要在每一个节点上安装nfs服务以便使k8s可以挂载nfs目录 #所有node节点安装客户端 yum -y install nfs-utils systemctl start nfs systemctl enable nfs
这样就为k8s的持久卷做好了准备。
2、建持久卷
复制附件中的pv.yaml内容修改其中的server配置为nfs服务器的ip地址
nfs: server: 192.168.0.186 #这里请写nfs服务器的ip
在k8s master节点上执行下面的命令创建namespace kubectl create namespace ns-elasticsearch 通过下面的命令建立持久卷 kubectl create -f pv.yaml 通过以下命令查看持久卷是否建立成功 kubectl get pv
3、部署elasticsearch
由于在elasticsearch.yaml中设置了node信息nodeSelector enable因此需要将node添加标签es:enable kubectl label nodes esenable kubectl label nodes esenable kubectl label nodes esenable 查看node标签 k get node --show-labels 复制附件elasticsearch.yaml的内并执行下面的命令创建es集群 kubectl create -f elasticsearch.yaml 通过以上部署我们建立了一个ns-elasticsearch的namespace并在其中创建了相应的pvc、角色账号有状态副本集以及服务。 kubectl get pods --namespace ns-elasticsearch -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
elasticsearch-data-0 1/1 Running 0 46h 10.244.2.45 vm188 none none
elasticsearch-data-1 1/1 Running 2 45h 10.244.1.62 vm187 none none
elasticsearch-master-0 1/1 Running 0 46h 10.244.2.44 vm188 none none
elasticsearch-master-1 1/1 Running 0 46h 10.244.1.61 vm187 none none
elasticsearch-master-2 1/1 Running 0 46h 10.244.0.14 vm186 none none服务 我们默认开启了对外nodeport端口对应关系
32000-9200
32100-9300
k8s内部可以通过下面的服务名称访问
elasticsearch-api-service.ns-elasticsearch:9300
elasticsearch-service.ns-elasticsearch:9200
等待容器都启动成功后验证。
注意
es的最大内存和最小内存需要保持一致默认的256m太小可适当增加我配置的是1024m。
es7.x参考
https://blog.csdn.net/chengyuqiang/article/details/89841544
https://www.sohu.com/a/301517999_683048
四、附件
pv.yaml内容
---
#es master节点的持久卷
apiVersion: v1
kind: PersistentVolume
metadata:name: pv-es-masterlabels:pv: pv-es-master
spec:capacity:storage: 1GiaccessModes:- ReadWriteOncepersistentVolumeReclaimPolicy: RecyclestorageClassName: nfsnfs:server: 192.168.1.190 #这里请写nfs服务器的ippath: /nfs/data/esmaster
---
#es数据节点的持久卷
apiVersion: v1
kind: PersistentVolume
metadata:name: pv-es-datalabels:pv: pv-es-data
spec:capacity:storage: 10GiaccessModes:- ReadWriteOncepersistentVolumeReclaimPolicy: RecyclestorageClassName: nfsnfs:server: 192.168.1.190 #这里请写nfs服务器的ippath: /nfs/data/esdata
---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:name: pvc-es-masternamespace: ns-elasticsearch
spec:accessModes:- ReadWriteOnceresources:requests:storage: 1GistorageClassName: nfsselector:matchLabels:pv: pv-es-master
---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:name: pvc-es-datanamespace: ns-elasticsearch
spec:accessModes:- ReadWriteOnceresources:requests:storage: 10GistorageClassName: nfsselector:matchLabels:pv: pv-es-dataelasticsearch.yaml内容
---
apiVersion: v1
kind: ServiceAccount
metadata:labels:elastic-app: elasticsearchname: elasticsearch-adminnamespace: ns-elasticsearch---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:name: elasticsearch-adminlabels:elastic-app: elasticsearch
roleRef:apiGroup: rbac.authorization.k8s.iokind: ClusterRolename: cluster-admin
subjects:- kind: ServiceAccountname: elasticsearch-adminnamespace: ns-elasticsearch---
kind: StatefulSet
apiVersion: apps/v1
metadata:labels:elastic-app: elasticsearchrole: mastername: elasticsearch-masternamespace: ns-elasticsearch
spec:serviceName: es-masterreplicas: 1revisionHistoryLimit: 10selector:matchLabels:elastic-app: elasticsearchrole: mastertemplate:metadata:labels:elastic-app: elasticsearchrole: masterspec:#将持久卷声明volumes:- name: pv-storage-elastic-masterpersistentVolumeClaim:claimName: pvc-es-masternodeSelector:es: enablecontainers:- name: elasticsearch-masterimage: registry.cn-shanghai.aliyuncs.com/luckyqing/elasticsearch:7.6.2lifecycle:postStart:exec:command: [/bin/bash, -c, sysctl -w vm.max_map_count262144; ulimit -l unlimited;chown -R elasticsearch:elasticsearch /usr/share/elasticsearch/data;]ports:- containerPort: 9200protocol: TCP- containerPort: 9300protocol: TCPenv:- name: MY_POD_NAMEvalueFrom:fieldRef:apiVersion: v1fieldPath: metadata.name#修改es默认的数据存储目录否则多个节点同时写一个目录es权限不允许- name: path.datavalue: /usr/share/elasticsearch/data/$(MY_POD_NAME)- name: cluster.namevalue: elasticsearch-cluster- name: bootstrap.memory_lockvalue: false- name: discovery.seed_hosts #7.x的配置方式value: elasticsearch-discovery- name: node.mastervalue: true- name: node.datavalue: false- name: node.ingestvalue: false- name: ES_JAVA_OPTSvalue: -Xms1024m -Xmx1024m- name: cluster.initial_master_nodesvalue: elasticsearch-master-0securityContext:privileged: true#将持久卷映射为数据目录的父目录volumeMounts:- name: pv-storage-elastic-mastermountPath: /usr/share/elasticsearch/data/
# imagePullSecrets:
# - name: aliyun-secretserviceAccountName: elasticsearch-admintolerations:- key: node-role.kubernetes.io/mastereffect: NoSchedule---
kind: Service
apiVersion: v1
metadata:labels:elastic-app: elasticsearchname: elasticsearch-discoverynamespace: ns-elasticsearch
spec:ports:- port: 9300targetPort: 9300selector:elastic-app: elasticsearchrole: master---
kind: StatefulSet
apiVersion: apps/v1
metadata:labels:elastic-app: elasticsearchrole: dataname: elasticsearch-datanamespace: ns-elasticsearch
spec:serviceName: es-datareplicas: 2revisionHistoryLimit: 10selector:matchLabels:elastic-app: elasticsearchtemplate:metadata:labels:elastic-app: elasticsearchrole: dataspec:#将es-data持久卷声明volumes:- name: pv-storage-elastic-datapersistentVolumeClaim:claimName: pvc-es-datanodeSelector:es: enablecontainers:- name: elasticsearch-dataimage: registry.cn-shanghai.aliyuncs.com/luckyqing/elasticsearch:7.6.2lifecycle:postStart:exec:command: [/bin/bash, -c, sysctl -w vm.max_map_count262144; ulimit -l unlimited;chown -R elasticsearch:elasticsearch /usr/share/elasticsearch/data;]ports:- containerPort: 9200protocol: TCP- containerPort: 9300protocol: TCPenv:- name: MY_POD_NAMEvalueFrom:fieldRef:apiVersion: v1fieldPath: metadata.name#修改es默认的数据存储目录否则多个节点同时写一个目录es权限不允许- name: path.datavalue: /usr/share/elasticsearch/data/$(MY_POD_NAME)- name: cluster.namevalue: elasticsearch-cluster- name: bootstrap.memory_lockvalue: false- name: discovery.seed_hostsvalue: elasticsearch-discovery- name: node.mastervalue: false- name: node.datavalue: true- name: ES_JAVA_OPTSvalue: -Xms1024m -Xmx1024msecurityContext:privileged: true#将持久卷映射到数据目录的父目录volumeMounts:- name: pv-storage-elastic-datamountPath: /usr/share/elasticsearch/data/# imagePullSecrets:# - name: aliyun-secretserviceAccountName: elasticsearch-admintolerations:- key: node-role.kubernetes.io/mastereffect: NoSchedule---
kind: Service
apiVersion: v1
metadata:labels:elastic-app: elasticsearch-servicename: elasticsearch-servicenamespace: ns-elasticsearch
spec:ports:- port: 9200targetPort: 9200nodePort: 32000selector:elastic-app: elasticsearchtype: NodePort---
kind: Service
apiVersion: v1
metadata:labels:elastic-app: elasticsearch-servicename: elasticsearch-api-servicenamespace: ns-elasticsearch
spec:ports:- port: 9300targetPort: 9300nodePort: 32100selector:elastic-app: elasticsearchtype: NodePort
