背景：
使用kubeadm安裝的kubernetes（1.11.6）集群馏鹤，使用了一年以后，登錄master無法正常查詢節(jié)點以及pod信息,但是服務(wù)可以正常訪問。
報錯內(nèi)容如下：
$ kubectl get no
error: the server doesn't have a resource type "no"
$ kubectl get -n kube-system po
error: the server doesn't have a resource type "po"
通過度娘以及谷歌的查詢，最好發(fā)現(xiàn)是因為證書過期導(dǎo)致黎烈，官方的說法是，通過這種方式匀谣，讓用戶不斷的升級版本照棋，現(xiàn)在這套環(huán)境上跑著用戶的生產(chǎn)環(huán)境，不可能去做升級或是重裝的事情武翎，這個影響太大了烈炭，所以需要在不重裝kubernates的前提上，把這個問題解決掉宝恶。
處理過程如下：
備份證書(3 master)
$ mv /etc/kubernetes/pki/apiserver.key /etc/kubernetes/pki/apiserver.key.old
$ mv /etc/kubernetes/pki/apiserver.crt /etc/kubernetes/pki/apiserver.crt.old
$ mv /etc/kubernetes/pki/apiserver-kubelet-client.crt /etc/kubernetes/pki/apiserver-kubelet-client.crt.old
$ mv /etc/kubernetes/pki/apiserver-kubelet-client.key /etc/kubernetes/pki/apiserver-kubelet-client.key.old
$ mv /etc/kubernetes/pki/front-proxy-client.crt /etc/kubernetes/pki/front-proxy-client.crt.old
$ mv /etc/kubernetes/pki/front-proxy-client.key /etc/kubernetes/pki/front-proxy-client.key.old
制作新的證書
$ kubeadm alpha phase certs apiserver --apiserver-advertise-address 192.168.175.61
[certificates] Generated apiserver certificate and key.
[certificates] apiserver serving cert is signed for DNS names [ubuntu kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.175.61]
$ kubeadm alpha phase certs apiserver-kubelet-client
[certificates] Generated apiserver-kubelet-client certificate and key.
$ kubeadm alpha phase certs front-proxy-client
[certificates] Generated front-proxy-client certificate and key.
將證書分發(fā)至每個master
$ scp -r /etc/kubernetes/pki master2:/etc/kubernetes/pki
$ scp -r /etc/kubernetes/pki master3:/etc/kubernetes/pki
備份配置文件(3 master都需備份)
$ mv /etc/kubernetes/admin.conf /etc/kubernetes/admin.conf.old
$ mv /etc/kubernetes/kubelet.conf /etc/kubernetes/kubelet.conf.old
$ mv /etc/kubernetes/controller-manager.conf /etc/kubernetes/controller-manager.conf.old
$ mv /etc/kubernetes/scheduler.conf /etc/kubernetes/scheduler.conf.old
制作新配置文件(3 master都需操作)
$ kubeadm alpha phase kubeconfig all --apiserver-advertise-address 192.168.175.61
確認(rèn)kubectl正在查找正確的配置文件路徑
$ mv $HOME/.kube/config $HOME/.kube/config.old
$ sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
$ sudo chown $(id -u):$(id -g) $HOME/.kube/config
$ sudo chmod 777 $HOME/.kube/config
$ export KUBECONFIG=$HOME/.kube/config
重啟kube-apiserver符隙，kube-controller-manager, kube-scheduler
當(dāng)做完以上操作以后趴捅，我的集群恢復(fù)正常
$ kubectl get no
NAME STATUS ROLES AGE VERSION
k8s-m1 Ready master 1y v1.11.6
k8s-m2 Ready master 1y v1.11.6
k8s-m3 Ready master 1y v1.11.6
k8s-mysql Ready <none> 1y v1.11.6
$ kubectl get -n kube-system po
NAME READY STATUS RESTARTS AGE
coredns-6d7874cb5-sqw9h 1/1 Running 0 30d
coredns-6d7874cb5-vzt4q 1/1 Running 0 4d
kube-apiserver-k8s-m1 1/1 Running 0 30d
kube-apiserver-k8s-m2 1/1 Running 0 30d
kube-apiserver-k8s-m3 1/1 Running 0 30d
kube-controller-manager-k8s-m1 1/1 Running 0 30d
kube-controller-manager-k8s-m2 1/1 Running 0 30d
kube-controller-manager-k8s-m3 1/1 Running 0 30d
kube-flannel-ds-cbl4h 1/1 Running 0 34d
kube-flannel-ds-cs9lb 1/1 Running 0 34d
kube-flannel-ds-mbhvd 1/1 Running 0 33d
kube-flannel-ds-sjf54 1/1 Running 0 32d
kube-proxy-cbp7k 1/1 Running 0 81d
kube-proxy-hc4bd 1/1 Running 0 198d
kube-proxy-ssrpq 1/1 Running 0 34d
kube-proxy-wtvzl 1/1 Running 0 180d
kube-scheduler-k8s-m1 1/1 Running 0 30d
kube-scheduler-k8s-m2 1/1 Running 0 30d
kube-scheduler-k8s-m3 1/1 Running 0 30d
kubernetes-dashboard-d4866d978-fmkgg 1/1 Running 0 30d
node-exporter-6wqwb 1/1 Running 0 10d
node-exporter-k6x6w 1/1 Running 0 10d
node-exporter-s8knb 1/1 Running 0 10d
