之前自己搭的集群是 1.28 版本，有点太老了，逐步升级到最新版本。本文章以升级到 1.29.13 为目标版本为例。
操作流程如下。
更新 sources 并升级 kubeadm
所有节点都需要执行下面的命令：
sudo rm -rf /etc/apt/sources.list.d/kubernetes.list
curl -fsSL https://pkgs.k8s.io/core:/stable:/v1.29/deb/Release.key | sudo gpg --dearmor -o /etc/apt/keyrings/kubernetes.gpg
echo 'deb [signed-by=/etc/apt/keyrings/kubernetes.gpg] https://pkgs.k8s.io/core:/stable:/v1.29/deb/ /' | sudo tee /etc/apt/sources.list.d/kubernetes.list
sudo apt update
sudo apt-mark unhold kubeadm
sudo apt install -y kubeadm='1.29.13-*'
sudo apt-mark hold kubeadm
sudo rebootcontrolplane 节点执行 kubeadm 升级
sudo kubeadm upgrade plan确认输出无误，我这里的输出是：
[upgrade/config] Making sure the configuration is correct:
[upgrade/config] Reading configuration from the cluster...
[upgrade/config] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -o yaml'
[preflight] Running pre-flight checks.
[upgrade] Running cluster health checks
[upgrade] Fetching available versions to upgrade to
[upgrade/versions] Cluster version: v1.28.11
[upgrade/versions] kubeadm version: v1.29.13
I0129 06:03:58.136307 2963 version.go:256] remote version is much newer: v1.32.1; falling back to: stable-1.29
[upgrade/versions] Target version: v1.29.13
[upgrade/versions] Latest version in the v1.28 series: v1.28.15
Components that must be upgraded manually after you have upgraded the control plane with 'kubeadm upgrade apply':
COMPONENT CURRENT TARGET
kubelet 4 x v1.28.2 v1.28.15
Upgrade to the latest version in the v1.28 series:
COMPONENT CURRENT TARGET
kube-apiserver v1.28.11 v1.28.15
kube-controller-manager v1.28.11 v1.28.15
kube-scheduler v1.28.11 v1.28.15
kube-proxy v1.28.11 v1.28.15
CoreDNS v1.10.1 v1.11.1
etcd 3.5.9-0 3.5.16-0
You can now apply the upgrade by executing the following command:
kubeadm upgrade apply v1.28.15
_____________________________________________________________________
Components that must be upgraded manually after you have upgraded the control plane with 'kubeadm upgrade apply':
COMPONENT CURRENT TARGET
kubelet 4 x v1.28.2 v1.29.13
Upgrade to the latest stable version:
COMPONENT CURRENT TARGET
kube-apiserver v1.28.11 v1.29.13
kube-controller-manager v1.28.11 v1.29.13
kube-scheduler v1.28.11 v1.29.13
kube-proxy v1.28.11 v1.29.13
CoreDNS v1.10.1 v1.11.1
etcd 3.5.9-0 3.5.16-0
You can now apply the upgrade by executing the following command:
kubeadm upgrade apply v1.29.13
_____________________________________________________________________
The table below shows the current state of component configs as understood by this version of kubeadm.
Configs that have a "yes" mark in the "MANUAL UPGRADE REQUIRED" column require manual config upgrade or
resetting to kubeadm defaults before a successful upgrade can be performed. The version to manually
upgrade to is denoted in the "PREFERRED VERSION" column.
API GROUP CURRENT VERSION PREFERRED VERSION MANUAL UPGRADE REQUIRED
kubeproxy.config.k8s.io v1alpha1 v1alpha1 no
kubelet.config.k8s.io v1beta1 v1beta1 no
_____________________________________________________________________
确认无误后执行：
sudo kubeadm upgrade apply v1.29.13如果存在其他的节点，那么在其他节点上执行：
sudo kubeadm upgrade node升级 kubelet 和 kubectl
sudo apt-mark unhold kubelet kubectl && \
sudo apt-get update && sudo apt-get install -y kubelet='1.29.13-*' kubectl='1.29.13-*' && \
sudo apt-mark hold kubelet kubectl
sudo systemctl daemon-reload
sudo systemctl restart kubelet