使用 kubeadm 部署 Kubernetes 开发测试集群

博主： ifangng
发布时间：2025 年 01 月 30 日
302 次浏览
1899字数
分类： kubernetes

环境配置

软件版本

操作系统：Rocky Linux 9.5
Kubernetes 版本：1.32.1
容器运行时：cri-docker
网络插件：Calico

操作系统分配

主机	配置	IP
K8s-master	2核4G	10.211.55.3
K8s-node01	2核4G	10.211.55.4
K8s-node02	2核4G	10.211.55.6

操作系统初始化

更换系统软件源

所有节点操作：

sed -e 's|^mirrorlist=|#mirrorlist=|g' \
    -e 's|^#baseurl=http://dl.rockylinux.org/$contentdir|baseurl=https://mirrors.aliyun.com/rockylinux|g' \
    -i.bak \
    /etc/yum.repos.d/[Rr]ocky*.repo
    
# 刷新缓存
dnf makecache

关闭防火墙

所有节点操作：

#关闭并禁止开机自启
systemctl disable --now firewalld.service
# 查看状态
systemctl status firewalld.service

关闭 SELinux

所有节点操作：

# 永久关闭
sed -ri 's#(SELINUX=)enforcing#\1disabled#g' /etc/selinux/config
# 临时关闭
setenforce 0
# 查看状态
getenforce

禁用 swap 分区

所有节点操作：

# 临时禁用
swapoff -a
# 永久禁用
sed -i 's/.*swap.*/#&/' /etc/fstab

添加 hosts

所有节点操作：

10.211.55.3 k8s-master
10.211.55.4 k8s-node01
10.211.55.6 k8s-node02

配置免密登录

master节点执行：

#安装sshpass
dnf install sshpass -y
#静默生成秘钥
ssh-keygen -P '' -q  -t rsa -f .ssh/id_rsa
# 密码
Password=YOURPASSWORD
#复制公钥到所有节点
for i in `awk -F"[ ]+" '/k8s/{print $0}' /etc/hosts`; do sshpass -p $Password ssh-copy-id -o StrictHostKeyChecking=no root@$i ;done 
#复制整个.ssh下文件到所有节点
scp -r $HOME/.ssh/* root@k8s-node01:$HOME/.ssh/
scp -r $HOME/.ssh/* root@k8s-node02:$HOME/.ssh/

修改内核参数

所有节点操作：

# k8s配置文件
cat >> /etc/sysctl.d/k8s.conf << EOF
#内核参数调整
vm.swappiness=0 
#配置iptables参数，使得流经网桥的流量也经过iptables/netfilter防火墙
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
net.ipv4.ip_forward = 1
EOF

# 加载网桥过滤模块
cat <<EOF | tee /etc/modules-load.d/k8s.conf
overlay
br_netfilter
EOF

modprobe overlay
modprobe br_netfilter

# 重新加载
sysctl --system
# 检测
lsmod | grep br_netfilter
# 返回如下内容表示成功
[root@k8s-master ~]# lsmod | grep br_netfilter
br_netfilter           32768  0
bridge                303104  1 br_netfilter

配置 ipvs 功能

所有节点操作：

# 安装ipset和ipvsadm
dnf install ipset ipvsadm -y
# 添加需要加载的模块写入脚本文件
cat <<EOF | sudo tee /etc/modules-load.d/ipvs.conf
overlay
ip_vs
ip_vs_rr
ip_vs_wrr
ip_vs_sh
nf_conntrack
EOF

modprobe overlay
modprobe ip_vs && modprobe ip_vs_rr && modprobe ip_vs_wrr && modprobe ip_vs_sh && modprobe nf_conntrack
 
#查看模块是否加载成功
[root@k8s-master ~]# lsmod | grep -e ip_vs -e nf_conntrack_ipv4
ip_vs_sh               12288  0
ip_vs_wrr              12288  0
ip_vs_rr               12288  6
ip_vs                 184320  12 ip_vs_rr,ip_vs_sh,ip_vs_wrr
nf_conntrack          200704  7 xt_conntrack,nf_nat,xt_nat,nf_conntrack_netlink,xt_CT,xt_MASQUERADE,ip_vs
nf_defrag_ipv6         24576  2 nf_conntrack,ip_vs
libcrc32c              12288  5 nf_conntrack,nf_nat,nf_tables,xfs,ip_vs

安装 Docker

所有节点操作：

dnf config-manager --add-repo=https://download.docker.com/linux/centos/docker-ce.repo
dnf update 
dnf install -y docker-ce

配置 Docker 加速器：

所有节点操作：

vi /etc/docker/daemon.json
{
  "registry-mirrors": ["https://docker.1panel.live"]
}

重启 Docker 服务：

所有节点操作：

sudo systemctl daemon-reload
sudo systemctl restart docker

设置 Docker 开机启动：

所有节点操作：

systemctl enable docker --now

安装运行时环境

所有节点操作:

# 下载对应版本和平台amd/arm的包https://github.com/Mirantis/cri-dockerd/releases
# 解压
tar -xf cri-dockerd-0.3.16.arm64.tgz
# 拷贝并设置执行权限
cp cri-dockerd/cri-dockerd /usr/bin/
chmod +x /usr/bin/cri-dockerd

配置cri-docker服务

所有节点操作:

cat <<"EOF" > /usr/lib/systemd/system/cri-docker.service
[Unit]
Description=CRI Interface for Docker Application Container Engine
Documentation=https://docs.mirantis.com
After=network-online.target firewalld.service docker.service
Wants=network-online.target
Requires=cri-docker.socket
[Service]
Type=notify
ExecStart=/usr/bin/cri-dockerd --network-plugin=cni --pod-infra-container-image=registry.aliyuncs.com/google_containers/pause:3.10
ExecReload=/bin/kill -s HUP $MAINPID
TimeoutSec=0
RestartSec=2
Restart=always
StartLimitBurst=3
StartLimitInterval=60s
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
TasksMax=infinity
Delegate=yes
KillMode=process
[Install]
WantedBy=multi-user.target
EOF

添加cri-docker套接字

所有节点操作:

cat <<"EOF" > /usr/lib/systemd/system/cri-docker.socket
[Unit]
Description=CRI Docker Socket for the API
PartOf=cri-docker.service
[Socket]
ListenStream=%t/cri-dockerd.sock
SocketMode=0660
SocketUser=root
SocketGroup=docker
[Install]
WantedBy=sockets.target
EOF

启动cri-docker对应服务

所有节点操作:

systemctl daemon-reload
# 设置开机启动
systemctl enable cri-docker
# 启动服务
systemctl start cri-docker
# 查看启动状态
systemctl is-active cri-docker # 输出结果为active表示启动正常

安装k8s集群

配置仓库源

所有节点操作:

# 配置1.32版本阿里源
cat <<EOF | tee /etc/yum.repos.d/kubernetes.repo
[kubernetes]
name=Kubernetes
baseurl=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/
enabled=1
gpgcheck=1
gpgkey=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/repodata/repomd.xml.key
EOF

安装kubelet、kubeadm、kubectl

所有节点操作:

# 安装
dnf install -y kubelet kubeadm kubectl
# 启动kubelet并设置开机自启
systemctl enable --now  kubelet
# 查看拉取的镜像 
kubeadm config images list --image-repository=registry.aliyuncs.com/google_containers
# 拉取镜像 --cri-socket 指定拉取时使用的容器运行时
kubeadm config images pull --image-repository=registry.aliyuncs.com/google_containers --cri-socket unix:///var/run/cri-dockerd.sock

初始化k8s集群

master节点操作:

kubeadm init --kubernetes-version=1.32.1 \
--apiserver-advertise-address=10.211.55.3 \
--image-repository registry.aliyuncs.com/google_containers \
--service-cidr=10.96.0.0/12 \
--pod-network-cidr=10.244.0.0/16 \
--ignore-preflight-errors=Swap \
--cri-socket=unix:///var/run/cri-dockerd.sock

# 初始化成功会显示如下信息
Your Kubernetes control-plane has initialized successfully!

To start using your cluster, you need to run the following as a regular user:

  mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config

Alternatively, if you are the root user, you can run:

  export KUBECONFIG=/etc/kubernetes/admin.conf

You should now deploy a pod network to the cluster.
Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
  https://kubernetes.io/docs/concepts/cluster-administration/addons/

Then you can join any number of worker nodes by running the following on each as root:

kubeadm join 10.211.55.3:6443 --token wft7f9.ytyacrye96ira9p2 \
        --discovery-token-ca-cert-hash sha256:d3f98caba36b99a0861a73cfb93731775f9852b91c78a7563e24bdf38aef9c63

设置k8s配置文件

master节点操作:

# 设置配置文件
mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config

# 复制到其他子节点
scp -r $HOME/.kube k8s-node01:$HOME/
scp -r $HOME/.kube k8s-node02:$HOME/

# 查看主节点状态
kubectl get componentstatuses
# 输出如下信息
NAME                 STATUS    MESSAGE   ERROR
scheduler            Healthy   ok        
controller-manager   Healthy   ok        
etcd-0               Healthy   ok

从节点加入集群

所有从节点执行:

# 使用cri-dockerd需要再kubeadm join后加入--cri-socket=unix:///var/run/cri-dockerd.sock
kubeadm join 10.211.55.3:6443 --token wft7f9.ytyacrye96ira9p2 \
        --discovery-token-ca-cert-hash sha256:d3f98caba36b99a0861a73cfb93731775f9852b91c78a7563e24bdf38aef9c63 --cri-socket unix:///var/run/cri-dockerd.sock

主节点查看状态:

kubectl get nodes

# 显示如下
[root@k8s-master ~]# kubectl get nodes
NAME         STATUS     ROLES           AGE     VERSION
k8s-master   NotReady   control-plane   7m25s   v1.32.1
k8s-node01   NotReady   <none>          55s     v1.32.1
k8s-node02   NotReady   <none>          46s     v1.32.1
# 当前集群是NotReady状态，还需要配置网络后才可用

设置k8s网络

以下操作都在master节点操作

安装Tigera Calico

官方网址：https://archive-os-3-26.netlify.app/calico/3.26/getting-started/kubernetes/quickstart/
打开文档中给定的最新版本地址，下载tigera-operator.yaml文件
打开文档中给定的最新版本地址，下载custom-resources.yaml文件

# 例如
wget https://raw.githubusercontent.com/projectcalico/calico/v3.26.5/manifests/tigera-operator.yaml
wget https://raw.githubusercontent.com/projectcalico/calico/v3.26.5/manifests/custom-resources.yaml

# 创建
kubectl create -f tigera-operator.yaml
# 查看tigera-operator内pod是否创建成功
kubectl get pods -n tigera-operator
# 输出如下内容表示创建成功
[root@k8s-master ~]# kubectl get pods -n tigera-operator
NAME                              READY   STATUS    RESTARTS   AGE
tigera-operator-b65bcdc98-fh2ml   1/1     Running   0          17s

安装calico

修改custom-resources.yaml配置文件

vim custom-resources.yaml

# cidr的地址为初始化k8s集群是配置的--pod-network-cidr=10.244.0.0/16地址
cidr: 192.168.0.0/16 
修改为
cidr: 10.244.0.0/16

创建资源
```
kubectl apply -f custom-resources.yaml
```

验证

# 查看是否创建calico-system命名空间
kubectl get ns
# 输出如下内容表示创建成功
[root@k8s-master ~]# kubectl get ns 
NAME               STATUS   AGE
calico-apiserver   Active   8m46s
calico-system      Active   42m
default            Active   59m
kube-node-lease    Active   59m
kube-public        Active   59m
kube-system        Active   59m
tigera-operator    Active   58s


# 查看pod是否创建完成
kubectl get pod -n calico-system
# 输出如下内容表示创建完成
[root@k8s-master ~]# kubectl get pod -n calico-system  
NAME                                       READY   STATUS              RESTARTS   AGE
calico-kube-controllers-6f6c89fff7-pzdkn   0/1     ContainerCreating   0          41s
calico-node-dvlbp                          1/1     Running             0          41s
calico-node-fwgwv                          1/1     Running             0          41s
calico-node-p4v6h                          1/1     Running             0          41s
calico-typha-74f7f775f-flsw6               1/1     Running             0          33s
calico-typha-74f7f775f-sgkkq               1/1     Running             0          41s
csi-node-driver-6thnf                      2/2     Running             0          41s
csi-node-driver-7jkpg                      2/2     Running             0          41s
csi-node-driver-rjvnl                      2/2     Running             0          41s


# 查看集群状态是否为ready
kubectl get nodes
# 输出如下内容即为成功
[root@k8s-master ~]# kubectl get nodes
NAME         STATUS   ROLES           AGE   VERSION
k8s-master   Ready    control-plane   60m   v1.32.1
k8s-node01   Ready    <none>          53m   v1.32.1
k8s-node02   Ready    <none>          53m   v1.32.1

配置k8s使用ipvs

# 编辑k8s-proxy的configmap文件,修改mode值为ipvs
kubectl edit configmaps kube-proxy  -n kube-system

mode: "ipvs" # 将mode: ""修改为mode: "ipvs"


# 删除所有kube-proxy让k8s进行自愈重建
kubectl delete pod -l k8s-app=kube-proxy  -n kube-system 

# 验证ipvs是否可用
ipvsadm -ln
# 输出如下内容
[root@k8s-master ~]# ipvsadm -ln
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
  -> RemoteAddress:Port           Forward Weight ActiveConn InActConn
TCP  10.96.0.1:443 rr
  -> 10.211.55.3:6443             Masq    1      1          0         
TCP  10.96.0.10:53 rr
  -> 10.244.235.195:53            Masq    1      0          0         
  -> 10.244.235.196:53            Masq    1      0          0         
TCP  10.96.0.10:9153 rr
  -> 10.244.235.195:9153          Masq    1      0          0         
  -> 10.244.235.196:9153          Masq    1      0          0         
TCP  10.99.39.163:5473 rr
  -> 10.211.55.4:5473             Masq    1      0          0         
  -> 10.211.55.6:5473             Masq    1      0          0         
TCP  10.107.112.14:443 rr
  -> 10.244.58.194:5443           Masq    1      0          0         
  -> 10.244.85.195:5443           Masq    1      0          0         
UDP  10.96.0.10:53 rr
  -> 10.244.235.195:53            Masq    1      0          0         
  -> 10.244.235.196:53            Masq    1      0          0

最后修改：2025 年 01 月 30 日

如果觉得我的文章对你有用，请随意赞赏

使用 kubeadm 部署 Kubernetes 开发测试集群

ifangng • 2025 年 01 月 30 日

<h2>环境配置</h2><h3>软件版本</h3><ul><li>操作系统：Rocky Linux 9.5</li><li>Kubernetes 版本：1.32.1</li><li>容器运行时：cri-docker</li><li>网络插件：Calico</li></ul><h3>操作系统分配</h3><table><thead><tr><th>主机</th><th>配置</th><th>IP</th></tr></thead><tbody><tr><td>K8s-master</td><td>2核4G</td><td>10.211.55.3</td></tr><tr><td>K8s-node01</td><td>2核4G</td><td>10.211.55.4</td></tr><tr><td>K8s-node02</td><td>2核4G</td><td>10.211.55.6</td></tr></tbody></table><h2>操作系统初始化</h2><h3>更换系统软件源</h3><p>所有节点操作：</p><pre><code class="lang-bash">sed -e &#039;s|^mirrorlist=|#mirrorlist=|g&#039; \
    -e &#039;s|^#baseurl=http://dl.rockylinux.org/$contentdir|baseurl=https://mirrors.aliyun.com/rockylinux|g&#039; \
    -i.bak \
    /etc/yum.repos.d/[Rr]ocky*.repo
    
# 刷新缓存
dnf makecache</code></pre><h3>关闭防火墙</h3><p>所有节点操作：</p><pre><code class="lang-bash">#关闭并禁止开机自启
systemctl disable --now firewalld.service
# 查看状态
systemctl status firewalld.service</code></pre><h3>关闭 SELinux</h3><p>所有节点操作：</p><pre><code class="lang-bash"># 永久关闭
sed -ri &#039;s#(SELINUX=)enforcing#\1disabled#g&#039; /etc/selinux/config
# 临时关闭
setenforce 0
# 查看状态
getenforce</code></pre><h3>禁用 swap 分区</h3><p>所有节点操作：</p><pre><code class="lang-bash"># 临时禁用
swapoff -a
# 永久禁用
sed -i &#039;s/.*swap.*/#&amp;/&#039; /etc/fstab</code></pre><h3>添加 hosts</h3><p>所有节点操作：</p><pre><code class="lang-bash">10.211.55.3 k8s-master
10.211.55.4 k8s-node01
10.211.55.6 k8s-node02</code></pre><h3>配置免密登录</h3><p>master节点执行：</p><pre><code class="lang-bash">#安装sshpass
dnf install sshpass -y
#静默生成秘钥
ssh-keygen -P &#039;&#039; -q  -t rsa -f .ssh/id_rsa
# 密码
Password=YOURPASSWORD
#复制公钥到所有节点
for i in `awk -F&quot;[ ]+&quot; &#039;/k8s/{print $0}&#039; /etc/hosts`; do sshpass -p $Password ssh-copy-id -o StrictHostKeyChecking=no root@$i ;done 
#复制整个.ssh下文件到所有节点
scp -r $HOME/.ssh/* root@k8s-node01:$HOME/.ssh/
scp -r $HOME/.ssh/* root@k8s-node02:$HOME/.ssh/</code></pre><h3>修改内核参数</h3><p>所有节点操作：</p><pre><code class="lang-bash"># k8s配置文件
cat &gt;&gt; /etc/sysctl.d/k8s.conf &lt;&lt; EOF
#内核参数调整
vm.swappiness=0 
#配置iptables参数，使得流经网桥的流量也经过iptables/netfilter防火墙
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
net.ipv4.ip_forward = 1
EOF

# 加载网桥过滤模块
cat &lt;&lt;EOF | tee /etc/modules-load.d/k8s.conf
overlay
br_netfilter
EOF

modprobe overlay
modprobe br_netfilter

# 重新加载
sysctl --system
# 检测
lsmod | grep br_netfilter
# 返回如下内容表示成功
[root@k8s-master ~]# lsmod | grep br_netfilter
br_netfilter           32768  0
bridge                303104  1 br_netfilter</code></pre><h3>配置 ipvs 功能</h3><p>所有节点操作：</p><pre><code class="lang-bash"># 安装ipset和ipvsadm
dnf install ipset ipvsadm -y
# 添加需要加载的模块写入脚本文件
cat &lt;&lt;EOF | sudo tee /etc/modules-load.d/ipvs.conf
overlay
ip_vs
ip_vs_rr
ip_vs_wrr
ip_vs_sh
nf_conntrack
EOF

modprobe overlay
modprobe ip_vs &amp;&amp; modprobe ip_vs_rr &amp;&amp; modprobe ip_vs_wrr &amp;&amp; modprobe ip_vs_sh &amp;&amp; modprobe nf_conntrack
 
#查看模块是否加载成功
[root@k8s-master ~]# lsmod | grep -e ip_vs -e nf_conntrack_ipv4
ip_vs_sh               12288  0
ip_vs_wrr              12288  0
ip_vs_rr               12288  6
ip_vs                 184320  12 ip_vs_rr,ip_vs_sh,ip_vs_wrr
nf_conntrack          200704  7 xt_conntrack,nf_nat,xt_nat,nf_conntrack_netlink,xt_CT,xt_MASQUERADE,ip_vs
nf_defrag_ipv6         24576  2 nf_conntrack,ip_vs
libcrc32c              12288  5 nf_conntrack,nf_nat,nf_tables,xfs,ip_vs</code></pre><h3>安装 Docker</h3><p>所有节点操作：</p><pre><code class="lang-shell">dnf config-manager --add-repo=https://download.docker.com/linux/centos/docker-ce.repo
dnf update 
dnf install -y docker-ce</code></pre><h3>配置 Docker 加速器：</h3><p>所有节点操作：</p><pre><code class="lang-bash">vi /etc/docker/daemon.json
{
  &quot;registry-mirrors&quot;: [&quot;https://docker.1panel.live&quot;]
}</code></pre><h3>重启 Docker 服务：</h3><p>所有节点操作：</p><pre><code class="lang-shell">sudo systemctl daemon-reload
sudo systemctl restart docker</code></pre><h3>设置 Docker 开机启动：</h3><p>所有节点操作：</p><pre><code class="lang-shell">systemctl enable docker --now</code></pre><h3>安装运行时环境</h3><p>所有节点操作:</p><pre><code class="lang-shell"># 下载对应版本和平台amd/arm的包https://github.com/Mirantis/cri-dockerd/releases
# 解压
tar -xf cri-dockerd-0.3.16.arm64.tgz
# 拷贝并设置执行权限
cp cri-dockerd/cri-dockerd /usr/bin/
chmod +x /usr/bin/cri-dockerd</code></pre><h3>配置cri-docker服务</h3><p>所有节点操作:</p><pre><code class="lang-shell">cat &lt;&lt;&quot;EOF&quot; &gt; /usr/lib/systemd/system/cri-docker.service
[Unit]
Description=CRI Interface for Docker Application Container Engine
Documentation=https://docs.mirantis.com
After=network-online.target firewalld.service docker.service
Wants=network-online.target
Requires=cri-docker.socket
[Service]
Type=notify
ExecStart=/usr/bin/cri-dockerd --network-plugin=cni --pod-infra-container-image=registry.aliyuncs.com/google_containers/pause:3.10
ExecReload=/bin/kill -s HUP $MAINPID
TimeoutSec=0
RestartSec=2
Restart=always
StartLimitBurst=3
StartLimitInterval=60s
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
TasksMax=infinity
Delegate=yes
KillMode=process
[Install]
WantedBy=multi-user.target
EOF</code></pre><h3>添加cri-docker套接字</h3><p>所有节点操作:</p><pre><code class="lang-shell">cat &lt;&lt;&quot;EOF&quot; &gt; /usr/lib/systemd/system/cri-docker.socket
[Unit]
Description=CRI Docker Socket for the API
PartOf=cri-docker.service
[Socket]
ListenStream=%t/cri-dockerd.sock
SocketMode=0660
SocketUser=root
SocketGroup=docker
[Install]
WantedBy=sockets.target
EOF</code></pre><h3>启动cri-docker对应服务</h3><p>所有节点操作:</p><pre><code class="lang-shell">systemctl daemon-reload
# 设置开机启动
systemctl enable cri-docker
# 启动服务
systemctl start cri-docker
# 查看启动状态
systemctl is-active cri-docker # 输出结果为active表示启动正常</code></pre><h2>安装k8s集群</h2><h3>配置仓库源</h3><p>所有节点操作:</p><pre><code class="lang-shell"># 配置1.32版本阿里源
cat &lt;&lt;EOF | tee /etc/yum.repos.d/kubernetes.repo
[kubernetes]
name=Kubernetes
baseurl=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/
enabled=1
gpgcheck=1
gpgkey=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/repodata/repomd.xml.key
EOF</code></pre><h3>安装kubelet、kubeadm、kubectl</h3><p>所有节点操作:</p><pre><code class="lang-shell"># 安装
dnf install -y kubelet kubeadm kubectl
# 启动kubelet并设置开机自启
systemctl enable --now  kubelet
# 查看拉取的镜像 
kubeadm config images list --image-repository=registry.aliyuncs.com/google_containers
# 拉取镜像 --cri-socket 指定拉取时使用的容器运行时
kubeadm config images pull --image-repository=registry.aliyuncs.com/google_containers --cri-socket unix:///var/run/cri-dockerd.sock</code></pre><h3>初始化k8s集群</h3><p>master节点操作:</p><pre><code class="lang-shell">kubeadm init --kubernetes-version=1.32.1 \
--apiserver-advertise-address=10.211.55.3 \
--image-repository registry.aliyuncs.com/google_containers \
--service-cidr=10.96.0.0/12 \
--pod-network-cidr=10.244.0.0/16 \
--ignore-preflight-errors=Swap \
--cri-socket=unix:///var/run/cri-dockerd.sock

# 初始化成功会显示如下信息
Your Kubernetes control-plane has initialized successfully!

To start using your cluster, you need to run the following as a regular user:

mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config

Alternatively, if you are the root user, you can run:

export KUBECONFIG=/etc/kubernetes/admin.conf

You should now deploy a pod network to the cluster.
Run &quot;kubectl apply -f [podnetwork].yaml&quot; with one of the options listed at:
  https://kubernetes.io/docs/concepts/cluster-administration/addons/

Then you can join any number of worker nodes by running the following on each as root:

kubeadm join 10.211.55.3:6443 --token wft7f9.ytyacrye96ira9p2 \
        --discovery-token-ca-cert-hash sha256:d3f98caba36b99a0861a73cfb93731775f9852b91c78a7563e24bdf38aef9c63</code></pre><h3>设置k8s配置文件</h3><p>master节点操作:</p><pre><code class="lang-shell"># 设置配置文件
mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config

# 复制到其他子节点
scp -r $HOME/.kube k8s-node01:$HOME/
scp -r $HOME/.kube k8s-node02:$HOME/

# 查看主节点状态
kubectl get componentstatuses
# 输出如下信息
NAME                 STATUS    MESSAGE   ERROR
scheduler            Healthy   ok        
controller-manager   Healthy   ok        
etcd-0               Healthy   ok</code></pre><h3>从节点加入集群</h3><p>所有从节点执行:</p><pre><code class="lang-shell"># 使用cri-dockerd需要再kubeadm join后加入--cri-socket=unix:///var/run/cri-dockerd.sock
kubeadm join 10.211.55.3:6443 --token wft7f9.ytyacrye96ira9p2 \
        --discovery-token-ca-cert-hash sha256:d3f98caba36b99a0861a73cfb93731775f9852b91c78a7563e24bdf38aef9c63 --cri-socket unix:///var/run/cri-dockerd.sock</code></pre><p>主节点查看状态:</p><pre><code class="lang-shell">kubectl get nodes

# 显示如下
[root@k8s-master ~]# kubectl get nodes
NAME         STATUS     ROLES           AGE     VERSION
k8s-master   NotReady   control-plane   7m25s   v1.32.1
k8s-node01   NotReady   &lt;none&gt;          55s     v1.32.1
k8s-node02   NotReady   &lt;none&gt;          46s     v1.32.1
# 当前集群是NotReady状态，还需要配置网络后才可用</code></pre><h2>设置k8s网络</h2><p>以下操作都在master节点操作</p><h3>安装Tigera Calico</h3><ul><li>官方网址：<span class="external-link"><a class="no-external-link" href="https://archive-os-3-26.netlify.app/calico/3.26/getting-started/kubernetes/quickstart/" target="_blank"><i data-feather="external-link"></i>https://archive-os-3-26.netlify.app/calico/3.26/getting-started/kubernetes/quickstart/</a></span></li><li>打开文档中给定的最新版本地址，下载tigera-operator.yaml文件</li><li>打开文档中给定的最新版本地址，下载custom-resources.yaml文件</li></ul><pre><code class="lang-shell"># 例如
wget https://raw.githubusercontent.com/projectcalico/calico/v3.26.5/manifests/tigera-operator.yaml
wget https://raw.githubusercontent.com/projectcalico/calico/v3.26.5/manifests/custom-resources.yaml

# 创建
kubectl create -f tigera-operator.yaml
# 查看tigera-operator内pod是否创建成功
kubectl get pods -n tigera-operator
# 输出如下内容表示创建成功
[root@k8s-master ~]# kubectl get pods -n tigera-operator
NAME                              READY   STATUS    RESTARTS   AGE
tigera-operator-b65bcdc98-fh2ml   1/1     Running   0          17s</code></pre><h3>安装calico</h3><ul><li><p>修改custom-resources.yaml配置文件</p><pre><code class="lang-shell">vim custom-resources.yaml

# cidr的地址为初始化k8s集群是配置的--pod-network-cidr=10.244.0.0/16地址
cidr: 192.168.0.0/16 
修改为
cidr: 10.244.0.0/16</code></pre></li><li><p>创建资源</p><pre><code class="lang-shell">kubectl apply -f custom-resources.yaml</code></pre></li><li><p>验证</p><pre><code class="lang-shell"># 查看是否创建calico-system命名空间
kubectl get ns
# 输出如下内容表示创建成功
[root@k8s-master ~]# kubectl get ns 
NAME               STATUS   AGE
calico-apiserver   Active   8m46s
calico-system      Active   42m
default            Active   59m
kube-node-lease    Active   59m
kube-public        Active   59m
kube-system        Active   59m
tigera-operator    Active   58s

# 查看pod是否创建完成
kubectl get pod -n calico-system
# 输出如下内容表示创建完成
[root@k8s-master ~]# kubectl get pod -n calico-system  
NAME                                       READY   STATUS              RESTARTS   AGE
calico-kube-controllers-6f6c89fff7-pzdkn   0/1     ContainerCreating   0          41s
calico-node-dvlbp                          1/1     Running             0          41s
calico-node-fwgwv                          1/1     Running             0          41s
calico-node-p4v6h                          1/1     Running             0          41s
calico-typha-74f7f775f-flsw6               1/1     Running             0          33s
calico-typha-74f7f775f-sgkkq               1/1     Running             0          41s
csi-node-driver-6thnf                      2/2     Running             0          41s
csi-node-driver-7jkpg                      2/2     Running             0          41s
csi-node-driver-rjvnl                      2/2     Running             0          41s

# 查看集群状态是否为ready
kubectl get nodes
# 输出如下内容即为成功
[root@k8s-master ~]# kubectl get nodes
NAME         STATUS   ROLES           AGE   VERSION
k8s-master   Ready    control-plane   60m   v1.32.1
k8s-node01   Ready    &lt;none&gt;          53m   v1.32.1
k8s-node02   Ready    &lt;none&gt;          53m   v1.32.1</code></pre></li></ul><h3>配置k8s使用ipvs</h3><pre><code class="lang-shell"># 编辑k8s-proxy的configmap文件,修改mode值为ipvs
kubectl edit configmaps kube-proxy  -n kube-system

mode: &quot;ipvs&quot; # 将mode: &quot;&quot;修改为mode: &quot;ipvs&quot;

# 删除所有kube-proxy让k8s进行自愈重建
kubectl delete pod -l k8s-app=kube-proxy  -n kube-system

# 验证ipvs是否可用
ipvsadm -ln
# 输出如下内容
[root@k8s-master ~]# ipvsadm -ln
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
  -&gt; RemoteAddress:Port           Forward Weight ActiveConn InActConn
TCP  10.96.0.1:443 rr
  -&gt; 10.211.55.3:6443             Masq    1      1          0         
TCP  10.96.0.10:53 rr
  -&gt; 10.244.235.195:53            Masq    1      0          0         
  -&gt; 10.244.235.196:53            Masq    1      0          0         
TCP  10.96.0.10:9153 rr
  -&gt; 10.244.235.195:9153          Masq    1      0          0         
  -&gt; 10.244.235.196:9153          Masq    1      0          0         
TCP  10.99.39.163:5473 rr
  -&gt; 10.211.55.4:5473             Masq    1      0          0         
  -&gt; 10.211.55.6:5473             Masq    1      0          0         
TCP  10.107.112.14:443 rr
  -&gt; 10.244.58.194:5443           Masq    1      0          0         
  -&gt; 10.244.85.195:5443           Masq    1      0          0         
UDP  10.96.0.10:53 rr
  -&gt; 10.244.235.195:53            Masq    1      0          0         
  -&gt; 10.244.235.196:53            Masq    1      0          0   </code></pre>

使用 kubeadm 部署 Kubernetes 开发测试集群

环境配置

软件版本

操作系统分配

操作系统初始化

更换系统软件源

关闭防火墙

关闭 SELinux

禁用 swap 分区

添加 hosts

配置免密登录

修改内核参数

配置 ipvs 功能

安装 Docker

配置 Docker 加速器：

重启 Docker 服务：

设置 Docker 开机启动：

安装运行时环境

配置cri-docker服务

添加cri-docker套接字

启动cri-docker对应服务

安装k8s集群

配置仓库源

安装kubelet、kubeadm、kubectl

初始化k8s集群

设置k8s配置文件

从节点加入集群

设置k8s网络

安装Tigera Calico

安装calico

配置k8s使用ipvs

MySQL8.0.36主从复制配置记录

iterm2美化记录

使用 kubeadm 部署 Kubernetes 开发测试集群

LLM（大语言模型）的前世今生：从词向量到通用智能的演进

MySQL8.0.36主从复制配置记录

iterm2美化记录

LLM（大语言模型）的前世今生：从词向量到通用智能的演进

使用 kubeadm 部署 Kubernetes 开发测试集群

使用 kubeadm 部署 Kubernetes 开发测试集群