{"id":7565,"date":"2023-01-04T21:40:23","date_gmt":"2023-01-04T12:40:23","guid":{"rendered":"https:\/\/lab4ict.com\/system\/?p=7565"},"modified":"2023-01-09T10:31:08","modified_gmt":"2023-01-09T01:31:08","slug":"kubeadm%e3%82%b3%e3%83%9e%e3%83%b3%e3%83%89%e3%81%a7kubernates%e3%81%ae%e3%82%af%e3%83%a9%e3%82%b9%e3%82%bf%e7%92%b0%e5%a2%83%e3%82%92%e6%a7%8b%e7%af%89%e3%81%99%e3%82%8b%ef%bc%81","status":"publish","type":"post","link":"https:\/\/lab4ict.com\/system\/archives\/7565","title":{"rendered":"kubeadm\u30b3\u30de\u30f3\u30c9\u3067Kubernates\u306e\u30af\u30e9\u30b9\u30bf\u74b0\u5883\u3092\u69cb\u7bc9\u3059\u308b\uff01"},"content":{"rendered":"

kubeadm\u30b3\u30de\u30f3\u30c9\u3067Kubernates\u306e\u30af\u30e9\u30b9\u30bf\u74b0\u5883\u3092\u69cb\u7bc9\u3059\u308b\uff01
\n<\/p>\n

\u30b3\u30f3\u30c8\u30ed\u30fc\u30eb\u30ce\u30fc\u30c9\u3068\u30ef\u30fc\u30ab\u30fc\u30ce\u30fc\u30c9\u306e\u540d\u524d\u89e3\u6c7a\u3092\u53ef\u80fd\u3068\u3059\u308b\uff01<\/h2>\n

\u30b3\u30f3\u30c8\u30ed\u30fc\u30eb\u30ce\u30fc\u30c9\u3068\u30ef\u30fc\u30ab\u30fc\u30ce\u30fc\u30c9\u306e\u540d\u524d\u89e3\u6c7a\u3092\/etc\/hosts\u3042\u308b\u3044\u306f\u3001DNS\u3067\u540d\u524d\u89e3\u6c7a\u53ef\u80fd\u306b\u3057\u307e\u3059\u3002<\/p>\n

Kubernates\u74b0\u5883\u3092\u521d\u671f\u5316\u3059\u308b\uff01<\/h2>\n
\r\n$ sudo kubeadm init --pod-network-cidr=10.200.0.0\/16\r\n[sudo] password for usradmin: \r\n[init] Using Kubernetes version: v1.26.0\r\n[preflight] Running pre-flight checks\r\n\t[WARNING Hostname]: hostname "vmsk8s81" could not be reached\r\n\t[WARNING Hostname]: hostname "vmsk8s81": lookup vmsk8s81 on 10.1.20.1:53: no such host\r\n\t[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'\r\n[preflight] Pulling images required for setting up a Kubernetes cluster\r\n[preflight] This might take a minute or two, depending on the speed of your internet connection\r\n[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'\r\n[certs] Using certificateDir folder "\/etc\/kubernetes\/pki"\r\n[certs] Generating "ca" certificate and key\r\n[certs] Generating "apiserver" certificate and key\r\n[certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local vmsk8s81] and IPs [10.96.0.1 10.1.97.81]\r\n[certs] Generating "apiserver-kubelet-client" certificate and key\r\n[certs] Generating "front-proxy-ca" certificate and key\r\n[certs] Generating "front-proxy-client" certificate and key\r\n[certs] Generating "etcd\/ca" certificate and key\r\n[certs] Generating "etcd\/server" certificate and key\r\n[certs] etcd\/server serving cert is signed for DNS names [localhost vmsk8s81] and IPs [10.1.97.81 127.0.0.1 ::1]\r\n[certs] Generating "etcd\/peer" certificate and key\r\n[certs] etcd\/peer serving cert is signed for DNS names [localhost vmsk8s81] and IPs [10.1.97.81 127.0.0.1 ::1]\r\n[certs] Generating "etcd\/healthcheck-client" certificate and key\r\n[certs] Generating "apiserver-etcd-client" certificate and key\r\n[certs] Generating "sa" key and public key\r\n[kubeconfig] Using kubeconfig folder "\/etc\/kubernetes"\r\n[kubeconfig] Writing "admin.conf" kubeconfig file\r\n[kubeconfig] Writing "kubelet.conf" kubeconfig file\r\n[kubeconfig] Writing "controller-manager.conf" kubeconfig file\r\n[kubeconfig] Writing "scheduler.conf" kubeconfig file\r\n[kubelet-start] Writing kubelet environment file with flags to file "\/var\/lib\/kubelet\/kubeadm-flags.env"\r\n[kubelet-start] Writing kubelet configuration to file "\/var\/lib\/kubelet\/config.yaml"\r\n[kubelet-start] Starting the kubelet\r\n[control-plane] Using manifest folder "\/etc\/kubernetes\/manifests"\r\n[control-plane] Creating static Pod manifest for "kube-apiserver"\r\n[control-plane] Creating static Pod manifest for "kube-controller-manager"\r\n[control-plane] Creating static Pod manifest for "kube-scheduler"\r\n[etcd] Creating static Pod manifest for local etcd in "\/etc\/kubernetes\/manifests"\r\n[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "\/etc\/kubernetes\/manifests". This can take up to 4m0s\r\n[apiclient] All control plane components are healthy after 10.503284 seconds\r\n[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace\r\n[kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster\r\n[upload-certs] Skipping phase. Please see --upload-certs\r\n[mark-control-plane] Marking the node vmsk8s81 as control-plane by adding the labels: [node-role.kubernetes.io\/control-plane node.kubernetes.io\/exclude-from-external-load-balancers]\r\n[mark-control-plane] Marking the node vmsk8s81 as control-plane by adding the taints [node-role.kubernetes.io\/control-plane:NoSchedule]\r\n[bootstrap-token] Using token: 2gtmrt.uliw8ddw1mot49xw\r\n[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles\r\n[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes\r\n[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials\r\n[bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token\r\n[bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster\r\n[bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace\r\n[kubelet-finalize] Updating "\/etc\/kubernetes\/kubelet.conf" to point to a rotatable kubelet client certificate and key\r\n[addons] Applied essential addon: CoreDNS\r\n[addons] Applied essential addon: kube-proxy\r\n\r\nYour Kubernetes control-plane has initialized successfully!\r\n\r\nTo start using your cluster, you need to run the following as a regular user:\r\n\r\n  mkdir -p $HOME\/.kube\r\n  sudo cp -i \/etc\/kubernetes\/admin.conf $HOME\/.kube\/config\r\n  sudo chown $(id -u):$(id -g) $HOME\/.kube\/config\r\n\r\nAlternatively, if you are the root user, you can run:\r\n\r\n  export KUBECONFIG=\/etc\/kubernetes\/admin.conf\r\n\r\nYou should now deploy a pod network to the cluster.\r\nRun "kubectl apply -f [podnetwork].yaml" with one of the options listed at:\r\n  https:\/\/kubernetes.io\/docs\/concepts\/cluster-administration\/addons\/\r\n\r\nThen you can join any number of worker nodes by running the following on each as root:\r\n\r\nkubeadm join 10.1.97.81:6443 --token 2gtmrt.uliw8ddw1mot49xw \\\r\n\t--discovery-token-ca-cert-hash sha256:8e7676f789f71f63e5d659da3d239cedc9e0a0523449a48d114bfbb8bc9fa3b7\r\n<\/pre>\n
\u30e1\u30fc\u30c3\u30bb\u30fc\u30b8\u51fa\u529b\u306e\u3068\u304a\u308a\u3001kubeadm\u74b0\u5883\u3092\u6574\u3048\u307e\u3059\u3002<\/p>\n
\r\n$ mkdir -p $HOME\/.kube\r\n$ sudo cp -i \/etc\/kubernetes\/admin.conf $HOME\/.kube\/config\r\n$ sudo chown $(id -u):$(id -g) $HOME\/.kube\/config\r\n<\/pre>\n
\u30ef\u30fc\u30ab\u30fc\u30ce\u30fc\u30c9\u3092\u767b\u9332\u3059\u308b\uff01<\/h2>\n
\u30ef\u30fc\u30ab\u30fc\u30ce\u30fc\u30c9\u3092\u767b\u9332\u3057\u307e\u3059\u3002\u4eca\u56de\u306f\u3001\u300cvmsk8s91\u300d\u3068\u300cvmsk8s92\u300d\u3044\u3046\u30de\u30b7\u30f3\u304b\u3089\u767b\u9332\u3057\u3066\u307f\u307e\u3057\u305f\u3002<\/p>\n
\r\n$ sudo kubeadm join 10.1.97.81:6443 --token 64yr1e.zl3ykzqa1m9bss2z        --discovery-token-ca-cert-hash sha256:8e7676f789f71f63e5d659da3d239cedc9e0a0523449a48d114bfbb8bc9fa3b7 \r\n[preflight] Running pre-flight checks\r\n[preflight] Reading configuration from the cluster...\r\n[preflight] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -o yaml'\r\n[kubelet-start] Writing kubelet configuration to file "\/var\/lib\/kubelet\/config.yaml"\r\n[kubelet-start] Writing kubelet environment file with flags to file "\/var\/lib\/kubelet\/kubeadm-flags.env"\r\n[kubelet-start] Starting the kubelet\r\n[kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap...\r\n[kubelet-check] Initial timeout of 40s passed.\r\n\r\nThis node has joined the cluster:\r\n* Certificate signing request was sent to apiserver and a response was received.\r\n* The Kubelet was informed of the new secure connection details.\r\n\r\nRun 'kubectl get nodes' on the control-plane to see this node join the cluster.\r\n<\/pre>\n
\u30b3\u30f3\u30c8\u30ed\u30fc\u30eb\u30d7\u30ec\u30fc\u30f3\u3067\u3001\u30ce\u30fc\u30c9\u304c\u8ffd\u52a0\u3055\u308c\u305f\u3053\u3068\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002<\/p>\n
\r\n$ kubectl get node\r\nNAME       STATUS     ROLES           AGE     VERSION\r\nvmsk8s81   NotReady   control-plane   4m48s   v1.26.0\r\nvmsk8s91   NotReady   <none>          2m42s   v1.26.0\r\nvmsk8s92   NotReady   <none>          2m      v1.26.0\r\n<\/pre>\n
Calico\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\uff01<\/h2>\n
Calico\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n
\r\n$ kubectl create -f https:\/\/raw.githubusercontent.com\/projectcalico\/calico\/v3.24.5\/manifests\/tigera-operator.yaml\r\n$ kubectl create -f https:\/\/raw.githubusercontent.com\/projectcalico\/calico\/v3.24.5\/manifests\/custom-resources.yaml\r\n<\/pre>\n
\u30ce\u30fc\u30c9\u306e\u72b6\u614b\u3092\u78ba\u8a8d\u3059\u308b\uff01<\/h2>\n
\u30ce\u30fc\u30c9\u306e\u72b6\u614b\u304c\u3059\u3079\u3066\u3001Ready\u306b\u306a\u3063\u305f\u3053\u3068\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002<\/p>\n
\r\n$ kubectl get node\r\nNAME       STATUS   ROLES           AGE   VERSION\r\nvmsk8s81   Ready    control-plane   64m   v1.26.0\r\nvmsk8s91   Ready    <none>          62m   v1.26.0\r\nvmsk8s92   Ready    <none>          61m   v1.26.0\r\n<\/pre>\n
Nginx\u3092\u52d5\u4f5c\u3055\u305b\u3066\u307f\u308b\uff01<\/h2>\n
Nginx\u3092\u52d5\u4f5c\u3055\u305b\u3066\u307f\u307e\u3059\u3002<\/p>\n
YAML\u30d5\u30a1\u30a4\u30eb\u3092\u7528\u610f\u3059\u308b\uff01<\/h3>\n
\u4ee5\u4e0b\u306eYAML\u30d5\u30a1\u30a4\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/p>\n
\r\n$ cat nginx.yaml \r\napiVersion: v1\r\nkind: Pod\r\nmetadata:\r\n  name: nginx\r\nspec:\r\n  containers:\r\n  - image: nginx:latest\r\n    name: nginx\r\n<\/pre>\n
Kubernates\u306e\u74b0\u5883\u306b\u9069\u7528\u3059\u308b\uff01<\/h3>\n
YAML\u30d5\u30a1\u30a4\u30eb\u3092Kubernates\u306e\u74b0\u5883\u306b\u9069\u7528\u3057\u307e\u3059\u3002<\/p>\n
\r\n$ kubectl apply -f nginx.yaml\r\npod\/nginx created\r\n<\/pre>\n
Nginx\u306ePod\u304c\u52d5\u4f5c\u3057\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002<\/p>\n
\r\n$ kubectl get pods\r\nNAME    READY   STATUS    RESTARTS   AGE\r\nnginx   1\/1     Running   0          60s\r\n<\/pre>\n
Pod\u306e\u72b6\u614b\u3092\u78ba\u8a8d\u3059\u308b\uff01<\/h3>\n
Nginx\u306ePod\u306e\u72b6\u614b\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002<\/p>\n
\r\n$ kubectl describe pod nginx\r\nName:             nginx\r\nNamespace:        default\r\nPriority:         0\r\nService Account:  default\r\nNode:             vmsk8s91\/10.1.97.91\r\nStart Time:       Mon, 09 Jan 2023 08:50:25 +0900\r\nLabels:           <none>\r\nAnnotations:      <none>\r\nStatus:           Running\r\nIP:               10.88.0.5\r\nIPs:\r\n  IP:  10.88.0.5\r\n  IP:  2001:4860:4860::5\r\nContainers:\r\n  nginx:\r\n    Container ID:   containerd:\/\/2a3e827647d101632026fb91758011691cb0bbdd002ba29bcb377aeb3a61840a\r\n    Image:          nginx:latest\r\n    Image ID:       docker.io\/library\/nginx@sha256:0047b729188a15da49380d9506d65959cce6d40291ccfb4e039f5dc7efd33286\r\n    Port:           <none>\r\n    Host Port:      <none>\r\n    State:          Running\r\n      Started:      Mon, 09 Jan 2023 08:50:28 +0900\r\n    Ready:          True\r\n    Restart Count:  0\r\n    Environment:    <none>\r\n    Mounts:\r\n      \/var\/run\/secrets\/kubernetes.io\/serviceaccount from kube-api-access-86rwh (ro)\r\nConditions:\r\n  Type              Status\r\n  Initialized       True \r\n  Ready             True \r\n  ContainersReady   True \r\n  PodScheduled      True \r\nVolumes:\r\n  kube-api-access-86rwh:\r\n    Type:                    Projected (a volume that contains injected data from multiple sources)\r\n    TokenExpirationSeconds:  3607\r\n    ConfigMapName:           kube-root-ca.crt\r\n    ConfigMapOptional:       <nil>\r\n    DownwardAPI:             true\r\nQoS Class:                   BestEffort\r\nNode-Selectors:              <none>\r\nTolerations:                 node.kubernetes.io\/not-ready:NoExecute op=Exists for 300s\r\n                             node.kubernetes.io\/unreachable:NoExecute op=Exists for 300s\r\nEvents:\r\n  Type    Reason     Age   From               Message\r\n  ----    ------     ----  ----               -------\r\n  Normal  Scheduled  2m2s  default-scheduler  Successfully assigned default\/nginx to vmsk8s91\r\n  Normal  Pulling    2m1s  kubelet            Pulling image "nginx:latest"\r\n  Normal  Pulled     2m    kubelet            Successfully pulled image "nginx:latest" in 1.589679623s (1.58968523s including waiting)\r\n  Normal  Created    2m    kubelet            Created container nginx\r\n  Normal  Started    119s  kubelet            Started container nginx\r\n\r\n<\/pre>\n
Nginx\u304c\u300cvmsk8s91\u300d\u4e0a\u3067\u3001\u300c10.88.0.5\u300d\u3067\u52d5\u4f5c\u3057\u3066\u3044\u308b\u3053\u3068\u304c\u308f\u304b\u308a\u307e\u3059\u3002<\/p>\n
Nginx\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b\uff01<\/h3>\n
\u300cvmsk8s91\u300d\u4e0a\u3067curl\u30b3\u30de\u30f3\u30c9\u3067\u30a2\u30af\u30bb\u30b9\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n
\r\n$ curl 10.88.0.5\r\n<!DOCTYPE html>\r\n<html>\r\n<head>\r\n<title>Welcome to nginx!<\/title>\r\n<style>\r\nhtml { color-scheme: light dark; }\r\nbody { width: 35em; margin: 0 auto;\r\nfont-family: Tahoma, Verdana, Arial, sans-serif; }\r\n<\/style>\r\n<\/head>\r\n<body>\r\n<h1>Welcome to nginx!<\/h1>\r\n<p>If you see this page, the nginx web server is successfully installed and\r\nworking. Further configuration is required.<\/p>\r\n\r\n<p>For online documentation and support please refer to\r\n<a href="http:\/\/nginx.org\/">nginx.org<\/a>.<br\/>\r\nCommercial support is available at\r\n<a href="http:\/\/nginx.com\/">nginx.com<\/a>.<\/p>\r\n\r\n<p><em>Thank you for using nginx.<\/em><\/p>\r\n<\/body>\r\n<\/html>\r\n<\/pre>\n
Nginx\u306e\u30c8\u30c3\u30d7\u30da\u30fc\u30b8\u306b\u30a2\u30af\u30bb\u30b9\u3067\u304d\u307e\u3057\u305f\u3002<\/p>\n
Nginx\u306ePod\u3092\u524a\u9664\u3059\u308b\uff01<\/h3>\n
\u6700\u5f8c\u306b\u3001\u30b3\u30f3\u30c8\u30ed\u30fc\u30eb\u30ce\u30fc\u30c9\u3067\u3001Nginx\u306ePod\u3092\u524a\u9664\u3057\u3066\u304a\u304d\u307e\u3059\u3002<\/p>\n
\r\n$ kubectl delete pod nginx\r\npod "nginx" deleted\r\n$ kubectl get pods\r\nNo resources found in default namespace.\r\n<\/pre>\n
\u52d5\u4f5c\u3057\u306a\u3044\u5834\u5408\u306f\u30fb\u30fb\u30fb<\/h2>\n
\u52d5\u4f5c\u3057\u306a\u3044\u5834\u5408\u306f\u3001containerd\u3068\u3001kublet\u306e\u30b5\u30fc\u30d3\u30b9\u306e\u30ed\u30b0\u3092\u898b\u3066\u3001\u30a8\u30e9\u30fc\u5185\u5bb9\u3092\u78ba\u8a8d\u3059\u308b\u3068\u89e3\u6c7a\u306b\u305f\u3069\u308a\u3051\u308b\u304b\u3082\u3057\u308c\u307e\u305b\u3093\u3002<\/p>\n
\r\n$ journalctl -xeu conatinerd\r\n$ journalctl -xeu kubulet\r\n<\/pre>\n
\u5b9f\u884c\u4e2d\u306b\u3001\u6700\u65b0\u306e\u30ed\u30b0\u3092\u78ba\u8a8d\u3059\u308b\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3059\u308b\u306e\u3082\u3088\u3044\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n
\r\n$ journalctl -xef\r\n<\/pre>\n
\u304a\u308f\u308a\u306b<\/h2>\n
kubeadm\u30b3\u30de\u30f3\u30c9\u3067\u30011\u500b\u306e\u30b3\u30f3\u30c8\u30ed\u30fc\u30eb\u30ce\u30fc\u30c9\u30012\u500b\u306e\u30ef\u30fc\u30ab\u30fc\u30ce\u30fc\u30c9\u306e\u69cb\u6210\u306eKubernates\u74b0\u5883\u3092\u69cb\u7bc9\u3057\u3066\u3001\u52d5\u4f5c\u78ba\u8a8d\u3068\u3057\u3066Nginx\u306ePod\u3092\u52d5\u4f5c\u3055\u305b\u3066\u307f\u307e\u3057\u305f\u3002<\/p>\n
\u53c2\u8003\u60c5\u5831<\/h2>\n