Forum Linux.général Kubernetes dashboard qui ne démarre pas

Posté par  . Licence CC By‑SA.
0
2
mar.
2021

Bonjour jeune entrepreneur,

Si tu maîtrises Kubernetes tu auras peut-être l’immense honneur de m’aider ! Voici mon problème :

Je tente d’installer un cluster Kubernetes, un master déjà pour commencer. Je fais ça sur une VM Debian 10 (KVM, hôte en Debian 10 aussi).

L’étape kubeadm init a bien abouti, je peux interroger le cluster :

$ kubectl cluster-info
Kubernetes control plane is running at https://192.168.122.204:6443
KubeDNS is running at https://192.168.122.204:6443/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy

To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.

Ensuite j’ai installé un CNI : Flannel, puis j’ai voulu installer le dashboard. Et c’est là que ça chie. L’installation (ie: le kubectl apply -f …) s’est bien déroulée, mais le pod ne démarre pas :

$ kubectl -n kubernetes-dashboard get pods
NAME                                         READY   STATUS               RESTARTS   AGE
dashboard-metrics-scraper-79c5968bdc-gxqct   0/1     CrashLoopBackOff     86         3d23h
kubernetes-dashboard-9f9799597-cdcbc         0/1     ContainerCannotRun   53         3d23h
$ kubectl -n kubernetes-dashboard describe pods kubernetes-dashboard-9f9799597-cdcbc |tail -n20
  Warning  FailedCreatePodSandBox  23h                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: runc did not terminate sucessfully: unknown
  Warning  FailedCreatePodSandBox  23h                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/00a5aab0c7edabe7c56fa373991492a3ebeffc64865b1b8b05b35a47bf5f7846/log.json: no such file or directory): runc did not terminate sucessfully: unknown
  Warning  FailedCreatePodSandBox  23h                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/237fefb18f26557c180d856b0789c7edf4fab8134e07c15d7cbcc2aaeec51d64/log.json: no such file or directory): runc did not terminate sucessfully: unknown
  Warning  FailedCreatePodSandBox  23h                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/e4a950a874522a6909b89217611da6aa10d49edf996f47635c54d3be2839e11d/log.json: no such file or directory): runc did not terminate sucessfully: unknown
  Warning  FailedCreatePodSandBox  23h (x3 over 23h)       kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: failed to start shim: fork/exec /usr/bin/docker-containerd-shim: resource temporarily unavailable: unknown
  Warning  FailedCreatePodSandBox  23h                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/fccfa3ebd614804419954d1d94d9c03e37885ddef0f4e2566114c9bb014092d6/log.json: no such file or directory): runc did not terminate sucessfully: unknown
  Warning  FailedCreatePodSandBox  23h                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/ffea13900939584c5bd1d491f1dc695452849485c6718486975a77625bca1921/log.json: no such file or directory): runc did not terminate sucessfully: unknown
  Normal   SandboxChanged          23h (x12 over 23h)      kubelet  Pod sandbox changed, it will be killed and re-created.
  Warning  FailedCreatePodSandBox  23h (x39 over 23h)      kubelet  (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/3d4227cd8ee3e5b1f7a1ab709523eeb8b2e75a496feea495889ec748ef41e550/log.json: no such file or directory): fork/exec /usr/sbin/runc: resource temporarily unavailable: unknown
  Warning  FailedCreatePodSandBox  51m                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "7d2be28bcba24165c3220a686094abaa2f997277beedf766a620179294caf9d3" network for pod "kubernetes-dashboard-9f9799597-cdcbc": networkPlugin cni failed to set up pod "kubernetes-dashboard-9f9799597-cdcbc_kubernetes-dashboard" network: open /run/flannel/subnet.env: no such file or directory
  Warning  FailedCreatePodSandBox  51m                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "1bd11304d6f7ab5f37f7465712dc18e6615013026e5a7ff45e0365da2ccb232c" network for pod "kubernetes-dashboard-9f9799597-cdcbc": networkPlugin cni failed to set up pod "kubernetes-dashboard-9f9799597-cdcbc_kubernetes-dashboard" network: open /run/flannel/subnet.env: no such file or directory
  Warning  FailedCreatePodSandBox  51m                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: container_linux.go:344: starting container process caused "process_linux.go:424: container init caused \"process_linux.go:407: running prestart hook 0 caused \\\"error running hook: exit status 2, stdout: , stderr: runtime/cgo: pthread_create failed: Resource temporarily unavailable\\\\nSIGABRT: abort\\\\nPC=0x7f210b6557bb m=0 sigcode=18446744073709551610\\\\n\\\\ngoroutine 0 [idle]:\\\\nruntime: unknown pc 0x7f210b6557bb\\\\nstack: frame={sp:0x7ffe926436b0, fp:0x0} stack=[0x7ffe91e44ba8,0x7ffe92643bd0)\\\\n00007ffe926435b0:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe926435c0:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe926435d0:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe926435e0:  0000000000000000  0000000000000000 \\\\n00007ffe926435f0:  0000000000000000  0000000000000000 \\\\n00007ffe92643600:  0000000000000000  0000000000000000 \\\\n00007ffe92643610:  0000000000000000  0000000000000000 \\\\n00007ffe92643620:  00007f210b98a9f0  00007f210b61d580 \\\\n00007ffe92643630:  0000000000000000  0000000000000000 \\\\n00007ffe92643640:  0000000000000000  0000000000000000 \\\\n00007ffe92643650:  0000000000000000  0000000000000000 \\\\n00007ffe92643660:  0000000000000000  0000000000000000 \\\\n00007ffe92643670:  0000000000000000  0000000000000000 \\\\n00007ffe92643680:  0000000000000000  0000000000000000 \\\\n00007ffe92643690:  0000000000000000  0000000000000000 \\\\n00007ffe926436a0:  00007f210b7de6f0  00005589e9065ce0 \\\\n00007ffe926436b0: <0000000000000000  00007f210b6a341a \\\\n00007ffe926436c0:  00007f2107d6e700  00007ffe92643700 \\\\n00007ffe926436d0:  00005589e42c25c7 <runtime.step+279>  00005589e6759642 \\\\n00007ffe926436e0:  0000000000ef1380  0000000000ef1380 \\\\n00007ffe926436f0:  0000027500000002  0000000000ef1380 \\\\n00007ffe92643700:  0000000000000002  800000000000000e \\\\n00007ffe92643710:  0000000000000000  0000000000000000 \\\\n00007ffe92643720:  0000000000000000  0000000000000000 \\\\n00007ffe92643730:  fffffffe7fffffff  ffffffffffffffff \\\\n00007ffe92643740:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643750:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643760:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643770:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643780:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643790:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe926437a0:  ffffffffffffffff  ffffffffffffffff \\\\nruntime: unknown pc 0x7f210b6557bb\\\\nstack: frame={sp:0x7ffe926436b0, fp:0x0} stack=[0x7ffe91e44ba8,0x7ffe92643bd0)\\\\n00007ffe926435b0:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe926435c0:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe926435d0:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe926435e0:  0000000000000000  0000000000000000 \\\\n00007ffe926435f0:  0000000000000000  0000000000000000 \\\\n00007ffe92643600:  0000000000000000  0000000000000000 \\\\n00007ffe92643610:  0000000000000000  0000000000000000 \\\\n00007ffe92643620:  00007f210b98a9f0  00007f210b61d580 \\\\n00007ffe92643630:  0000000000000000  0000000000000000 \\\\n00007ffe92643640:  0000000000000000  0000000000000000 \\\\n00007ffe92643650:  0000000000000000  0000000000000000 \\\\n00007ffe92643660:  0000000000000000  0000000000000000 \\\\n00007ffe92643670:  0000000000000000  0000000000000000 \\\\n00007ffe92643680:  0000000000000000  0000000000000000 \\\\n00007ffe92643690:  0000000000000000  0000000000000000 \\\\n00007ffe926436a0:  00007f210b7de6f0  00005589e9065ce0 \\\\n00007ffe926436b0: <0000000000000000  00007f210b6a341a \\\\n00007ffe926436c0:  00007f2107d6e700  00007ffe92643700 \\\\n00007ffe926436d0:  00005589e42c25c7 <runtime.step+279>  00005589e6759642 \\\\n00007ffe926436e0:  0000000000ef1380  0000000000ef1380 \\\\n00007ffe926436f0:  0000027500000002  0000000000ef1380 \\\\n00007ffe92643700:  0000000000000002  800000000000000e \\\\n00007ffe92643710:  0000000000000000  0000000000000000 \\\\n00007ffe92643720:  0000000000000000  0000000000000000 \\\\n00007ffe92643730:  fffffffe7fffffff  ffffffffffffffff \\\\n00007ffe92643740:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643750:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643760:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643770:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643780:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe92643790:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffe926437a0:  ffffffffffffffff  ffffffffffffffff \\\\n\\\\ngoroutine 1 [running, locked to thread]:\\\\nruntime.asmcgocall(0x5589e595dfa0, 0xc00005a720)\\\\n\\\\t/usr/lib/go-1.11/src/runtime/asm_amd64.s:622 +0x3f fp=0xc00005a6f8 sp=0xc00005a6f0 pc=0x5589e42d37cf\\\\nruntime.newm1(0xc00005ee00)\\\\n\\\\t/usr/lib/go-1.11/src/runtime/proc.go:1935 +0xc8 fp=0xc00005a748 sp=0xc00005a6f8 pc=0x5589e42a9288\\\\nruntime.newm(0x5589e65ef1c0, 0x0)\\\\n\\\\t/usr/lib/go-1.11/src/runtime/proc.go:1919 +0x9f fp=0xc00005a778 sp=0xc00005a748 pc=0x5589e42a910f\\\\nruntime.startTemplateThread()\\\\n\\\\t/usr/lib/go-1.11/src/runtime/proc.go:1955 +0x51 fp=0xc00005a798 sp=0xc00005a778 pc=0x5589e42a9351\\\\nruntime.main()\\\\n\\\\t/usr/lib/go-1.11/src/runtime/proc.go:184 +0x19c fp=0xc00005a7e0 sp=0xc00005a798 pc=0x5589e42a4efc\\\\nruntime.goexit()\\\\n\\\\t/usr/lib/go-1.11/src/runtime/asm_amd64.s:1333 +0x1 fp=0xc00005a7e8 sp=0xc00005a7e0 pc=0x5589e42d4091\\\\n\\\\nrax    0x0\\\\nrbx    0x6\\\\nrcx    0x7f210b6557bb\\\\nrdx    0x0\\\\nrdi    0x2\\\\nrsi    0x7ffe926436b0\\\\nrbp    0x5589e5ca6ef5\\\\nrsp    0x7ffe926436b0\\\\nr8     0x0\\\\nr9     0x7ffe926436b0\\\\nr10    0x8\\\\nr11    0x246\\\\nr12    0x5589e9065e70\\\\nr13    0x11\\\\nr14    0x5589e5c50514\\\\nr15    0x0\\\\nrip    0x7f210b6557bb\\\\nrflags 0x246\\\\ncs     0x33\\\\nfs     0x0\\\\ngs     0x0\\\\n\\\"\"": unknown
  Warning  FailedCreatePodSandBox  51m                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: runc did not terminate sucessfully: unknown
  Warning  FailedCreatePodSandBox  50m                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: ttrpc: client shutting down: read unix @->/run/containerd/s/37b673c7316d7c428c39e2c5e09d7d6eb1f1d79b9104c658bab11ffb45ac6b3c: read: connection reset by peer: unknown
  Warning  FailedCreatePodSandBox  50m                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: container_linux.go:344: starting container process caused "process_linux.go:269: starting init process command caused \"fork/exec /proc/self/exe: resource temporarily unavailable\"": unknown
  Warning  FailedCreatePodSandBox  50m                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/3030ca2f8bbb0d5175b2ae2740847b6dc7b531c329260e5f4aec70759b9ec61e/log.json: no such file or directory): runc did not terminate sucessfully: unknown
  Warning  FailedCreatePodSandBox  50m                     kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/6b8532ce7583f71896b176cf46bd9acbcc881c11c50b129cac1f3b8d359bf041/log.json: no such file or directory): runc did not terminate sucessfully: unknown
  Warning  FailedCreatePodSandBox  50m (x2 over 50m)       kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: failed to start shim: fork/exec /usr/bin/docker-containerd-shim: resource temporarily unavailable: unknown
  Normal   SandboxChanged          36m (x232 over 51m)     kubelet  Pod sandbox changed, it will be killed and re-created.
  Warning  FailedCreatePodSandBox  91s (x639 over 50m)     kubelet  (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "kubernetes-dashboard-9f9799597-cdcbc": Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/2194dac0e95b9127d513526afc36c6efcbd6d4e0781f6f27cc287ed0607d4e6f/log.json: no such file or directory): fork/exec /usr/sbin/runc: resource temporarily unavailable: unknown

Alors voilà, je suis bloqué là. On voit bien que j’ai certains conteneurs, liés à Kubernetes, qui sont démarrés (ici je lance la commande directement sur le cluster) :

# docker ps
CONTAINER ID        IMAGE                  COMMAND                  CREATED             STATUS              PORTS               NAMES
ba80d3a65e72        k8s.gcr.io/pause:3.2   "/pause"                 About an hour ago   Up About an hour                        k8s_POD_dashboard-metrics-scraper-79c5968bdc-gxqct_kubernetes-dashboard_9533858c-0ea8-4d48-8a20-3695d61a4072_22
72930d1f2f4c        dee1cac4dd20           "/opt/bin/flanneld -…"   About an hour ago   Up About an hour                        k8s_kube-flannel_kube-flannel-ds-jrtcn_kube-system_d6784bba-66fe-41c6-9dd5-d205300e9683_21
b6e15e6f567f        c29e6c583067           "/usr/local/bin/kube…"   About an hour ago   Up About an hour                        k8s_kube-proxy_kube-proxy-6x2rv_kube-system_3571a164-3e11-4ebe-8e31-563080ce8aba_16
0ff40e1f847d        k8s.gcr.io/pause:3.2   "/pause"                 About an hour ago   Up About an hour                        k8s_POD_kube-flannel-ds-jrtcn_kube-system_d6784bba-66fe-41c6-9dd5-d205300e9683_14
0720c23b9f4b        k8s.gcr.io/pause:3.2   "/pause"                 About an hour ago   Up About an hour                        k8s_POD_coredns-74ff55c5b-jklcd_kube-system_a72b0284-7719-413e-9622-1f09fa245ce5_16
923bae3f5c32        k8s.gcr.io/pause:3.2   "/pause"                 About an hour ago   Up About an hour                        k8s_POD_kube-proxy-6x2rv_kube-system_3571a164-3e11-4ebe-8e31-563080ce8aba_13
be64289b7fab        5f8cb769bd73           "kube-scheduler --au…"   About an hour ago   Up About an hour                        k8s_kube-scheduler_kube-scheduler-bouillon_kube-system_90280dfce8bf44f46a3e41b6c4a9f551_13
f6a94c1f735f        0a41a1414c53           "kube-controller-man…"   About an hour ago   Up About an hour                        k8s_kube-controller-manager_kube-controller-manager-bouillon_kube-system_c4804a7e661ad03b11396c7acdda8c3a_13
023765cc3557        k8s.gcr.io/pause:3.2   "/pause"                 About an hour ago   Up About an hour                        k8s_POD_kube-scheduler-bouillon_kube-system_90280dfce8bf44f46a3e41b6c4a9f551_13
f5092b423253        k8s.gcr.io/pause:3.2   "/pause"                 About an hour ago   Up About an hour                        k8s_POD_kube-controller-manager-bouillon_kube-system_c4804a7e661ad03b11396c7acdda8c3a_13
bb62cf85c401        ae5eb22e4a9d           "kube-apiserver --ad…"   About an hour ago   Up About an hour                        k8s_kube-apiserver_kube-apiserver-bouillon_kube-system_c5a79b6a4db0fe0104f6d6632115f3b8_14
de275953d9d0        k8s.gcr.io/pause:3.2   "/pause"                 About an hour ago   Up About an hour                        k8s_POD_kube-apiserver-bouillon_kube-system_c5a79b6a4db0fe0104f6d6632115f3b8_13
bdc5ab95ba1a        0369cf4303ff           "etcd --advertise-cl…"   About an hour ago   Up About an hour                        k8s_etcd_etcd-bouillon_kube-system_fa16f8225a7397b6a665d2de0b1ff6db_13
da2af50bce5c        k8s.gcr.io/pause:3.2   "/pause"                 About an hour ago   Up About an hour                        k8s_POD_etcd-bouillon_kube-system_fa16f8225a7397b6a665d2de0b1ff6db_13

Par contre, et c’est là que je ne comprends plus, si j’essaie de démarrer un bête conteneur manuellement il ne démarre pas ! Il reste à l’état "Created" et j’ai ce message d’erreur (commande lancée sur le cluster) :

# docker run -it centos:7
Unable to find image 'centos:7' locally
7: Pulling from library/centos
2d473b07cdd5: Pull complete 
Digest: sha256:0f4ec88e21daf75124b8a9e5ca03c37a5e937e0e108a255d890492430789b60e
Status: Downloaded newer image for centos:7
docker: Error response from daemon: OCI runtime create failed: container_linux.go:344: starting container process caused "process_linux.go:424: container init caused \"process_linux.go:407: running prestart hook 0 caused \\\"error running hook: exit status 2, stdout: , stderr: runtime/cgo: pthread_create failed: Resource temporarily unavailable\\\\nSIGABRT: abort\\\\nPC=0x7f91fa9e57bb m=0 sigcode=18446744073709551610\\\\n\\\\ngoroutine 0 [idle]:\\\\nruntime: unknown pc 0x7f91fa9e57bb\\\\nstack: frame={sp:0x7ffc44401870, fp:0x0} stack=[0x7ffc43c02ef8,0x7ffc44401f20)\\\\n00007ffc44401770:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401780:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401790:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc444017a0:  0000000000000000  0000000000000000 \\\\n00007ffc444017b0:  0000000000000000  0000000000000000 \\\\n00007ffc444017c0:  0000000000000000  0000000000000000 \\\\n00007ffc444017d0:  0000000000000000  0000000000000000 \\\\n00007ffc444017e0:  00007f91fad1a9f0  00007f91fa9ad580 \\\\n00007ffc444017f0:  0000000000000000  0000000000000000 \\\\n00007ffc44401800:  0000000000000000  0000000000000000 \\\\n00007ffc44401810:  0000000000000000  0000000000000000 \\\\n00007ffc44401820:  0000000000000000  0000000000000000 \\\\n00007ffc44401830:  0000000000000000  0000000000000000 \\\\n00007ffc44401840:  0000000000000000  0000000000000000 \\\\n00007ffc44401850:  0000000000000000  0000000000000000 \\\\n00007ffc44401860:  00007f91fad1a9f0  00007f91fa9ad580 \\\\n00007ffc44401870: <0000000000000000  0000000000000000 \\\\n00007ffc44401880:  0000000000000000  0000000000000000 \\\\n00007ffc44401890:  0000000000000000  0000000000000000 \\\\n00007ffc444018a0:  0000000000000000  0000000000000000 \\\\n00007ffc444018b0:  0000000000000000  0000000000000000 \\\\n00007ffc444018c0:  0000000000000002  800000000000000e \\\\n00007ffc444018d0:  0000000000000000  0000000000000000 \\\\n00007ffc444018e0:  0000000000000000  0000000000000000 \\\\n00007ffc444018f0:  fffffffe7fffffff  ffffffffffffffff \\\\n00007ffc44401900:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401910:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401920:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401930:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401940:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401950:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401960:  ffffffffffffffff  ffffffffffffffff \\\\nruntime: unknown pc 0x7f91fa9e57bb\\\\nstack: frame={sp:0x7ffc44401870, fp:0x0} stack=[0x7ffc43c02ef8,0x7ffc44401f20)\\\\n00007ffc44401770:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401780:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401790:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc444017a0:  0000000000000000  0000000000000000 \\\\n00007ffc444017b0:  0000000000000000  0000000000000000 \\\\n00007ffc444017c0:  0000000000000000  0000000000000000 \\\\n00007ffc444017d0:  0000000000000000  0000000000000000 \\\\n00007ffc444017e0:  00007f91fad1a9f0  00007f91fa9ad580 \\\\n00007ffc444017f0:  0000000000000000  0000000000000000 \\\\n00007ffc44401800:  0000000000000000  0000000000000000 \\\\n00007ffc44401810:  0000000000000000  0000000000000000 \\\\n00007ffc44401820:  0000000000000000  0000000000000000 \\\\n00007ffc44401830:  0000000000000000  0000000000000000 \\\\n00007ffc44401840:  0000000000000000  0000000000000000 \\\\n00007ffc44401850:  0000000000000000  0000000000000000 \\\\n00007ffc44401860:  00007f91fad1a9f0  00007f91fa9ad580 \\\\n00007ffc44401870: <0000000000000000  0000000000000000 \\\\n00007ffc44401880:  0000000000000000  0000000000000000 \\\\n00007ffc44401890:  0000000000000000  0000000000000000 \\\\n00007ffc444018a0:  0000000000000000  0000000000000000 \\\\n00007ffc444018b0:  0000000000000000  0000000000000000 \\\\n00007ffc444018c0:  0000000000000002  800000000000000e \\\\n00007ffc444018d0:  0000000000000000  0000000000000000 \\\\n00007ffc444018e0:  0000000000000000  0000000000000000 \\\\n00007ffc444018f0:  fffffffe7fffffff  ffffffffffffffff \\\\n00007ffc44401900:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401910:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401920:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401930:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401940:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401950:  ffffffffffffffff  ffffffffffffffff \\\\n00007ffc44401960:  ffffffffffffffff  ffffffffffffffff \\\\n\\\\ngoroutine 1 [running, locked to thread]:\\\\nruntime.systemstack_switch()\\\\n\\\\t/usr/lib/go-1.11/src/runtime/asm_amd64.s:311 fp=0xc00005a708 sp=0xc00005a700 pc=0x55e21a692f80\\\\nruntime.newproc(0x55e200000000, 0x55e21c9affb0)\\\\n\\\\t/usr/lib/go-1.11/src/runtime/proc.go:3311 +0x70 fp=0xc00005a750 sp=0xc00005a708 pc=0x55e21a66dd80\\\\nruntime.init.4()\\\\n\\\\t/usr/lib/go-1.11/src/runtime/proc.go:240 +0x37 fp=0xc00005a770 sp=0xc00005a750 pc=0x55e21a666107\\\\nruntime.init()\\\\n\\\\t<autogenerated>:1 +0xea fp=0xc00005a798 sp=0xc00005a770 pc=0x55e21a692c2a\\\\nruntime.main()\\\\n\\\\t/usr/lib/go-1.11/src/runtime/proc.go:147 +0xcd fp=0xc00005a7e0 sp=0xc00005a798 pc=0x55e21a665e2d\\\\nruntime.goexit()\\\\n\\\\t/usr/lib/go-1.11/src/runtime/asm_amd64.s:1333 +0x1 fp=0xc00005a7e8 sp=0xc00005a7e0 pc=0x55e21a695091\\\\n\\\\nrax    0x0\\\\nrbx    0x6\\\\nrcx    0x7f91fa9e57bb\\\\nrdx    0x0\\\\nrdi    0x2\\\\nrsi    0x7ffc44401870\\\\nrbp    0x55e21c067ef5\\\\nrsp    0x7ffc44401870\\\\nr8     0x0\\\\nr9     0x7ffc44401870\\\\nr10    0x8\\\\nr11    0x246\\\\nr12    0x55e21ea1db30\\\\nr13    0x11\\\\nr14    0x55e21c011514\\\\nr15    0x0\\\\nrip    0x7f91fa9e57bb\\\\nrflags 0x246\\\\ncs     0x33\\\\nfs     0x0\\\\ngs     0x0\\\\n\\\"\"": unknown.
# docker ps -a |grep centos
ebc6ee374d20        centos:7                 "/bin/bash"              About a minute ago   Created   kind_dubinsky

# docker exec -it ebc6ee374d20 /bin/bash
Error response from daemon: Container ebc6ee374d20c2bcde59f6ee22493e012e88ac7f2320036b9bac0467afa86ab1 is not running

Ensuite je n’ai pas toujours la même chose :

# docker run -d centos:7
Unable to find image 'centos:7' locally
7: Pulling from library/centos
2d473b07cdd5: Pull complete 
Digest: sha256:0f4ec88e21daf75124b8a9e5ca03c37a5e937e0e108a255d890492430789b60e
Status: Downloaded newer image for centos:7
4bca320c9b43e7f64c4b8a5e3e4bb34abf537af4c996b505a1059a0e688d32a7
docker: Error response from daemon: transport is closing: unavailable.

# docker run -d centos:7
b80a4d473d134e4cefa41eeac664815b2508847368d21a09199852857134dbf5
docker: Error response from daemon: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/b80a4d473d134e4cefa41eeac664815b2508847368d21a09199852857134dbf5/log.json: no such file or directory): runc did not terminate sucessfully: unknown.

Au niveau des versions utilisées, j’ai découvert que Kubernetes n’avait pas de dépôt pour Debian, seulement pour Ubuntu. Alors je ne sais pas si mon problème pourrait venir de là, peut-être… Qu’en pensez-vous ?

# cat /etc/apt/sources.list.d/kubernetes.list 
deb https://apt.kubernetes.io/ kubernetes-xenial main

# dpkg -l |grep kube
hi  kubeadm                        1.20.4-00                    amd64        Kubernetes Cluster Bootstrapping Tool
hi  kubectl                        1.20.4-00                    amd64        Kubernetes Command Line Tool
hi  kubelet                        1.20.4-00                    amd64        Kubernetes Node Agent
ii  kubernetes-cni                 0.8.7-00                     amd64        Kubernetes CNI

# dpkg -l |grep -E 'runc|container|docker'
rc  docker-engine                  1.11.2-0~xenial              amd64        Docker: the open-source application container engine
ii  docker.io                      18.09.1+dfsg1-7.1+deb10u3    amd64        Linux container runtime
ii  libnss-mymachines:amd64        241-7~deb10u6                amd64        nss module to resolve hostnames for local container instances
ii  runc                           1.0.0~rc6+dfsg1-3            amd64        Open Container Project - runtime
ii  systemd-container              241-7~deb10u6                amd64        systemd container/nspawn tools
ii  tini                           0.18.0-1                     amd64        tiny but valid init for containers

Par où dois-je commencer ?

Pensez-vous que la meilleure chose à faire soit de tenter à nouveau l’exercice sous CentOS 7 ?

Question subsidiaire : Quel est votre avis sur la hype Kubernetes/Conteneurisation/IAC ? Je découvre ça (avec Rancher et bientôt Openshift) et je trouve que ça sent très fort la peinture fraîche ! La normalisation est à peine entamée (OCI/CNI) avec encore un tas de technologies récentes qui s’affrontent, des projets qui voient les choses tous un peu différement. Et vous, quel est votre avis (éclairé ou non !) sur la question ?

  • # Ressources

    Posté par  . Évalué à 3.

    Cela semble bizarre. Au niveua des ressources, tu as assez de RAM (pas d'oomkiller dans dmesg ?), assez de disque ?

    Au niveau des limites systèmes, tout est aussi ok ? pas de limites atteinte avec ulimit ? avec systemd https://unix.stackexchange.com/a/255603 ?

    « Rappelez-vous toujours que si la Gestapo avait les moyens de vous faire parler, les politiciens ont, eux, les moyens de vous faire taire. » Coluche

  • # Firewall ?

    Posté par  . Évalué à 1. Dernière modification le 03 mars 2021 à 10:31.

    Bonjour,

    Côté firewall, tu as bien ouvert tout ce qu'il fallait ? Tes pods communiquent entre eux (flux/routage des interfaces cni0, range 10.x ouvert, etc.) ?

    • [^] # Re: Firewall ?

      Posté par  . Évalué à 1.

      Je me réponds à moi même, mais à l'énoncé de tes soucis, tes soucis semblent plus liés à l'instabilité de ton infra, voire de tes machines.
      As-tu tout d'abord essayé avec un simple "minikube" pour voir ? Et ensuite, un modèle 1 Master/1-3 nodes me semble plus pertinent pour tester les choses en "vrai", voire (comme je le fais actuellement), trois masters/quatre nodes pour avoir un vrai simulacre de cluster.

      Avec les fressources qui vont bien. J'ai un cluster k8s de 3 masters et 4 nodes, deux vcpus par machine, 2 Go par master, 2/4 Go par node, qui tourne comme une horloge. Sous du Virtualbox (machine huit coeurs et 32 Go).

      Concernant le "c'est pas sec", je joue avec Kubernetes et Openshift depuis 2015, et les containers depuis 2013, et si je constate parfois des soucis, des bugs, des comportements parfois surprenants (par exemple sur le mécanisme d'éviction des pods depuis k8s 1.18), c'est assez fiable, selon les implémentations des grand éditeurs (Un openshift 4.x est bien pllus testé et intégré qu'une install k8s maison). Reste que k8s avance vite, parfois trop vite, et il faut savoir se poser sur une version stabilisése plutôt que de courir vers les toutes dernières releases.

Suivre le flux des commentaires

Note : les commentaires appartiennent à celles et ceux qui les ont postés. Nous n’en sommes pas responsables.