Jan 04 18:47:07 k8s-master-1 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...
Jan 04 18:47:07 k8s-master-1 kubelet[5536]: I0104 18:47:07.314280    5536 dynamic_cafile_content.go:171] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
Jan 04 18:47:07 k8s-master-1 systemd[1]: kubelet.service: Deactivated successfully.
Jan 04 18:47:07 k8s-master-1 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 04 18:47:07 k8s-master-1 systemd[1]: kubelet.service: Consumed 11.460s CPU time.
Jan 04 18:47:07 k8s-master-1 systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI.
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: I0104 18:47:07.377676   10325 server.go:204] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: I0104 18:47:07.382882   10325 server.go:487] "Kubelet version" kubeletVersion="v1.29.0"
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: I0104 18:47:07.383515   10325 server.go:489] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: I0104 18:47:07.383996   10325 server.go:919] "Client rotation is on, will bootstrap in background"
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: I0104 18:47:07.387134   10325 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: I0104 18:47:07.388986   10325 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: W0104 18:47:07.389596   10325 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "/var/run/containerd/containerd.sock", ServerName: "%2Fvar%2Frun%2Fcontainerd%2Fcontainerd.sock", }. Err: connection error: desc = "transport: Error while dialing: dial unix /var/run/containerd/containerd.sock: connect: no such file or directory"
Jan 04 18:47:07 k8s-master-1 kubelet[10325]: E0104 18:47:07.389697   10325 run.go:74] "command failed" err="failed to run Kubelet: validate service connection: validate CRI v1 runtime API for endpoint \"unix:///var/run/containerd/containerd.sock\": rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /var/run/containerd/containerd.sock: connect: no such file or directory\""
Jan 04 18:47:07 k8s-master-1 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE
Jan 04 18:47:07 k8s-master-1 systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 04 18:47:17 k8s-master-1 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1.
Jan 04 18:47:17 k8s-master-1 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 04 18:47:17 k8s-master-1 systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI.
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.616657   10502 server.go:204] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.619738   10502 server.go:487] "Kubelet version" kubeletVersion="v1.29.0"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.619838   10502 server.go:489] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.619977   10502 server.go:919] "Client rotation is on, will bootstrap in background"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.621070   10502 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.622632   10502 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629119   10502 server.go:745] "--cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629392   10502 container_manager_linux.go:265] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629530   10502 container_manager_linux.go:270] "Creating Container Manager object based on Node Config" nodeConfig={"RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null}
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629564   10502 topology_manager.go:138] "Creating topology manager with none policy"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629572   10502 container_manager_linux.go:301] "Creating device plugin manager"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629598   10502 state_mem.go:36] "Initialized new in-memory state store"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629669   10502 kubelet.go:396] "Attempting to sync node with API server"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629693   10502 kubelet.go:301] "Adding static pod path" path="/etc/kubernetes/manifests"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629737   10502 kubelet.go:312] "Adding apiserver pod source"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.629776   10502 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.635893   10502 kuberuntime_manager.go:258] "Container runtime initialized" containerRuntime="containerd" version="v1.7.11" apiVersion="v1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.636198   10502 kubelet.go:809] "Not starting ClusterTrustBundle informer because we are in static kubelet mode"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.636745   10502 server.go:1256] "Started kubelet"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.638338   10502 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.642432   10502 server.go:162] "Starting to listen" address="0.0.0.0" port=10250
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.643048   10502 server.go:461] "Adding debug handlers to kubelet server"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.643822   10502 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.644024   10502 server.go:233] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.644917   10502 volume_manager.go:291] "Starting Kubelet Volume Manager"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.645043   10502 desired_state_of_world_populator.go:151] "Desired state populator starts to run"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.647610   10502 reconciler_new.go:29] "Reconciler: start to sync state"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: E0104 18:47:17.655037   10502 kubelet.go:1462] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.656636   10502 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.657238   10502 factory.go:221] Registration of the containerd container factory successfully
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.657255   10502 factory.go:221] Registration of the systemd container factory successfully
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.657372   10502 factory.go:219] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.658453   10502 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.658541   10502 status_manager.go:217] "Starting to sync pod status with apiserver"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.658600   10502 kubelet.go:2329] "Starting kubelet main sync loop"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: E0104 18:47:17.658715   10502 kubelet.go:2353] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.745981   10502 cpu_manager.go:214] "Starting CPU manager" policy="none"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.746063   10502 cpu_manager.go:215] "Reconciling" reconcilePeriod="10s"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.746107   10502 state_mem.go:36] "Initialized new in-memory state store"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.746260   10502 kubelet_node_status.go:73] "Attempting to register node" node="k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.746328   10502 state_mem.go:88] "Updated default CPUSet" cpuSet=""
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.746370   10502 state_mem.go:96] "Updated CPUSet assignments" assignments={}
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.746398   10502 policy_none.go:49] "None policy: Start"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.748402   10502 memory_manager.go:170] "Starting memorymanager" policy="None"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.748557   10502 state_mem.go:35] "Initializing new in-memory state store"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.748768   10502 state_mem.go:75] "Updated machine memory state"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.754744   10502 kubelet_node_status.go:112] "Node was previously registered" node="k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.754813   10502 kubelet_node_status.go:76] "Successfully registered node" node="k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.755662   10502 kuberuntime_manager.go:1529] "Updating runtime config through cri with podcidr" CIDR="192.168.0.0/24"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.756124   10502 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="192.168.0.0/24"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.756857   10502 setters.go:568] "Node became not ready" node="k8s-master-1" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2024-01-04T07:47:17Z","lastTransitionTime":"2024-01-04T07:47:17Z","reason":"KubeletNotReady","message":"container runtime status check may not have completed yet"}
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.758691   10502 manager.go:479] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.758961   10502 topology_manager.go:215] "Topology Admit Handler" podUID="ae6f3ae88a884674eedf4b00be3a9285" podNamespace="kube-system" podName="etcd-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.759034   10502 topology_manager.go:215] "Topology Admit Handler" podUID="0db68db92c7bd8712a1f83bdef0555d4" podNamespace="kube-system" podName="kube-apiserver-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.759086   10502 topology_manager.go:215] "Topology Admit Handler" podUID="6da756f56a6154cb9bef9bc85ea87762" podNamespace="kube-system" podName="kube-controller-manager-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.759132   10502 topology_manager.go:215] "Topology Admit Handler" podUID="130e03ba260b005058ca513c8b0fe951" podNamespace="kube-system" podName="kube-scheduler-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.761484   10502 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.785282   10502 kubelet_node_status.go:497] "Fast updating node status as it just became ready"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: E0104 18:47:17.796660   10502 kubelet.go:1921] "Failed creating a mirror pod for" err="pods \"etcd-k8s-master-1\" already exists" pod="kube-system/etcd-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: E0104 18:47:17.796892   10502 kubelet.go:1921] "Failed creating a mirror pod for" err="pods \"kube-scheduler-k8s-master-1\" already exists" pod="kube-system/kube-scheduler-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: E0104 18:47:17.797040   10502 kubelet.go:1921] "Failed creating a mirror pod for" err="pods \"kube-apiserver-k8s-master-1\" already exists" pod="kube-system/kube-apiserver-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: E0104 18:47:17.797147   10502 kubelet.go:1921] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-k8s-master-1\" already exists" pod="kube-system/kube-controller-manager-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.853759   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/ae6f3ae88a884674eedf4b00be3a9285-etcd-certs\") pod \"etcd-k8s-master-1\" (UID: \"ae6f3ae88a884674eedf4b00be3a9285\") " pod="kube-system/etcd-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.853787   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/ae6f3ae88a884674eedf4b00be3a9285-etcd-data\") pod \"etcd-k8s-master-1\" (UID: \"ae6f3ae88a884674eedf4b00be3a9285\") " pod="kube-system/etcd-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.853806   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/6da756f56a6154cb9bef9bc85ea87762-ca-certs\") pod \"kube-controller-manager-k8s-master-1\" (UID: \"6da756f56a6154cb9bef9bc85ea87762\") " pod="kube-system/kube-controller-manager-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.854216   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-pki\" (UniqueName: \"kubernetes.io/host-path/6da756f56a6154cb9bef9bc85ea87762-etc-pki\") pod \"kube-controller-manager-k8s-master-1\" (UID: \"6da756f56a6154cb9bef9bc85ea87762\") " pod="kube-system/kube-controller-manager-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.854807   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/6da756f56a6154cb9bef9bc85ea87762-flexvolume-dir\") pod \"kube-controller-manager-k8s-master-1\" (UID: \"6da756f56a6154cb9bef9bc85ea87762\") " pod="kube-system/kube-controller-manager-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.854902   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/130e03ba260b005058ca513c8b0fe951-kubeconfig\") pod \"kube-scheduler-k8s-master-1\" (UID: \"130e03ba260b005058ca513c8b0fe951\") " pod="kube-system/kube-scheduler-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.854938   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/0db68db92c7bd8712a1f83bdef0555d4-ca-certs\") pod \"kube-apiserver-k8s-master-1\" (UID: \"0db68db92c7bd8712a1f83bdef0555d4\") " pod="kube-system/kube-apiserver-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.854952   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-pki\" (UniqueName: \"kubernetes.io/host-path/0db68db92c7bd8712a1f83bdef0555d4-etc-pki\") pod \"kube-apiserver-k8s-master-1\" (UID: \"0db68db92c7bd8712a1f83bdef0555d4\") " pod="kube-system/kube-apiserver-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.854964   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/0db68db92c7bd8712a1f83bdef0555d4-k8s-certs\") pod \"kube-apiserver-k8s-master-1\" (UID: \"0db68db92c7bd8712a1f83bdef0555d4\") " pod="kube-system/kube-apiserver-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.854976   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/6da756f56a6154cb9bef9bc85ea87762-k8s-certs\") pod \"kube-controller-manager-k8s-master-1\" (UID: \"6da756f56a6154cb9bef9bc85ea87762\") " pod="kube-system/kube-controller-manager-k8s-master-1"
Jan 04 18:47:17 k8s-master-1 kubelet[10502]: I0104 18:47:17.854988   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/6da756f56a6154cb9bef9bc85ea87762-kubeconfig\") pod \"kube-controller-manager-k8s-master-1\" (UID: \"6da756f56a6154cb9bef9bc85ea87762\") " pod="kube-system/kube-controller-manager-k8s-master-1"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.636848   10502 apiserver.go:52] "Watching apiserver"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.643330   10502 topology_manager.go:215] "Topology Admit Handler" podUID="ff745724-1300-4d53-bbbe-6b5acce91153" podNamespace="kube-system" podName="coredns-76f75df574-dknlv"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.643705   10502 topology_manager.go:215] "Topology Admit Handler" podUID="3d18cbe2-d234-4870-a886-e9c53bb73628" podNamespace="kube-system" podName="coredns-76f75df574-pdh9z"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.643999   10502 topology_manager.go:215] "Topology Admit Handler" podUID="a636b895-9708-41f0-9f06-79062982085f" podNamespace="kube-system" podName="kube-proxy-qhjv7"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.644302   10502 topology_manager.go:215] "Topology Admit Handler" podUID="641a53f6-e74d-4b25-b3b2-b7f83fed3023" podNamespace="calico-system" podName="calico-kube-controllers-65f8b797fc-lxw6t"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.644573   10502 topology_manager.go:215] "Topology Admit Handler" podUID="4b82af8a-c100-420d-9b62-3d24ae6abc83" podNamespace="calico-system" podName="calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.644860   10502 topology_manager.go:215] "Topology Admit Handler" podUID="b91cbc9a-d0fa-4502-b334-23c3b1152101" podNamespace="calico-system" podName="csi-node-driver-q8l9n"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.645187   10502 topology_manager.go:215] "Topology Admit Handler" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b" podNamespace="calico-apiserver" podName="calico-apiserver-7596f6c7b5-hglw8"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.660887   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/a636b895-9708-41f0-9f06-79062982085f-xtables-lock\") pod \"kube-proxy-qhjv7\" (UID: \"a636b895-9708-41f0-9f06-79062982085f\") " pod="kube-system/kube-proxy-qhjv7"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.660951   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvol-driver-host\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-flexvol-driver-host\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661033   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"policysync\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-policysync\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661124   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-bin-dir\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-cni-bin-dir\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661181   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b91cbc9a-d0fa-4502-b334-23c3b1152101-kubelet-dir\") pod \"csi-node-driver-q8l9n\" (UID: \"b91cbc9a-d0fa-4502-b334-23c3b1152101\") " pod="calico-system/csi-node-driver-q8l9n"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661234   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b91cbc9a-d0fa-4502-b334-23c3b1152101-socket-dir\") pod \"csi-node-driver-q8l9n\" (UID: \"b91cbc9a-d0fa-4502-b334-23c3b1152101\") " pod="calico-system/csi-node-driver-q8l9n"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661412   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varrun\" (UniqueName: \"kubernetes.io/host-path/b91cbc9a-d0fa-4502-b334-23c3b1152101-varrun\") pod \"csi-node-driver-q8l9n\" (UID: \"b91cbc9a-d0fa-4502-b334-23c3b1152101\") " pod="calico-system/csi-node-driver-q8l9n"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661475   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-log-dir\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-cni-log-dir\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661529   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b91cbc9a-d0fa-4502-b334-23c3b1152101-registration-dir\") pod \"csi-node-driver-q8l9n\" (UID: \"b91cbc9a-d0fa-4502-b334-23c3b1152101\") " pod="calico-system/csi-node-driver-q8l9n"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661602   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-calico\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-var-run-calico\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661675   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-lib-modules\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661727   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-net-dir\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-cni-net-dir\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661802   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-var-lib-calico\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661903   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a636b895-9708-41f0-9f06-79062982085f-lib-modules\") pod \"kube-proxy-qhjv7\" (UID: \"a636b895-9708-41f0-9f06-79062982085f\") " pod="kube-system/kube-proxy-qhjv7"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.661959   10502 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/4b82af8a-c100-420d-9b62-3d24ae6abc83-xtables-lock\") pod \"calico-node-v7n84\" (UID: \"4b82af8a-c100-420d-9b62-3d24ae6abc83\") " pod="calico-system/calico-node-v7n84"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: E0104 18:47:18.706813   10502 kubelet.go:1921] "Failed creating a mirror pod for" err="pods \"kube-apiserver-k8s-master-1\" already exists" pod="kube-system/kube-apiserver-k8s-master-1"
Jan 04 18:47:18 k8s-master-1 kubelet[10502]: I0104 18:47:18.746050   10502 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world"
Jan 04 18:47:38 k8s-master-1 kubelet[10502]: E0104 18:47:38.959161   10502 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/calico/apiserver:v3.27.0\": failed to resolve reference \"docker.io/calico/apiserver:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:34911->192.168.160.1:53: i/o timeout" image="docker.io/calico/apiserver:v3.27.0"
Jan 04 18:47:38 k8s-master-1 kubelet[10502]: E0104 18:47:38.959346   10502 kuberuntime_image.go:55] "Failed to pull image" err="failed to pull and unpack image \"docker.io/calico/apiserver:v3.27.0\": failed to resolve reference \"docker.io/calico/apiserver:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:34911->192.168.160.1:53: i/o timeout" image="docker.io/calico/apiserver:v3.27.0"
Jan 04 18:47:38 k8s-master-1 kubelet[10502]: E0104 18:47:38.959612   10502 kuberuntime_manager.go:1262] container &Container{Name:calico-apiserver,Image:docker.io/calico/apiserver:v3.27.0,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-9c6tg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/version,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:90,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/code/filecheck],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:5,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7596f6c7b5-hglw8_calico-apiserver(e54c9f9c-1a16-4d85-84d1-4818521ccd5b): ErrImagePull: failed to pull and unpack image "docker.io/calico/apiserver:v3.27.0": failed to resolve reference "docker.io/calico/apiserver:v3.27.0": failed to do request: Head "https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:34911->192.168.160.1:53: i/o timeout
Jan 04 18:47:38 k8s-master-1 kubelet[10502]: E0104 18:47:38.959657   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/calico/apiserver:v3.27.0\\\": failed to resolve reference \\\"docker.io/calico/apiserver:v3.27.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\\\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:34911->192.168.160.1:53: i/o timeout\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"
Jan 04 18:47:58 k8s-master-1 kubelet[10502]: E0104 18:47:58.974883   10502 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to resolve reference \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:37799->192.168.160.1:53: i/o timeout" image="docker.io/calico/node-driver-registrar:v3.27.0"
Jan 04 18:47:58 k8s-master-1 kubelet[10502]: E0104 18:47:58.974955   10502 kuberuntime_image.go:55] "Failed to pull image" err="failed to pull and unpack image \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to resolve reference \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:37799->192.168.160.1:53: i/o timeout" image="docker.io/calico/node-driver-registrar:v3.27.0"
Jan 04 18:47:58 k8s-master-1 kubelet[10502]: E0104 18:47:58.975859   10502 kuberuntime_manager.go:1262] container &Container{Name:csi-node-driver-registrar,Image:docker.io/calico/node-driver-registrar:v3.27.0,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-d5lmf,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-q8l9n_calico-system(b91cbc9a-d0fa-4502-b334-23c3b1152101): ErrImagePull: failed to pull and unpack image "docker.io/calico/node-driver-registrar:v3.27.0": failed to resolve reference "docker.io/calico/node-driver-registrar:v3.27.0": failed to do request: Head "https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:37799->192.168.160.1:53: i/o timeout
Jan 04 18:47:58 k8s-master-1 kubelet[10502]: E0104 18:47:58.976016   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\": failed to resolve reference \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\\\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:37799->192.168.160.1:53: i/o timeout\"" pod="calico-system/csi-node-driver-q8l9n" podUID="b91cbc9a-d0fa-4502-b334-23c3b1152101"
Jan 04 18:48:18 k8s-master-1 kubelet[10502]: E0104 18:48:18.987723   10502 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/calico/apiserver:v3.27.0\": failed to resolve reference \"docker.io/calico/apiserver:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:40656->192.168.160.1:53: i/o timeout" image="docker.io/calico/apiserver:v3.27.0"
Jan 04 18:48:18 k8s-master-1 kubelet[10502]: E0104 18:48:18.987852   10502 kuberuntime_image.go:55] "Failed to pull image" err="failed to pull and unpack image \"docker.io/calico/apiserver:v3.27.0\": failed to resolve reference \"docker.io/calico/apiserver:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:40656->192.168.160.1:53: i/o timeout" image="docker.io/calico/apiserver:v3.27.0"
Jan 04 18:48:18 k8s-master-1 kubelet[10502]: E0104 18:48:18.988323   10502 kuberuntime_manager.go:1262] container &Container{Name:calico-apiserver,Image:docker.io/calico/apiserver:v3.27.0,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-9c6tg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/version,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:90,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/code/filecheck],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:5,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7596f6c7b5-hglw8_calico-apiserver(e54c9f9c-1a16-4d85-84d1-4818521ccd5b): ErrImagePull: failed to pull and unpack image "docker.io/calico/apiserver:v3.27.0": failed to resolve reference "docker.io/calico/apiserver:v3.27.0": failed to do request: Head "https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:40656->192.168.160.1:53: i/o timeout
Jan 04 18:48:18 k8s-master-1 kubelet[10502]: E0104 18:48:18.988436   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/calico/apiserver:v3.27.0\\\": failed to resolve reference \\\"docker.io/calico/apiserver:v3.27.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\\\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:40656->192.168.160.1:53: i/o timeout\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"
Jan 04 18:48:30 k8s-master-1 kubelet[10502]: E0104 18:48:30.661656   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/apiserver:v3.27.0\\\"\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"
Jan 04 18:48:38 k8s-master-1 kubelet[10502]: E0104 18:48:38.995651   10502 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to resolve reference \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:44017->192.168.160.1:53: i/o timeout" image="docker.io/calico/node-driver-registrar:v3.27.0"
Jan 04 18:48:38 k8s-master-1 kubelet[10502]: E0104 18:48:38.995691   10502 kuberuntime_image.go:55] "Failed to pull image" err="failed to pull and unpack image \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to resolve reference \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:44017->192.168.160.1:53: i/o timeout" image="docker.io/calico/node-driver-registrar:v3.27.0"
Jan 04 18:48:38 k8s-master-1 kubelet[10502]: E0104 18:48:38.995773   10502 kuberuntime_manager.go:1262] container &Container{Name:csi-node-driver-registrar,Image:docker.io/calico/node-driver-registrar:v3.27.0,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-d5lmf,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-q8l9n_calico-system(b91cbc9a-d0fa-4502-b334-23c3b1152101): ErrImagePull: failed to pull and unpack image "docker.io/calico/node-driver-registrar:v3.27.0": failed to resolve reference "docker.io/calico/node-driver-registrar:v3.27.0": failed to do request: Head "https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:44017->192.168.160.1:53: i/o timeout
Jan 04 18:48:38 k8s-master-1 kubelet[10502]: E0104 18:48:38.995801   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\": failed to resolve reference \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\\\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:44017->192.168.160.1:53: i/o timeout\"" pod="calico-system/csi-node-driver-q8l9n" podUID="b91cbc9a-d0fa-4502-b334-23c3b1152101"
Jan 04 18:48:50 k8s-master-1 kubelet[10502]: E0104 18:48:50.660918   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\"\"" pod="calico-system/csi-node-driver-q8l9n" podUID="b91cbc9a-d0fa-4502-b334-23c3b1152101"
Jan 04 18:49:02 k8s-master-1 kubelet[10502]: E0104 18:49:02.670064   10502 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/calico/apiserver:v3.27.0\": failed to resolve reference \"docker.io/calico/apiserver:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:49429->192.168.160.1:53: i/o timeout" image="docker.io/calico/apiserver:v3.27.0"
Jan 04 18:49:02 k8s-master-1 kubelet[10502]: E0104 18:49:02.670106   10502 kuberuntime_image.go:55] "Failed to pull image" err="failed to pull and unpack image \"docker.io/calico/apiserver:v3.27.0\": failed to resolve reference \"docker.io/calico/apiserver:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:49429->192.168.160.1:53: i/o timeout" image="docker.io/calico/apiserver:v3.27.0"
Jan 04 18:49:02 k8s-master-1 kubelet[10502]: E0104 18:49:02.670248   10502 kuberuntime_manager.go:1262] container &Container{Name:calico-apiserver,Image:docker.io/calico/apiserver:v3.27.0,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-9c6tg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/version,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:90,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/code/filecheck],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:5,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7596f6c7b5-hglw8_calico-apiserver(e54c9f9c-1a16-4d85-84d1-4818521ccd5b): ErrImagePull: failed to pull and unpack image "docker.io/calico/apiserver:v3.27.0": failed to resolve reference "docker.io/calico/apiserver:v3.27.0": failed to do request: Head "https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:49429->192.168.160.1:53: i/o timeout
Jan 04 18:49:02 k8s-master-1 kubelet[10502]: E0104 18:49:02.670275   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/calico/apiserver:v3.27.0\\\": failed to resolve reference \\\"docker.io/calico/apiserver:v3.27.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\\\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:49429->192.168.160.1:53: i/o timeout\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"
Jan 04 18:49:13 k8s-master-1 kubelet[10502]: E0104 18:49:13.660487   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/apiserver:v3.27.0\\\"\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"
Jan 04 18:49:22 k8s-master-1 kubelet[10502]: E0104 18:49:22.679252   10502 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to resolve reference \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:54173->192.168.160.1:53: i/o timeout" image="docker.io/calico/node-driver-registrar:v3.27.0"
Jan 04 18:49:22 k8s-master-1 kubelet[10502]: E0104 18:49:22.679296   10502 kuberuntime_image.go:55] "Failed to pull image" err="failed to pull and unpack image \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to resolve reference \"docker.io/calico/node-driver-registrar:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:54173->192.168.160.1:53: i/o timeout" image="docker.io/calico/node-driver-registrar:v3.27.0"
Jan 04 18:49:22 k8s-master-1 kubelet[10502]: E0104 18:49:22.679415   10502 kuberuntime_manager.go:1262] container &Container{Name:csi-node-driver-registrar,Image:docker.io/calico/node-driver-registrar:v3.27.0,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-d5lmf,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-q8l9n_calico-system(b91cbc9a-d0fa-4502-b334-23c3b1152101): ErrImagePull: failed to pull and unpack image "docker.io/calico/node-driver-registrar:v3.27.0": failed to resolve reference "docker.io/calico/node-driver-registrar:v3.27.0": failed to do request: Head "https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:54173->192.168.160.1:53: i/o timeout
Jan 04 18:49:22 k8s-master-1 kubelet[10502]: E0104 18:49:22.679460   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\": failed to resolve reference \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/calico/node-driver-registrar/manifests/v3.27.0\\\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:54173->192.168.160.1:53: i/o timeout\"" pod="calico-system/csi-node-driver-q8l9n" podUID="b91cbc9a-d0fa-4502-b334-23c3b1152101"
Jan 04 18:49:24 k8s-master-1 kubelet[10502]: E0104 18:49:24.660707   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/apiserver:v3.27.0\\\"\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"
Jan 04 18:49:34 k8s-master-1 kubelet[10502]: E0104 18:49:34.660129   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\"\"" pod="calico-system/csi-node-driver-q8l9n" podUID="b91cbc9a-d0fa-4502-b334-23c3b1152101"
Jan 04 18:49:37 k8s-master-1 kubelet[10502]: E0104 18:49:37.660639   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/apiserver:v3.27.0\\\"\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"
Jan 04 18:49:45 k8s-master-1 kubelet[10502]: E0104 18:49:45.665549   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\"\"" pod="calico-system/csi-node-driver-q8l9n" podUID="b91cbc9a-d0fa-4502-b334-23c3b1152101"
Jan 04 18:49:58 k8s-master-1 kubelet[10502]: E0104 18:49:58.663104   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/node-driver-registrar:v3.27.0\\\"\"" pod="calico-system/csi-node-driver-q8l9n" podUID="b91cbc9a-d0fa-4502-b334-23c3b1152101"
Jan 04 18:50:11 k8s-master-1 kubelet[10502]: E0104 18:50:11.673986   10502 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/calico/apiserver:v3.27.0\": failed to resolve reference \"docker.io/calico/apiserver:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:48054->192.168.160.1:53: i/o timeout" image="docker.io/calico/apiserver:v3.27.0"
Jan 04 18:50:11 k8s-master-1 kubelet[10502]: E0104 18:50:11.674079   10502 kuberuntime_image.go:55] "Failed to pull image" err="failed to pull and unpack image \"docker.io/calico/apiserver:v3.27.0\": failed to resolve reference \"docker.io/calico/apiserver:v3.27.0\": failed to do request: Head \"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:48054->192.168.160.1:53: i/o timeout" image="docker.io/calico/apiserver:v3.27.0"
Jan 04 18:50:11 k8s-master-1 kubelet[10502]: E0104 18:50:11.674248   10502 kuberuntime_manager.go:1262] container &Container{Name:calico-apiserver,Image:docker.io/calico/apiserver:v3.27.0,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-9c6tg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/version,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:90,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/code/filecheck],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:5,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7596f6c7b5-hglw8_calico-apiserver(e54c9f9c-1a16-4d85-84d1-4818521ccd5b): ErrImagePull: failed to pull and unpack image "docker.io/calico/apiserver:v3.27.0": failed to resolve reference "docker.io/calico/apiserver:v3.27.0": failed to do request: Head "https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:48054->192.168.160.1:53: i/o timeout
Jan 04 18:50:11 k8s-master-1 kubelet[10502]: E0104 18:50:11.674281   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/calico/apiserver:v3.27.0\\\": failed to resolve reference \\\"docker.io/calico/apiserver:v3.27.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/calico/apiserver/manifests/v3.27.0\\\": dial tcp: lookup registry-1.docker.io on 192.168.160.1:53: read udp 192.168.162.104:48054->192.168.160.1:53: i/o timeout\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"
Jan 04 18:50:26 k8s-master-1 kubelet[10502]: E0104 18:50:26.661331   10502 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/calico/apiserver:v3.27.0\\\"\"" pod="calico-apiserver/calico-apiserver-7596f6c7b5-hglw8" podUID="e54c9f9c-1a16-4d85-84d1-4818521ccd5b"