May 22 14:08:56.297477 ip-10-0-3-189.eu-west-1.compute.internal systemd[1]: Starting nodeadm-run.service - EKS Nodeadm Run... May 22 14:08:56.335699 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.3356035,"caller":"init/init.go:49","msg":"Checking user is root.."} May 22 14:08:56.335699 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.3356895,"caller":"init/init.go:57","msg":"Loading configuration..","configSource":"imds://user-data"} May 22 14:08:56.339774 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.33914,"caller":"init/init.go:66","msg":"Loaded configuration","config":{"metadata":{"creationTimestamp":null},"spec":{"cluster":{"name":"datafy-dp-eks-dev-sdh","apiServerEndpoint":"https://1419B82FA434B6FE84DFDA7C9465F410.gr7.eu-west-1.eks.amazonaws.com","certificateAuthority":"LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURCVENDQWUyZ0F3SUJBZ0lJYTlyUEQ3dDRJYjB3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB5TkRBMU1qRXhNREF3TWpaYUZ3MHpOREExTVRreE1EQTFNalphTUJVeApFekFSQmdOVkJBTVRDbXQxWW1WeWJtVjBaWE13Z2dFaU1BMEdDU3FHU0liM0RRRUJBUVVBQTRJQkR3QXdnZ0VLCkFvSUJBUURDbmpEREwzN2NMRldDc1huaVpsc2ZWNTlKTWwrNXF1MmRPSlNuT00xY0w1Y2tOZ1d3c0k1Z0JVS3oKSHRxejFIRHRtMkt2RlJlTXFkQjQrWC9NZ1Y4dWNPbVFXdnZUa3BDTC94d2hPTllaaE1pR2lFRWVhZUNQSlVxLwpMWHdnQitHZmE3OUJwMzZRVnZnWGhDT3VHd1E0ZTNJTmZrVGhVNnNsaFZScnJPMTJWbGl5Nk5PaXhLcUlORTdFCnhBcXhsYSs4dEJEQktycVhsZzVIQUVCKzFJVHJiZC9acUFMaEdzeUJ6cnJqMjVueXIra3YzaitMTjdTU08vTW0KK2FzQWkydERLVENOUXJBLytSZHBJamxoZ21DUndOeXcyUDMwVTN6UVZacGZsM1pFeDgyVVYzM0h6bVlVQU43cQpueXRtSWRGV0JURU5QQVp2VUMzbTV4SmZkdkI3QWdNQkFBR2pXVEJYTUE0R0ExVWREd0VCL3dRRUF3SUNwREFQCkJnTlZIUk1CQWY4RUJUQURBUUgvTUIwR0ExVWREZ1FXQkJRQUgxVWhNQlNuWWZjdG0zQUlyMGVZMjdyWm9UQVYKQmdOVkhSRUVEakFNZ2dwcmRXSmxjbTVsZEdWek1BMEdDU3FHU0liM0RRRUJDd1VBQTRJQkFRQlg4dzhCVTVJVgpGVmZnQVBJaXI2NEh4NHBTeEtwVmduaUFxWHB3Sy9rMXlidmswZ2kybGdWbTRkeTRQWjZMUzhSZGNDY0kzSjJOCjYrK241eDlYaC9TTkZoUUJkYnFodm9aeC81dzNXb1RZcTZhK3RPbjNhQnV6M29kZldkenRib2dvc1ZPUlRZR1kKZ2RoNmtaK1drNnczc3pjWHhJWFRMMnpETFFKV2VuUG5KNUo0VHFmd1kwKzdMcTRlVXpDbFJOY09aZ2sxanBaQwpTZ3hlR2xhMWtCWnJLSzMxVnc0bTFsdVZ5blAyd3AvWkZZSzFnUTB4TnYzV2RtN3NPYm5PbkFROWptTUFuYUJ6CmhVakU5QmhobUp2TEVxWmhzaEFpSE8rYVRxcHZRTXZ1OGl3elZCVUVsVHE3dzZnTEJuK2F0NEo3TGFtWGlNdngKOHh2REs2SmlnSmpoCi0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS0K","cidr":"172.20.0.0/16"},"containerd":{},"instance":{"localStorage":{}},"kubelet":{"config":{"clusterDNS":["169.254.20.10"],"enableSystemLogHandler":true,"enableSystemLogQuery":true,"evictionHard":{"memory.available":"200Mi","nodefs.available":"10%"},"featureGates":{"DisableKubeletCloudCredentialProviders":true,"NodeLogQuery":true},"kubeReserved":{"cpu":"100m","ephemeral-storage":"1Gi","memory":"400Mi"},"maxPods":58,"shutdownGracePeriod":"30s","shutdownGracePeriodCriticalPods":"10s","systemReserved":{"cpu":"100m","ephemeral-storage":"1Gi","memory":"200Mi"}},"flags":["--node-labels=\"karpenter.sh/capacity-type=spot,karpenter.sh/nodepool=mx-xlarge-long-running,node.kubernetes.io/conveyor-long-running=true,node.kubernetes.io/datafy-instance-class=mx.xlarge,node.kubernetes.io/karpenter=true,node.kubernetes.io/single-az=true\""]}},"status":{"instance":{},"default":{}}}} May 22 14:08:56.339774 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.3394535,"caller":"init/init.go:68","msg":"Enriching configuration.."} May 22 14:08:56.339774 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.3394647,"caller":"init/init.go:148","msg":"Fetching instance details.."} May 22 14:08:56.345739 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: SDK 2024/05/22 14:08:56 DEBUG attempting waiter request, attempt count: 1 May 22 14:08:56.531110 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5310287,"caller":"init/init.go:161","msg":"Instance details populated","details":{"id":"i-0566df0ab32af619d","region":"eu-west-1","type":"m5.xlarge","availabilityZone":"eu-west-1c","mac":"02:91:da:e7:c1:41","privateDnsName":"ip-10-0-3-189.eu-west-1.compute.internal"}} May 22 14:08:56.531110 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.531103,"caller":"init/init.go:162","msg":"Fetching default options..."} May 22 14:08:56.532120 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5320768,"caller":"init/init.go:170","msg":"Default options populated","defaults":{"sandboxImage":"602401143452.dkr.ecr.eu-west-1.amazonaws.com/eks/pause:3.5"}} May 22 14:08:56.532120 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5321155,"caller":"init/init.go:73","msg":"Validating configuration.."} May 22 14:08:56.532120 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5321248,"caller":"init/init.go:78","msg":"Creating daemon manager.."} May 22 14:08:56.533524 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5334916,"caller":"init/init.go:112","msg":"Setting up system aspects..."} May 22 14:08:56.533524 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5335174,"caller":"init/init.go:115","msg":"Setting up system aspect..","name":"local-disk"} May 22 14:08:56.533621 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5335295,"caller":"system/local_disk.go:26","msg":"Not configuring local disks!"} May 22 14:08:56.533621 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.533538,"caller":"init/init.go:119","msg":"Set up system aspect","name":"local-disk"} May 22 14:08:56.533621 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5335479,"caller":"init/init.go:115","msg":"Setting up system aspect..","name":"networking"} May 22 14:08:56.533621 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5335786,"caller":"system/networking.go:79","msg":"writing eks_primary_eni_only network configuration"} May 22 14:08:56.550077 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5499377,"caller":"init/init.go:119","msg":"Set up system aspect","name":"networking"} May 22 14:08:56.550077 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5500052,"caller":"init/init.go:128","msg":"Ensuring daemon is running..","name":"containerd"} May 22 14:08:56.557113 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5570738,"caller":"init/init.go:132","msg":"Daemon is running","name":"containerd"} May 22 14:08:56.557113 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.5571096,"caller":"init/init.go:134","msg":"Running post-launch tasks..","name":"containerd"} May 22 14:08:56.557240 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386936.557121,"caller":"containerd/sandbox.go:20","msg":"Looking up current sandbox image in containerd config.."} May 22 14:08:57.256190 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386937.2552626,"caller":"containerd/sandbox.go:32","msg":"Found sandbox image","image":"602401143452.dkr.ecr.eu-west-1.amazonaws.com/eks/pause:3.5"} May 22 14:08:57.256190 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386937.2553065,"caller":"containerd/sandbox.go:34","msg":"Fetching ECR authorization token.."} May 22 14:08:57.292348 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386937.2920935,"caller":"containerd/sandbox.go:48","msg":"Pulling sandbox image..","image":"602401143452.dkr.ecr.eu-west-1.amazonaws.com/eks/pause:3.5"} May 22 14:08:57.298151 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: E0522 14:08:57.298110 1923 remote_image.go:135] PullImage "602401143452.dkr.ecr.eu-west-1.amazonaws.com/eks/pause:3.5" from image service failed: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /run/containerd/containerd.sock: connect: no such file or directory" May 22 14:08:59.300568 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386939.2990894,"caller":"containerd/sandbox.go:48","msg":"Pulling sandbox image..","image":"602401143452.dkr.ecr.eu-west-1.amazonaws.com/eks/pause:3.5"} May 22 14:09:01.295939 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386941.2958791,"caller":"containerd/sandbox.go:53","msg":"Finished pulling sandbox image","image-ref":"sha256:6996f8da07bd405c6f82a549ef041deda57d1d658ec20a78584f9f436c9a3bb7"} May 22 14:09:01.296021 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386941.2959363,"caller":"init/init.go:138","msg":"Finished post-launch tasks","name":"containerd"} May 22 14:09:01.296021 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386941.2959526,"caller":"init/init.go:128","msg":"Ensuring daemon is running..","name":"kubelet"} May 22 14:09:01.303800 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386941.3005989,"caller":"init/init.go:132","msg":"Daemon is running","name":"kubelet"} May 22 14:09:01.303800 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386941.3006332,"caller":"init/init.go:134","msg":"Running post-launch tasks..","name":"kubelet"} May 22 14:09:01.303800 ip-10-0-3-189.eu-west-1.compute.internal nodeadm[1923]: {"level":"info","ts":1716386941.3006465,"caller":"init/init.go:138","msg":"Finished post-launch tasks","name":"kubelet"} May 22 14:09:01.343209 ip-10-0-3-189.eu-west-1.compute.internal systemd[1]: nodeadm-run.service: Deactivated successfully. May 22 14:09:01.343441 ip-10-0-3-189.eu-west-1.compute.internal systemd[1]: Finished nodeadm-run.service - EKS Nodeadm Run.