Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: create cluster with ipv6 fails #1257

Closed
yuvalk opened this issue Jan 15, 2020 · 15 comments
Closed

BUG: create cluster with ipv6 fails #1257

yuvalk opened this issue Jan 15, 2020 · 15 comments
Assignees
Labels
kind/bug Categorizes issue or PR as related to a bug. triage/needs-information Indicates an issue needs more information in order to work on it.

Comments

@yuvalk
Copy link

yuvalk commented Jan 15, 2020

What happened:
config.yaml:

kind: Cluster
apiVersion: kind.x-k8s.io/v1alpha4
networking:
  ipFamily: ipv6

*exactly as in https://kind.sigs.k8s.io/docs/user/configuration/
$ kind create cluster --config=config.yaml
Creating cluster "kind" ...
✓ Ensuring node image (kindest/node:v1.17.0) 🖼
✓ Preparing nodes 📦
✓ Writing configuration 📜
✗ Starting control-plane 🕹️
ERROR: failed to create cluster: failed to init node with kubeadm: command "docker exec --privileged kind-control-plane kubeadm init --ignore-preflight-errors=all --config=/kind/kubeadm.conf --skip-token-print --v=6" failed with error: exit status 1

Environment:
$ kind version
kind v0.7.0 go1.13.5 linux/amd64

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"15+", GitVersion:"v1.15.8-beta.0", GitCommit:"6c143d35bb11d74970e7bc0b6c45b6bfdffc0bd4", GitTreeState:"archive", BuildDate:"2020-01-02T00:00:00Z", GoVersion:"go1.13.5", Compiler:"gc", Platform:"linux/amd64"}

$ docker info
Containers: 6
Running: 0
Paused: 0
Stopped: 6
Images: 7
Server Version: 18.09.8
Storage Driver: overlay2
Backing Filesystem: xfs
Supports d_type: true
Native Overlay Diff: true
Logging Driver: journald
Cgroup Driver: systemd
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: /usr/libexec/docker/docker-init
containerd version:
runc version: ce97911e3cd37a5ce3ef98f7f1d4add21a3ac162
init version: v0.18.0 (expected: fec3683b971d9c3ef73f284f176672c44b448662)
Security Options:
seccomp
Profile: default
selinux
Kernel Version: 5.3.16-300.fc31.x86_64
Operating System: Fedora 31 (Workstation Edition)
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 62.6GiB
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: true

@yuvalk yuvalk added the kind/bug Categorizes issue or PR as related to a bug. label Jan 15, 2020
@neolit123
Copy link
Member

neolit123 commented Jan 15, 2020

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"15+", GitVersion:"v1.15.8-beta.0", GitCommit:"6c143d35bb11d74970e7bc0b6c45b6bfdffc0bd4", GitTreeState:"archive", BuildDate:"2020-01-02T00:00:00Z", GoVersion:"go1.13.5", Compiler:"gc", Platform:"linux/amd64"}

make sure your kubectl is at least 1.16 or better 1.17.

ERROR: failed to create cluster: failed to init node with kubeadm: command "docker exec --privileged kind-control-plane kubeadm init --ignore-preflight-errors=all --config=/kind/kubeadm.conf --skip-token-print --v=6" failed with error: exit status 1

what are the logs if you pass e.g. --v=5 to the kind command?

@BenTheElder
Copy link
Member

Kubectl on the host shouldn't matter during create.

Does docker on the host have IPv6 enabled for containers?
Does kind work without this config?

@BenTheElder BenTheElder added the triage/needs-information Indicates an issue needs more information in order to work on it. label Jan 15, 2020
@yuvalk
Copy link
Author

yuvalk commented Jan 16, 2020

ok, so after upgrading to

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.1", GitCommit:"d224476cd0730baca2b6e357d144171ed74192d6", GitTreeState:"clean", BuildDate:"2020-01-14T21:04:32Z", GoVersion:"go1.13.5", Compiler:"gc", Platform:"linux/amd64"}

and making sure /etc/docker/daemon.json:

{
  "ipv6": true
}

here's the log:

$ kind create cluster --config=config.yaml -v 5
Creating cluster "kind" ...
DEBUG: docker/images.go:61] Image: kindest/node:v1.17.0@sha256:9512edae126da271b66b990b6fff768fbb7cd786c7d39e86bdf55906352fdf62 present locally
 ✓ Ensuring node image (kindest/node:v1.17.0) 🖼
 ✓ Preparing nodes 📦  
DEBUG: config/config.go:90] Using kubeadm config:
apiServer:
  certSANs:
  - localhost
  - ::1
apiVersion: kubeadm.k8s.io/v1beta2
clusterName: kind
controlPlaneEndpoint: '[]:6443'
controllerManager:
  extraArgs:
    bind-address: '::'
    enable-hostpath-provisioner: "true"
kind: ClusterConfiguration
kubernetesVersion: v1.17.0
networking:
  podSubnet: fd00:10:244::/64
  serviceSubnet: fd00:10:96::/112
scheduler:
  extraArgs:
    address: '::'
    bind-address: ::1
---
apiVersion: kubeadm.k8s.io/v1beta2
bootstrapTokens:
- token: abcdef.0123456789abcdef
kind: InitConfiguration
localAPIEndpoint:
  advertiseAddress: ""
  bindPort: 6443
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
    fail-swap-on: "false"
    node-ip: ""
---
apiVersion: kubeadm.k8s.io/v1beta2
controlPlane:
  localAPIEndpoint:
    advertiseAddress: ""
    bindPort: 6443
discovery:
  bootstrapToken:
    apiServerEndpoint: '[]:6443'
    token: abcdef.0123456789abcdef
    unsafeSkipCAVerification: true
kind: JoinConfiguration
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
    fail-swap-on: "false"
    node-ip: ""
---
address: '::'
apiVersion: kubelet.config.k8s.io/v1beta1
evictionHard:
  imagefs.available: 0%
  nodefs.available: 0%
  nodefs.inodesFree: 0%
healthzBindAddress: '::'
imageGCHighThresholdPercent: 100
kind: KubeletConfiguration
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
 ✓ Writing configuration 📜 
DEBUG: kubeadminit/init.go:73] I0116 08:04:38.350750     124 initconfiguration.go:207] loading configuration from "/kind/kubeadm.conf"
[config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta2, Kind=JoinConfiguration
I0116 08:04:38.353530     124 interface.go:400] Looking for default routes with IPv4 addresses
I0116 08:04:38.353536     124 interface.go:405] Default route transits interface "eth0"
I0116 08:04:38.353598     124 interface.go:208] Interface eth0 is up
I0116 08:04:38.353623     124 interface.go:256] Interface "eth0" has 2 addresses :[172.17.0.2/16 fe80::42:acff:fe11:2/64].
I0116 08:04:38.353631     124 interface.go:223] Checking addr  172.17.0.2/16.
I0116 08:04:38.353635     124 interface.go:230] IP found 172.17.0.2
I0116 08:04:38.353638     124 interface.go:262] Found valid IPv4 address 172.17.0.2 for interface "eth0".
I0116 08:04:38.353641     124 interface.go:411] Found active IP 172.17.0.2 
W0116 08:04:38.353649     124 defaults.go:186] The recommended value for "healthzBindAddress" in "KubeletConfiguration" is: 127.0.0.1; the provided value is: ::
hostport []:6443: host '' must be a valid IP address or a valid RFC-1123 DNS subdomain
k8s.io/kubernetes/cmd/kubeadm/app/util.ParseHostPort
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/endpoint.go:112
k8s.io/kubernetes/cmd/kubeadm/app/util/config.SetClusterDynamicDefaults
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:164
k8s.io/kubernetes/cmd/kubeadm/app/util/config.SetInitDynamicDefaults
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:56
k8s.io/kubernetes/cmd/kubeadm/app/util/config.documentMapToInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:329
k8s.io/kubernetes/cmd/kubeadm/app/util/config.BytesToInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:242
k8s.io/kubernetes/cmd/kubeadm/app/util/config.LoadInitConfigurationFromFile
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:214
k8s.io/kubernetes/cmd/kubeadm/app/util/config.LoadOrDefaultInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:226
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newInitData
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:330
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func3
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:191
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).InitData
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:183
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:139
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357
 ✗ Starting control-plane 🕹️
ERROR: failed to create cluster: failed to init node with kubeadm: command "docker exec --privileged kind-control-plane kubeadm init --ignore-preflight-errors=all --config=/kind/kubeadm.conf --skip-token-print --v=6" failed with error: exit status 1

Output:
I0116 08:04:38.350750     124 initconfiguration.go:207] loading configuration from "/kind/kubeadm.conf"
[config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta2, Kind=JoinConfiguration
I0116 08:04:38.353530     124 interface.go:400] Looking for default routes with IPv4 addresses
I0116 08:04:38.353536     124 interface.go:405] Default route transits interface "eth0"
I0116 08:04:38.353598     124 interface.go:208] Interface eth0 is up
I0116 08:04:38.353623     124 interface.go:256] Interface "eth0" has 2 addresses :[172.17.0.2/16 fe80::42:acff:fe11:2/64].
I0116 08:04:38.353631     124 interface.go:223] Checking addr  172.17.0.2/16.
I0116 08:04:38.353635     124 interface.go:230] IP found 172.17.0.2
I0116 08:04:38.353638     124 interface.go:262] Found valid IPv4 address 172.17.0.2 for interface "eth0".
I0116 08:04:38.353641     124 interface.go:411] Found active IP 172.17.0.2 
W0116 08:04:38.353649     124 defaults.go:186] The recommended value for "healthzBindAddress" in "KubeletConfiguration" is: 127.0.0.1; the provided value is: ::
hostport []:6443: host '' must be a valid IP address or a valid RFC-1123 DNS subdomain
k8s.io/kubernetes/cmd/kubeadm/app/util.ParseHostPort
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/endpoint.go:112
k8s.io/kubernetes/cmd/kubeadm/app/util/config.SetClusterDynamicDefaults
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:164
k8s.io/kubernetes/cmd/kubeadm/app/util/config.SetInitDynamicDefaults
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:56
k8s.io/kubernetes/cmd/kubeadm/app/util/config.documentMapToInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:329
k8s.io/kubernetes/cmd/kubeadm/app/util/config.BytesToInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:242
k8s.io/kubernetes/cmd/kubeadm/app/util/config.LoadInitConfigurationFromFile
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:214
k8s.io/kubernetes/cmd/kubeadm/app/util/config.LoadOrDefaultInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:226
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newInitData
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:330
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func3
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:191
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).InitData
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:183
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:139
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357

Stack Trace: 
sigs.k8s.io/kind/pkg/errors.WithStack
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/errors/errors.go:51
sigs.k8s.io/kind/pkg/exec.(*LocalCmd).Run
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/exec/local.go:116
sigs.k8s.io/kind/pkg/cluster/internal/providers/docker.(*nodeCmd).Run
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/providers/docker/node.go:130
sigs.k8s.io/kind/pkg/exec.CombinedOutputLines
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/exec/helpers.go:67
sigs.k8s.io/kind/pkg/cluster/internal/create/actions/kubeadminit.(*action).Execute
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/create/actions/kubeadminit/init.go:72
sigs.k8s.io/kind/pkg/cluster/internal/create.Cluster
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/create/create.go:136
sigs.k8s.io/kind/pkg/cluster.(*Provider).Create
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/provider.go:100
sigs.k8s.io/kind/pkg/cmd/kind/create/cluster.runE
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cmd/kind/create/cluster/createcluster.go:86
sigs.k8s.io/kind/pkg/cmd/kind/create/cluster.NewCommand.func1
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cmd/kind/create/cluster/createcluster.go:52
github.com/spf13/cobra.(*Command).execute
	/home/yuval/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:826
github.com/spf13/cobra.(*Command).ExecuteC
	/home/yuval/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:914
github.com/spf13/cobra.(*Command).Execute
	/home/yuval/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:864
sigs.k8s.io/kind/cmd/kind/app.Run
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/cmd/kind/app/main.go:53
sigs.k8s.io/kind/cmd/kind/app.Main
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/cmd/kind/app/main.go:35
main.main
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/main.go:25
runtime.main
	/usr/lib/golang/src/runtime/proc.go:203
runtime.goexit
	/usr/lib/golang/src/runtime/asm_amd64.s:1357

seems like I'll have to supply my own ip address?

@aojea
Copy link
Contributor

aojea commented Jan 16, 2020

@yuvalk the problem is that docker docs are not ok, you need to add another field to the daemon.json to specify the ipv6 subnet of docker.

{
  "ipv6": true,
  "fixed-cidr-v6": "2001:db8:1::/64",
 }

then restart your docker daemon systemctl restart docker

and try to create the cluster again:

@yuvalk
Copy link
Author

yuvalk commented Jan 16, 2020

I did that, but that wasnt enough"

$ kind create cluster --config=config.yaml -v 5
Creating cluster "kind" ...
DEBUG: docker/images.go:61] Image: kindest/node:v1.17.0@sha256:9512edae126da271b66b990b6fff768fbb7cd786c7d39e86bdf55906352fdf62 present locally
 ✓ Ensuring node image (kindest/node:v1.17.0) 🖼
 ✓ Preparing nodes 📦  
DEBUG: config/config.go:90] Using kubeadm config:
apiServer:
  certSANs:
  - localhost
  - ::1
apiVersion: kubeadm.k8s.io/v1beta2
clusterName: kind
controlPlaneEndpoint: '[]:6443'
controllerManager:
  extraArgs:
    bind-address: '::'
    enable-hostpath-provisioner: "true"
kind: ClusterConfiguration
kubernetesVersion: v1.17.0
networking:
  podSubnet: fd00:10:244::/64
  serviceSubnet: fd00:10:96::/112
scheduler:
  extraArgs:
    address: '::'
    bind-address: ::1
---
apiVersion: kubeadm.k8s.io/v1beta2
bootstrapTokens:
- token: abcdef.0123456789abcdef
kind: InitConfiguration
localAPIEndpoint:
  advertiseAddress: ""
  bindPort: 6443
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
    fail-swap-on: "false"
    node-ip: ""
---
apiVersion: kubeadm.k8s.io/v1beta2
controlPlane:
  localAPIEndpoint:
    advertiseAddress: ""
    bindPort: 6443
discovery:
  bootstrapToken:
    apiServerEndpoint: '[]:6443'
    token: abcdef.0123456789abcdef
    unsafeSkipCAVerification: true
kind: JoinConfiguration
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
    fail-swap-on: "false"
    node-ip: ""
---
address: '::'
apiVersion: kubelet.config.k8s.io/v1beta1
evictionHard:
  imagefs.available: 0%
  nodefs.available: 0%
  nodefs.inodesFree: 0%
healthzBindAddress: '::'
imageGCHighThresholdPercent: 100
kind: KubeletConfiguration
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
 ✓ Writing configuration 📜 
DEBUG: kubeadminit/init.go:73] I0116 15:05:28.472529     124 initconfiguration.go:207] loading configuration from "/kind/kubeadm.conf"
[config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta2, Kind=JoinConfiguration
I0116 15:05:28.474929     124 interface.go:400] Looking for default routes with IPv4 addresses
I0116 15:05:28.474936     124 interface.go:405] Default route transits interface "eth0"
I0116 15:05:28.474994     124 interface.go:208] Interface eth0 is up
I0116 15:05:28.475026     124 interface.go:256] Interface "eth0" has 2 addresses :[172.17.0.2/16 fe80::42:acff:fe11:2/64].
I0116 15:05:28.475036     124 interface.go:223] Checking addr  172.17.0.2/16.
I0116 15:05:28.475040     124 interface.go:230] IP found 172.17.0.2
I0116 15:05:28.475045     124 interface.go:262] Found valid IPv4 address 172.17.0.2 for interface "eth0".
I0116 15:05:28.475048     124 interface.go:411] Found active IP 172.17.0.2 
W0116 15:05:28.475056     124 defaults.go:186] The recommended value for "healthzBindAddress" in "KubeletConfiguration" is: 127.0.0.1; the provided value is: ::
hostport []:6443: host '' must be a valid IP address or a valid RFC-1123 DNS subdomain
k8s.io/kubernetes/cmd/kubeadm/app/util.ParseHostPort
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/endpoint.go:112
k8s.io/kubernetes/cmd/kubeadm/app/util/config.SetClusterDynamicDefaults
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:164
k8s.io/kubernetes/cmd/kubeadm/app/util/config.SetInitDynamicDefaults
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:56
k8s.io/kubernetes/cmd/kubeadm/app/util/config.documentMapToInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:329
k8s.io/kubernetes/cmd/kubeadm/app/util/config.BytesToInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:242
k8s.io/kubernetes/cmd/kubeadm/app/util/config.LoadInitConfigurationFromFile
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:214
k8s.io/kubernetes/cmd/kubeadm/app/util/config.LoadOrDefaultInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:226
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newInitData
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:330
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func3
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:191
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).InitData
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:183
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:139
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357
 ✗ Starting control-plane 🕹️
ERROR: failed to create cluster: failed to init node with kubeadm: command "docker exec --privileged kind-control-plane kubeadm init --ignore-preflight-errors=all --config=/kind/kubeadm.conf --skip-token-print --v=6" failed with error: exit status 1

Output:
I0116 15:05:28.472529     124 initconfiguration.go:207] loading configuration from "/kind/kubeadm.conf"
[config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta2, Kind=JoinConfiguration
I0116 15:05:28.474929     124 interface.go:400] Looking for default routes with IPv4 addresses
I0116 15:05:28.474936     124 interface.go:405] Default route transits interface "eth0"
I0116 15:05:28.474994     124 interface.go:208] Interface eth0 is up
I0116 15:05:28.475026     124 interface.go:256] Interface "eth0" has 2 addresses :[172.17.0.2/16 fe80::42:acff:fe11:2/64].
I0116 15:05:28.475036     124 interface.go:223] Checking addr  172.17.0.2/16.
I0116 15:05:28.475040     124 interface.go:230] IP found 172.17.0.2
I0116 15:05:28.475045     124 interface.go:262] Found valid IPv4 address 172.17.0.2 for interface "eth0".
I0116 15:05:28.475048     124 interface.go:411] Found active IP 172.17.0.2 
W0116 15:05:28.475056     124 defaults.go:186] The recommended value for "healthzBindAddress" in "KubeletConfiguration" is: 127.0.0.1; the provided value is: ::
hostport []:6443: host '' must be a valid IP address or a valid RFC-1123 DNS subdomain
k8s.io/kubernetes/cmd/kubeadm/app/util.ParseHostPort
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/endpoint.go:112
k8s.io/kubernetes/cmd/kubeadm/app/util/config.SetClusterDynamicDefaults
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:164
k8s.io/kubernetes/cmd/kubeadm/app/util/config.SetInitDynamicDefaults
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:56
k8s.io/kubernetes/cmd/kubeadm/app/util/config.documentMapToInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:329
k8s.io/kubernetes/cmd/kubeadm/app/util/config.BytesToInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:242
k8s.io/kubernetes/cmd/kubeadm/app/util/config.LoadInitConfigurationFromFile
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:214
k8s.io/kubernetes/cmd/kubeadm/app/util/config.LoadOrDefaultInitConfiguration
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/config/initconfiguration.go:226
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newInitData
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:330
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func3
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:191
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).InitData
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:183
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:139
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357

Stack Trace: 
sigs.k8s.io/kind/pkg/errors.WithStack
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/errors/errors.go:51
sigs.k8s.io/kind/pkg/exec.(*LocalCmd).Run
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/exec/local.go:116
sigs.k8s.io/kind/pkg/cluster/internal/providers/docker.(*nodeCmd).Run
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/providers/docker/node.go:130
sigs.k8s.io/kind/pkg/exec.CombinedOutputLines
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/exec/helpers.go:67
sigs.k8s.io/kind/pkg/cluster/internal/create/actions/kubeadminit.(*action).Execute
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/create/actions/kubeadminit/init.go:72
sigs.k8s.io/kind/pkg/cluster/internal/create.Cluster
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/create/create.go:136
sigs.k8s.io/kind/pkg/cluster.(*Provider).Create
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/provider.go:100
sigs.k8s.io/kind/pkg/cmd/kind/create/cluster.runE
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cmd/kind/create/cluster/createcluster.go:86
sigs.k8s.io/kind/pkg/cmd/kind/create/cluster.NewCommand.func1
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cmd/kind/create/cluster/createcluster.go:52
github.com/spf13/cobra.(*Command).execute
	/home/yuval/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:826
github.com/spf13/cobra.(*Command).ExecuteC
	/home/yuval/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:914
github.com/spf13/cobra.(*Command).Execute
	/home/yuval/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:864
sigs.k8s.io/kind/cmd/kind/app.Run
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/cmd/kind/app/main.go:53
sigs.k8s.io/kind/cmd/kind/app.Main
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/cmd/kind/app/main.go:35
main.main
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/main.go:25
runtime.main
	/usr/lib/golang/src/runtime/proc.go:203
runtime.goexit
	/usr/lib/golang/src/runtime/asm_amd64.s:1357

as you can see, the error is with the bind address. I think it might be related to this:
#1195

@aojea
Copy link
Contributor

aojea commented Jan 16, 2020

your docker daemon is not using ipv6

I0116 15:05:28.475026 124 interface.go:256] Interface "eth0" has 2 addresses :[172.17.0.2/16 fe80::42:acff:fe11:2/64].

it has to show 3 addresses in that entry, is missing the IPv6 global address, can you try this?

docker run --rm busybox ip a
Unable to find image 'busybox:latest' locally
latest: Pulling from library/busybox
bdbbaa22dec6: Pull complete 
Digest: sha256:6915be4043561d64e0ab0f8f098dc2ac48e077fe23f488ac24b665166898115a
Status: Downloaded newer image for busybox:latest
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
70: eth0@if71: <BROADCAST,MULTICAST,UP,LOWER_UP,M-DOWN> mtu 1500 qdisc noqueue 
    link/ether 02:42:ac:11:00:03 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.3/16 brd 172.17.255.255 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 2001:db8:1::242:ac11:3/64 scope global flags 02 
       valid_lft forever preferred_lft forever
    inet6 fe80::42:acff:fe11:3/64 scope link tentative 
       valid_lft forever preferred_lft forever

and check that your eth0 has an IPv6 global address?


EDIT
you have to restart docker, reload is not enough :)

@yuvalk
Copy link
Author

yuvalk commented Jan 19, 2020

TNX,
that (restart docker) was the issue
I guess documentation is crappy..

but you might wanna mention this on your end (ie make sure first docker is properly configured for ipv6 networking, or something of the kind)

@yuvalk
Copy link
Author

yuvalk commented Jan 19, 2020

ok, problem is, this now succeed for a single node, but fails with the following kind.yaml:

kind: Cluster
apiVersion: kind.x-k8s.io/v1alpha4
networking:
  ipFamily: ipv6
  apiServerAddress: "::1"
nodes:
- role: control-plane
- role: worker

here's the full (and lengthy) log:

$ kind --loglevel debug create cluster --retain --name=yktest --config=kind.yaml 
WARNING: --loglevel is deprecated, please switch to -v and -q!
Creating cluster "yktest" ...
DEBUG: docker/images.go:61] Image: kindest/node:v1.17.0@sha256:9512edae126da271b66b990b6fff768fbb7cd786c7d39e86bdf55906352fdf62 present locally
 ✓ Ensuring node image (kindest/node:v1.17.0) 🖼
 ✓ Preparing nodes 📦 📦  
DEBUG: config/config.go:90] Using kubeadm config:
apiServer:
  certSANs:
  - localhost
  - ::1
apiVersion: kubeadm.k8s.io/v1beta2
clusterName: yktest
controlPlaneEndpoint: '[2001:db8:1::242:ac11:2]:6443'
controllerManager:
  extraArgs:
    bind-address: '::'
    enable-hostpath-provisioner: "true"
kind: ClusterConfiguration
kubernetesVersion: v1.17.0
networking:
  podSubnet: fd00:10:244::/64
  serviceSubnet: fd00:10:96::/112
scheduler:
  extraArgs:
    address: '::'
    bind-address: ::1
---
apiVersion: kubeadm.k8s.io/v1beta2
bootstrapTokens:
- token: abcdef.0123456789abcdef
kind: InitConfiguration
localAPIEndpoint:
  advertiseAddress: 2001:db8:1::242:ac11:3
  bindPort: 6443
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
    fail-swap-on: "false"
    node-ip: 2001:db8:1::242:ac11:3
---
apiVersion: kubeadm.k8s.io/v1beta2
discovery:
  bootstrapToken:
    apiServerEndpoint: '[2001:db8:1::242:ac11:2]:6443'
    token: abcdef.0123456789abcdef
    unsafeSkipCAVerification: true
kind: JoinConfiguration
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
    fail-swap-on: "false"
    node-ip: 2001:db8:1::242:ac11:3
---
address: '::'
apiVersion: kubelet.config.k8s.io/v1beta1
evictionHard:
  imagefs.available: 0%
  nodefs.available: 0%
  nodefs.inodesFree: 0%
healthzBindAddress: '::'
imageGCHighThresholdPercent: 100
kind: KubeletConfiguration
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
DEBUG: config/config.go:90] Using kubeadm config:
apiServer:
  certSANs:
  - localhost
  - ::1
apiVersion: kubeadm.k8s.io/v1beta2
clusterName: yktest
controlPlaneEndpoint: '[2001:db8:1::242:ac11:2]:6443'
controllerManager:
  extraArgs:
    bind-address: '::'
    enable-hostpath-provisioner: "true"
kind: ClusterConfiguration
kubernetesVersion: v1.17.0
networking:
  podSubnet: fd00:10:244::/64
  serviceSubnet: fd00:10:96::/112
scheduler:
  extraArgs:
    address: '::'
    bind-address: ::1
---
apiVersion: kubeadm.k8s.io/v1beta2
bootstrapTokens:
- token: abcdef.0123456789abcdef
kind: InitConfiguration
localAPIEndpoint:
  advertiseAddress: 2001:db8:1::242:ac11:2
  bindPort: 6443
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
    fail-swap-on: "false"
    node-ip: 2001:db8:1::242:ac11:2
---
apiVersion: kubeadm.k8s.io/v1beta2
controlPlane:
  localAPIEndpoint:
    advertiseAddress: 2001:db8:1::242:ac11:2
    bindPort: 6443
discovery:
  bootstrapToken:
    apiServerEndpoint: '[2001:db8:1::242:ac11:2]:6443'
    token: abcdef.0123456789abcdef
    unsafeSkipCAVerification: true
kind: JoinConfiguration
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
    fail-swap-on: "false"
    node-ip: 2001:db8:1::242:ac11:2
---
address: '::'
apiVersion: kubelet.config.k8s.io/v1beta1
evictionHard:
  imagefs.available: 0%
  nodefs.available: 0%
  nodefs.inodesFree: 0%
healthzBindAddress: '::'
imageGCHighThresholdPercent: 100
kind: KubeletConfiguration
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
 ✓ Writing configuration 📜 
DEBUG: kubeadminit/init.go:73] I0119 08:36:06.748641     121 initconfiguration.go:207] loading configuration from "/kind/kubeadm.conf"
[config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta2, Kind=JoinConfiguration
W0119 08:36:06.751619     121 defaults.go:186] The recommended value for "healthzBindAddress" in "KubeletConfiguration" is: 127.0.0.1; the provided value is: ::
[init] Using Kubernetes version: v1.17.0
W0119 08:36:06.751683     121 validation.go:28] Cannot validate kube-proxy config - no validator is available
W0119 08:36:06.751688     121 validation.go:28] Cannot validate kubelet config - no validator is available
[preflight] Running pre-flight checks
I0119 08:36:06.751799     121 checks.go:577] validating Kubernetes and kubeadm version
I0119 08:36:06.751810     121 checks.go:166] validating if the firewall is enabled and active
I0119 08:36:06.756385     121 checks.go:201] validating availability of port 6443
I0119 08:36:06.756510     121 checks.go:201] validating availability of port 10259
I0119 08:36:06.756529     121 checks.go:201] validating availability of port 10257
I0119 08:36:06.756547     121 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
I0119 08:36:06.756565     121 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
I0119 08:36:06.756571     121 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
I0119 08:36:06.756577     121 checks.go:286] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
I0119 08:36:06.756582     121 checks.go:432] validating if the connectivity type is via proxy or direct
I0119 08:36:06.756601     121 checks.go:471] validating http connectivity to first IP address in the CIDR
I0119 08:36:06.756613     121 checks.go:471] validating http connectivity to first IP address in the CIDR
I0119 08:36:06.756621     121 checks.go:102] validating the container runtime
I0119 08:36:06.760726     121 checks.go:376] validating the presence of executable crictl
I0119 08:36:06.760747     121 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I0119 08:36:06.760782     121 checks.go:335] validating the contents of file /proc/sys/net/ipv4/ip_forward
I0119 08:36:06.760801     121 checks.go:649] validating whether swap is enabled or not
I0119 08:36:06.760816     121 checks.go:376] validating the presence of executable ip
I0119 08:36:06.760848     121 checks.go:376] validating the presence of executable iptables
I0119 08:36:06.760879     121 checks.go:376] validating the presence of executable mount
I0119 08:36:06.760893     121 checks.go:376] validating the presence of executable nsenter
I0119 08:36:06.760910     121 checks.go:376] validating the presence of executable ebtables
I0119 08:36:06.760935     121 checks.go:376] validating the presence of executable ethtool
I0119 08:36:06.760949     121 checks.go:376] validating the presence of executable socat
I0119 08:36:06.760968     121 checks.go:376] validating the presence of executable tc
I0119 08:36:06.760981     121 checks.go:376] validating the presence of executable touch
I0119 08:36:06.760998     121 checks.go:520] running all checks
I0119 08:36:06.766847     121 checks.go:406] checking whether the given node name is reachable using net.LookupHost
I0119 08:36:06.766965     121 checks.go:618] validating kubelet version
I0119 08:36:06.795182     121 checks.go:128] validating if the service is enabled and active
I0119 08:36:06.800379     121 checks.go:201] validating availability of port 10250
I0119 08:36:06.800448     121 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-ip6tables
I0119 08:36:06.800482     121 checks.go:335] validating the contents of file /proc/sys/net/ipv6/conf/default/forwarding
I0119 08:36:06.800499     121 checks.go:201] validating availability of port 2379
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0119 08:36:06.800520     121 checks.go:201] validating availability of port 2380
I0119 08:36:06.800543     121 checks.go:249] validating the existence and emptiness of directory /var/lib/etcd
I0119 08:36:06.804303     121 checks.go:838] image exists: k8s.gcr.io/kube-apiserver:v1.17.0
I0119 08:36:06.811531     121 checks.go:838] image exists: k8s.gcr.io/kube-controller-manager:v1.17.0
I0119 08:36:06.815140     121 checks.go:838] image exists: k8s.gcr.io/kube-scheduler:v1.17.0
I0119 08:36:06.819012     121 checks.go:838] image exists: k8s.gcr.io/kube-proxy:v1.17.0
I0119 08:36:06.823021     121 checks.go:838] image exists: k8s.gcr.io/pause:3.1
I0119 08:36:06.827631     121 checks.go:838] image exists: k8s.gcr.io/etcd:3.4.3-0
I0119 08:36:06.831837     121 checks.go:838] image exists: k8s.gcr.io/coredns:1.6.5
I0119 08:36:06.831852     121 kubelet.go:63] Stopping the kubelet
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[certs] Using certificateDir folder "/etc/kubernetes/pki"
I0119 08:36:06.893659     121 certs.go:104] creating a new certificate authority for ca
[certs] Generating "ca" certificate and key
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [yktest-control-plane kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [fd00:10:96::1 2001:db8:1::242:ac11:2 2001:db8:1::242:ac11:2 ::1]
[certs] Generating "apiserver-kubelet-client" certificate and key
I0119 08:36:07.436544     121 certs.go:104] creating a new certificate authority for front-proxy-ca
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
I0119 08:36:07.781239     121 certs.go:104] creating a new certificate authority for etcd-ca
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [yktest-control-plane localhost] and IPs [2001:db8:1::242:ac11:2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [yktest-control-plane localhost] and IPs [2001:db8:1::242:ac11:2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
I0119 08:36:08.451099     121 certs.go:70] creating a new public/private key files for signing service account users
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0119 08:36:08.642902     121 kubeconfig.go:79] creating kubeconfig file for admin.conf
[kubeconfig] Writing "admin.conf" kubeconfig file
I0119 08:36:08.883208     121 kubeconfig.go:79] creating kubeconfig file for kubelet.conf
[kubeconfig] Writing "kubelet.conf" kubeconfig file
I0119 08:36:09.306953     121 kubeconfig.go:79] creating kubeconfig file for controller-manager.conf
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0119 08:36:09.536589     121 kubeconfig.go:79] creating kubeconfig file for scheduler.conf
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
I0119 08:36:09.711352     121 manifests.go:90] [control-plane] getting StaticPodSpecs
I0119 08:36:09.715830     121 manifests.go:115] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
I0119 08:36:09.715838     121 manifests.go:90] [control-plane] getting StaticPodSpecs
W0119 08:36:09.715867     121 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
I0119 08:36:09.716662     121 manifests.go:115] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
I0119 08:36:09.716670     121 manifests.go:90] [control-plane] getting StaticPodSpecs
W0119 08:36:09.716694     121 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
[control-plane] Creating static Pod manifest for "kube-scheduler"
I0119 08:36:09.717147     121 manifests.go:115] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0119 08:36:09.717656     121 local.go:69] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"
I0119 08:36:09.717663     121 waitcontrolplane.go:80] [wait-control-plane] Waiting for the API server to be healthy
I0119 08:36:09.718135     121 loader.go:375] Config loaded from file:  /etc/kubernetes/admin.conf
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0119 08:36:09.718932     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:10.219758     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:10.719716     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:11.219843     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:11.719854     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:12.219786     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:12.719795     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:13.219777     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:13.719750     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:14.219784     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:14.719761     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:15.219781     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:15.719719     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:16.219339     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:16.719713     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:17.219767     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:17.719752     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:18.219752     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:18.719748     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:19.219830     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:19.719835     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:20.219808     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:20.719755     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:21.219794     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:21.719773     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:22.219733     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:22.719782     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:23.219743     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:23.719753     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:24.219774     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:24.719823     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:25.219867     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:25.719772     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:26.219759     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:26.719811     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:27.219810     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:27.719785     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:28.219763     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:28.719767     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:29.219796     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:29.719791     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:30.219235     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:30.719355     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:31.219374     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s  in 0 milliseconds
I0119 08:36:33.860461     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s 500 Internal Server Error in 2141 milliseconds
I0119 08:36:34.222308     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s 500 Internal Server Error in 2 milliseconds
I0119 08:36:34.722318     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s 500 Internal Server Error in 3 milliseconds
I0119 08:36:35.222101     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/healthz?timeout=10s 200 OK in 2 milliseconds
I0119 08:36:35.222277     121 uploadconfig.go:108] [upload-config] Uploading the kubeadm ClusterConfiguration to a ConfigMap
[apiclient] All control plane components are healthy after 25.503659 seconds
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0119 08:36:35.232707     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 5 milliseconds
I0119 08:36:35.239351     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 5 milliseconds
I0119 08:36:35.246045     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 5 milliseconds
I0119 08:36:35.247295     121 uploadconfig.go:122] [upload-config] Uploading the kubelet component config to a ConfigMap
[kubelet] Creating a ConfigMap "kubelet-config-1.17" in namespace kube-system with the configuration for the kubelets in the cluster
I0119 08:36:35.252557     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 3 milliseconds
I0119 08:36:35.256696     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 3 milliseconds
I0119 08:36:35.260547     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 3 milliseconds
I0119 08:36:35.260770     121 uploadconfig.go:127] [upload-config] Preserving the CRISocket information for the control-plane node
I0119 08:36:35.260804     121 patchnode.go:30] [patchnode] Uploading the CRI Socket information "/run/containerd/containerd.sock" to the Node API object "yktest-control-plane" as an annotation
I0119 08:36:35.766005     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/nodes/yktest-control-plane?timeout=10s 200 OK in 4 milliseconds
I0119 08:36:35.776943     121 round_trippers.go:443] PATCH https://[2001:db8:1::242:ac11:2]:6443/api/v1/nodes/yktest-control-plane?timeout=10s 200 OK in 5 milliseconds
[upload-certs] Skipping phase. Please see --upload-certs
[mark-control-plane] Marking the node yktest-control-plane as control-plane by adding the label "node-role.kubernetes.io/master=''"
[mark-control-plane] Marking the node yktest-control-plane as control-plane by adding the taints [node-role.kubernetes.io/master:NoSchedule]
I0119 08:36:36.279602     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/nodes/yktest-control-plane?timeout=10s 200 OK in 1 milliseconds
I0119 08:36:36.282945     121 round_trippers.go:443] PATCH https://[2001:db8:1::242:ac11:2]:6443/api/v1/nodes/yktest-control-plane?timeout=10s 200 OK in 2 milliseconds
[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0119 08:36:36.286575     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/secrets/bootstrap-token-abcdef?timeout=10s 404 Not Found in 3 milliseconds
I0119 08:36:36.289348     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/secrets?timeout=10s 201 Created in 2 milliseconds
[bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0119 08:36:36.292116     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 2 milliseconds
[bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0119 08:36:36.294311     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 1 milliseconds
[bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0119 08:36:36.296793     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 2 milliseconds
[bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0119 08:36:36.297077     121 clusterinfo.go:45] [bootstrap-token] loading admin kubeconfig
I0119 08:36:36.297667     121 loader.go:375] Config loaded from file:  /etc/kubernetes/admin.conf
I0119 08:36:36.297682     121 clusterinfo.go:53] [bootstrap-token] copying the cluster from admin.conf to the bootstrap kubeconfig
I0119 08:36:36.298055     121 clusterinfo.go:65] [bootstrap-token] creating/updating ConfigMap in kube-public namespace
I0119 08:36:36.300675     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps?timeout=10s 201 Created in 2 milliseconds
I0119 08:36:36.300802     121 clusterinfo.go:79] creating the RBAC rules for exposing the cluster-info ConfigMap in the kube-public namespace
I0119 08:36:36.302658     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/roles?timeout=10s 201 Created in 1 milliseconds
I0119 08:36:36.304448     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/rolebindings?timeout=10s 201 Created in 1 milliseconds
I0119 08:36:36.304569     121 kubeletfinalize.go:88] [kubelet-finalize] Assuming that kubelet client certificate rotation is enabled: found "/var/lib/kubelet/pki/kubelet-client-current.pem"
[kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0119 08:36:36.305156     121 loader.go:375] Config loaded from file:  /etc/kubernetes/kubelet.conf
I0119 08:36:36.305711     121 kubeletfinalize.go:132] [kubelet-finalize] Restarting the kubelet to enable client certificate rotation
I0119 08:36:36.380253     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/configmaps/kube-dns?timeout=10s 404 Not Found in 0 milliseconds
I0119 08:36:36.381130     121 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/configmaps/coredns?timeout=10s 404 Not Found in 0 milliseconds
I0119 08:36:36.382122     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 0 milliseconds
I0119 08:36:36.384282     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/clusterroles?timeout=10s 201 Created in 1 milliseconds
I0119 08:36:36.385294     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 0 milliseconds
I0119 08:36:36.386939     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/serviceaccounts?timeout=10s 201 Created in 1 milliseconds
I0119 08:36:36.395461     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/apps/v1/namespaces/kube-system/deployments?timeout=10s 201 Created in 5 milliseconds
I0119 08:36:36.398601     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/services?timeout=10s 201 Created in 2 milliseconds
[addons] Applied essential addon: CoreDNS
I0119 08:36:36.477872     121 request.go:565] Throttling request took 79.116798ms, request: POST:https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/serviceaccounts?timeout=10s
I0119 08:36:36.480827     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/serviceaccounts?timeout=10s 201 Created in 2 milliseconds
I0119 08:36:36.677901     121 request.go:565] Throttling request took 194.868922ms, request: POST:https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0119 08:36:36.680133     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 2 milliseconds
I0119 08:36:36.692573     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/apps/v1/namespaces/kube-system/daemonsets?timeout=10s 201 Created in 6 milliseconds
I0119 08:36:36.693930     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s 201 Created in 1 milliseconds
I0119 08:36:36.695025     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 0 milliseconds
I0119 08:36:36.696253     121 round_trippers.go:443] POST https://[2001:db8:1::242:ac11:2]:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 1 milliseconds
[addons] Applied essential addon: kube-proxy
I0119 08:36:36.696771     121 loader.go:375] Config loaded from file:  /etc/kubernetes/admin.conf
I0119 08:36:36.697118     121 loader.go:375] Config loaded from file:  /etc/kubernetes/admin.conf

Your Kubernetes control-plane has initialized successfully!

To start using your cluster, you need to run the following as a regular user:

  mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config

You should now deploy a pod network to the cluster.
Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
  https://kubernetes.io/docs/concepts/cluster-administration/addons/

You can now join any number of control-plane nodes by copying certificate authorities
and service account keys on each node and then running the following as root:

  kubeadm join [2001:db8:1::242:ac11:2]:6443 --token <value withheld> \
    --discovery-token-ca-cert-hash sha256:10f1e041cca136df6e4cf84d7bbb64bd57dc31b4b0a7b4f30430c5239606837a \
    --control-plane 

Then you can join any number of worker nodes by running the following on each as root:

kubeadm join [2001:db8:1::242:ac11:2]:6443 --token <value withheld> \
    --discovery-token-ca-cert-hash sha256:10f1e041cca136df6e4cf84d7bbb64bd57dc31b4b0a7b4f30430c5239606837a 
 ✓ Starting control-plane 🕹️ 
 ✓ Installing CNI 🔌 
 ✓ Installing StorageClass 💾 
DEBUG: kubeadmjoin/join.go:133] W0119 08:36:37.546178     426 join.go:346] [preflight] WARNING: JoinControlPane.controlPlane settings will be ignored when control-plane flag is not set.
I0119 08:36:37.546203     426 join.go:371] [preflight] found NodeName empty; using OS hostname as NodeName
I0119 08:36:37.546207     426 joinconfiguration.go:75] loading configuration from "/kind/kubeadm.conf"
I0119 08:36:37.547339     426 preflight.go:90] [preflight] Running general checks
I0119 08:36:37.547375     426 checks.go:249] validating the existence and emptiness of directory /etc/kubernetes/manifests
[preflight] Running pre-flight checks
I0119 08:36:37.547400     426 checks.go:286] validating the existence of file /etc/kubernetes/kubelet.conf
I0119 08:36:37.547407     426 checks.go:286] validating the existence of file /etc/kubernetes/bootstrap-kubelet.conf
I0119 08:36:37.547412     426 checks.go:102] validating the container runtime
I0119 08:36:37.551571     426 checks.go:376] validating the presence of executable crictl
I0119 08:36:37.551592     426 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I0119 08:36:37.551627     426 checks.go:335] validating the contents of file /proc/sys/net/ipv4/ip_forward
I0119 08:36:37.551644     426 checks.go:649] validating whether swap is enabled or not
I0119 08:36:37.551657     426 checks.go:376] validating the presence of executable ip
I0119 08:36:37.551688     426 checks.go:376] validating the presence of executable iptables
I0119 08:36:37.551722     426 checks.go:376] validating the presence of executable mount
I0119 08:36:37.551733     426 checks.go:376] validating the presence of executable nsenter
I0119 08:36:37.551750     426 checks.go:376] validating the presence of executable ebtables
I0119 08:36:37.551769     426 checks.go:376] validating the presence of executable ethtool
I0119 08:36:37.551783     426 checks.go:376] validating the presence of executable socat
I0119 08:36:37.551799     426 checks.go:376] validating the presence of executable tc
I0119 08:36:37.551812     426 checks.go:376] validating the presence of executable touch
I0119 08:36:37.551828     426 checks.go:520] running all checks
I0119 08:36:37.557063     426 checks.go:406] checking whether the given node name is reachable using net.LookupHost
I0119 08:36:37.557366     426 checks.go:618] validating kubelet version
I0119 08:36:37.582933     426 checks.go:128] validating if the service is enabled and active
I0119 08:36:37.587988     426 checks.go:201] validating availability of port 10250
I0119 08:36:37.588095     426 checks.go:286] validating the existence of file /etc/kubernetes/pki/ca.crt
I0119 08:36:37.588108     426 checks.go:432] validating if the connectivity type is via proxy or direct
I0119 08:36:37.588127     426 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-ip6tables
I0119 08:36:37.588156     426 checks.go:335] validating the contents of file /proc/sys/net/ipv6/conf/default/forwarding
I0119 08:36:37.588172     426 join.go:441] [preflight] Discovering cluster-info
I0119 08:36:37.588201     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:37.588456     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:38.618584     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1030 milliseconds
I0119 08:36:38.618711     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:36:38.618748     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:36:43.618931     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:43.619331     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:44.635540     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1016 milliseconds
I0119 08:36:44.635661     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:36:44.635709     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:36:49.635848     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:49.636214     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:50.650562     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:36:50.650678     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:36:50.650718     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:36:55.650986     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:55.652241     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:56.666561     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:36:56.666691     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:36:56.666732     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:01.667000     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:01.668050     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:02.682575     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:02.682684     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:02.682715     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:07.682913     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:07.683968     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:08.698559     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:08.698683     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:08.698725     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:13.698995     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:13.700028     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:14.714479     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:14.714601     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:14.714632     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:19.714880     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:19.715949     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:20.730599     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:20.730720     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:20.730760     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:25.730966     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:25.732020     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:26.746540     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:26.746656     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:26.746689     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:31.746967     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:31.748049     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:32.762579     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:32.762701     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:32.762731     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:37.762932     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:37.763943     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:38.778372     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:38.778442     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:38.778462     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:43.778575     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:43.778930     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:44.795568     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1016 milliseconds
I0119 08:37:44.795684     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:44.795715     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:49.796054     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:49.796642     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:50.810524     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:37:50.810645     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:50.810680     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:55.810938     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:55.811953     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:56.826481     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:56.826590     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:56.826622     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:01.826896     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:01.827961     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:02.842672     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:02.842789     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:02.842820     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:07.843086     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:07.844137     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:08.858420     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:08.858473     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:08.858486     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:13.858698     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:13.859025     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:14.874578     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:38:14.874689     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:14.874718     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:19.874916     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:19.875916     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:20.890510     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:20.890627     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:20.890666     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:25.890929     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:25.891949     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:26.906576     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:26.906694     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:26.906726     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:31.906922     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:31.908891     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:32.922300     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1010 milliseconds
I0119 08:38:32.922334     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:32.922342     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:37.922483     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:37.923482     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:38.938377     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:38.938415     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:38.938451     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:43.938604     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:43.939670     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:44.954575     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:44.954692     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:44.954724     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:49.954926     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:49.955946     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:50.970606     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:50.970740     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:50.970771     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:55.970987     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:55.972011     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:56.986296     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:56.986331     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:56.986339     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:01.986424     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:01.986682     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:03.002568     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:39:03.002692     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:03.002767     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:08.003044     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:08.004064     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:09.018573     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:09.018690     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:09.018720     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:14.018970     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:14.019986     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:15.035355     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:39:15.035404     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:15.035418     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:20.035597     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:20.035965     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:21.050574     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:21.050692     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:21.050748     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:26.050946     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:26.052043     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:27.066562     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:27.066681     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:27.066723     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:32.066922     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:32.067294     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:33.082588     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:39:33.082706     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:33.082737     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:38.083021     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:38.084043     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:39.098556     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:39.098698     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:39.098740     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:44.098933     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:44.100007     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:45.114610     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:45.114726     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:45.114767     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:50.115013     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:50.115591     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:51.130547     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:51.130659     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:51.130689     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:56.130888     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:56.131231     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:57.146578     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:39:57.146699     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:57.146730     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:02.146991     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:02.147829     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:03.162617     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:03.162747     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:03.162783     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:08.163106     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:08.164121     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:09.178609     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:09.178771     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:09.178806     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:14.178954     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:14.180058     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:15.195568     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:40:15.195693     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:15.195725     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:20.195922     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:20.196922     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:21.210398     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:40:21.210439     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:21.210450     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:26.210613     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:26.211936     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:27.226537     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:27.226664     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:27.226700     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:32.227223     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:32.229452     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:33.243551     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:40:33.243665     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:33.243709     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:38.243958     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:38.244964     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:39.258578     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:40:39.258694     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:39.258736     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:44.258918     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:44.259945     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:45.274569     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:45.274689     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:45.274721     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:50.274903     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:50.275910     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:51.291394     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:40:51.291451     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:51.291466     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:56.291630     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:56.291869     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:57.306528     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:57.306657     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:57.306696     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:02.306893     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:02.307912     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:03.322571     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:41:03.322691     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:03.322775     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:08.323028     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:08.324044     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:09.338571     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:41:09.338686     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:09.338726     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:14.338991     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:14.340009     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:15.354582     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:41:15.354702     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:15.354733     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:20.354938     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:20.356181     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:21.371533     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:41:21.371615     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:21.371635     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:26.371890     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:26.372904     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:27.386589     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:41:27.386713     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:27.386747     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:32.387015     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:32.388023     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:33.402590     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:41:33.402708     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:33.402740     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:37.588426     426 token.go:208] [discovery] abort connecting to API servers after timeout of 5m0s
abort connecting to API servers after timeout of 5m0s
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.fetchKubeConfigWithTimeout
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:207
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.RetrieveValidatedConfigInfo
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:63
k8s.io/kubernetes/cmd/kubeadm/app/discovery.DiscoverValidatedKubeConfig
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:82
k8s.io/kubernetes/cmd/kubeadm/app/discovery.For
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:42
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).TLSBootstrapCfg
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:442
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).InitCfg
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:452
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join.runPreflight
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join/preflight.go:95
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:234
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:422
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdJoin.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:170
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357
couldn't validate the identity of the API Server
k8s.io/kubernetes/cmd/kubeadm/app/discovery.For
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:44
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).TLSBootstrapCfg
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:442
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).InitCfg
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:452
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join.runPreflight
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join/preflight.go:95
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:234
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:422
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdJoin.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:170
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357
error execution phase preflight
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:235
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:422
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdJoin.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:170
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357
 ✗ Joining worker nodes 🚜
ERROR: failed to create cluster: failed to join node with kubeadm: command "docker exec --privileged yktest-worker kubeadm join --config /kind/kubeadm.conf --ignore-preflight-errors=all --v=6" failed with error: exit status 1

Output:
W0119 08:36:37.546178     426 join.go:346] [preflight] WARNING: JoinControlPane.controlPlane settings will be ignored when control-plane flag is not set.
I0119 08:36:37.546203     426 join.go:371] [preflight] found NodeName empty; using OS hostname as NodeName
I0119 08:36:37.546207     426 joinconfiguration.go:75] loading configuration from "/kind/kubeadm.conf"
I0119 08:36:37.547339     426 preflight.go:90] [preflight] Running general checks
I0119 08:36:37.547375     426 checks.go:249] validating the existence and emptiness of directory /etc/kubernetes/manifests
[preflight] Running pre-flight checks
I0119 08:36:37.547400     426 checks.go:286] validating the existence of file /etc/kubernetes/kubelet.conf
I0119 08:36:37.547407     426 checks.go:286] validating the existence of file /etc/kubernetes/bootstrap-kubelet.conf
I0119 08:36:37.547412     426 checks.go:102] validating the container runtime
I0119 08:36:37.551571     426 checks.go:376] validating the presence of executable crictl
I0119 08:36:37.551592     426 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I0119 08:36:37.551627     426 checks.go:335] validating the contents of file /proc/sys/net/ipv4/ip_forward
I0119 08:36:37.551644     426 checks.go:649] validating whether swap is enabled or not
I0119 08:36:37.551657     426 checks.go:376] validating the presence of executable ip
I0119 08:36:37.551688     426 checks.go:376] validating the presence of executable iptables
I0119 08:36:37.551722     426 checks.go:376] validating the presence of executable mount
I0119 08:36:37.551733     426 checks.go:376] validating the presence of executable nsenter
I0119 08:36:37.551750     426 checks.go:376] validating the presence of executable ebtables
I0119 08:36:37.551769     426 checks.go:376] validating the presence of executable ethtool
I0119 08:36:37.551783     426 checks.go:376] validating the presence of executable socat
I0119 08:36:37.551799     426 checks.go:376] validating the presence of executable tc
I0119 08:36:37.551812     426 checks.go:376] validating the presence of executable touch
I0119 08:36:37.551828     426 checks.go:520] running all checks
I0119 08:36:37.557063     426 checks.go:406] checking whether the given node name is reachable using net.LookupHost
I0119 08:36:37.557366     426 checks.go:618] validating kubelet version
I0119 08:36:37.582933     426 checks.go:128] validating if the service is enabled and active
I0119 08:36:37.587988     426 checks.go:201] validating availability of port 10250
I0119 08:36:37.588095     426 checks.go:286] validating the existence of file /etc/kubernetes/pki/ca.crt
I0119 08:36:37.588108     426 checks.go:432] validating if the connectivity type is via proxy or direct
I0119 08:36:37.588127     426 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-ip6tables
I0119 08:36:37.588156     426 checks.go:335] validating the contents of file /proc/sys/net/ipv6/conf/default/forwarding
I0119 08:36:37.588172     426 join.go:441] [preflight] Discovering cluster-info
I0119 08:36:37.588201     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:37.588456     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:38.618584     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1030 milliseconds
I0119 08:36:38.618711     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:36:38.618748     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:36:43.618931     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:43.619331     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:44.635540     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1016 milliseconds
I0119 08:36:44.635661     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:36:44.635709     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:36:49.635848     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:49.636214     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:50.650562     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:36:50.650678     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:36:50.650718     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:36:55.650986     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:55.652241     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:36:56.666561     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:36:56.666691     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:36:56.666732     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:01.667000     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:01.668050     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:02.682575     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:02.682684     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:02.682715     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:07.682913     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:07.683968     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:08.698559     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:08.698683     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:08.698725     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:13.698995     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:13.700028     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:14.714479     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:14.714601     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:14.714632     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:19.714880     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:19.715949     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:20.730599     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:20.730720     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:20.730760     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:25.730966     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:25.732020     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:26.746540     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:26.746656     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:26.746689     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:31.746967     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:31.748049     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:32.762579     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:32.762701     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:32.762731     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:37.762932     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:37.763943     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:38.778372     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:38.778442     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:38.778462     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:43.778575     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:43.778930     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:44.795568     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1016 milliseconds
I0119 08:37:44.795684     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:44.795715     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:49.796054     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:49.796642     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:50.810524     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:37:50.810645     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:50.810680     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:37:55.810938     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:55.811953     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:37:56.826481     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:37:56.826590     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:37:56.826622     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:01.826896     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:01.827961     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:02.842672     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:02.842789     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:02.842820     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:07.843086     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:07.844137     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:08.858420     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:08.858473     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:08.858486     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:13.858698     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:13.859025     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:14.874578     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:38:14.874689     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:14.874718     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:19.874916     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:19.875916     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:20.890510     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:20.890627     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:20.890666     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:25.890929     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:25.891949     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:26.906576     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:26.906694     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:26.906726     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:31.906922     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:31.908891     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:32.922300     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1010 milliseconds
I0119 08:38:32.922334     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:32.922342     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:37.922483     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:37.923482     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:38.938377     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:38.938415     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:38.938451     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:43.938604     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:43.939670     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:44.954575     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:44.954692     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:44.954724     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:49.954926     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:49.955946     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:50.970606     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:50.970740     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:50.970771     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:38:55.970987     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:55.972011     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:38:56.986296     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:38:56.986331     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:38:56.986339     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:01.986424     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:01.986682     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:03.002568     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:39:03.002692     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:03.002767     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:08.003044     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:08.004064     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:09.018573     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:09.018690     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:09.018720     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:14.018970     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:14.019986     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:15.035355     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:39:15.035404     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:15.035418     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:20.035597     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:20.035965     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:21.050574     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:21.050692     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:21.050748     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:26.050946     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:26.052043     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:27.066562     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:27.066681     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:27.066723     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:32.066922     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:32.067294     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:33.082588     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:39:33.082706     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:33.082737     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:38.083021     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:38.084043     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:39.098556     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:39.098698     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:39.098740     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:44.098933     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:44.100007     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:45.114610     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:45.114726     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:45.114767     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:50.115013     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:50.115591     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:51.130547     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:39:51.130659     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:51.130689     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:39:56.130888     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:56.131231     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:39:57.146578     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:39:57.146699     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:39:57.146730     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:02.146991     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:02.147829     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:03.162617     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:03.162747     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:03.162783     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:08.163106     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:08.164121     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:09.178609     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:09.178771     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:09.178806     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:14.178954     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:14.180058     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:15.195568     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:40:15.195693     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:15.195725     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:20.195922     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:20.196922     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:21.210398     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:40:21.210439     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:21.210450     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:26.210613     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:26.211936     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:27.226537     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:27.226664     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:27.226700     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:32.227223     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:32.229452     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:33.243551     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:40:33.243665     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:33.243709     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:38.243958     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:38.244964     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:39.258578     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:40:39.258694     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:39.258736     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:44.258918     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:44.259945     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:45.274569     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:45.274689     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:45.274721     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:50.274903     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:50.275910     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:51.291394     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:40:51.291451     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:51.291466     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:40:56.291630     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:56.291869     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:40:57.306528     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:40:57.306657     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:40:57.306696     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:02.306893     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:02.307912     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:03.322571     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:41:03.322691     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:03.322775     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:08.323028     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:08.324044     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:09.338571     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:41:09.338686     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:09.338726     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:14.338991     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:14.340009     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:15.354582     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:41:15.354702     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:15.354733     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:20.354938     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:20.356181     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:21.371533     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1015 milliseconds
I0119 08:41:21.371615     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:21.371635     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:26.371890     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:26.372904     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:27.386589     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1013 milliseconds
I0119 08:41:27.386713     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:27.386747     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:32.387015     426 token.go:188] [discovery] Trying to connect to API Server "[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:32.388023     426 token.go:73] [discovery] Created cluster-info discovery client, requesting info from "https://[2001:db8:1::242:ac11:2]:6443"
I0119 08:41:33.402590     426 round_trippers.go:443] GET https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s  in 1014 milliseconds
I0119 08:41:33.402708     426 token.go:78] [discovery] Failed to request cluster info: [Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied]
I0119 08:41:33.402740     426 token.go:191] [discovery] Failed to connect to API Server "[2001:db8:1::242:ac11:2]:6443": Get https://[2001:db8:1::242:ac11:2]:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s: dial tcp [2001:db8:1::242:ac11:2]:6443: connect: permission denied
I0119 08:41:37.588426     426 token.go:208] [discovery] abort connecting to API servers after timeout of 5m0s
abort connecting to API servers after timeout of 5m0s
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.fetchKubeConfigWithTimeout
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:207
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.RetrieveValidatedConfigInfo
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:63
k8s.io/kubernetes/cmd/kubeadm/app/discovery.DiscoverValidatedKubeConfig
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:82
k8s.io/kubernetes/cmd/kubeadm/app/discovery.For
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:42
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).TLSBootstrapCfg
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:442
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).InitCfg
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:452
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join.runPreflight
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join/preflight.go:95
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:234
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:422
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdJoin.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:170
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357
couldn't validate the identity of the API Server
k8s.io/kubernetes/cmd/kubeadm/app/discovery.For
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:44
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).TLSBootstrapCfg
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:442
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).InitCfg
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:452
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join.runPreflight
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join/preflight.go:95
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:234
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:422
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdJoin.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:170
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357
error execution phase preflight
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:235
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:422
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdJoin.func1
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:170
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
	_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
	/usr/local/go/src/runtime/proc.go:203
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1357

Stack Trace: 
sigs.k8s.io/kind/pkg/errors.WithStack
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/errors/errors.go:51
sigs.k8s.io/kind/pkg/exec.(*LocalCmd).Run
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/exec/local.go:116
sigs.k8s.io/kind/pkg/cluster/internal/providers/docker.(*nodeCmd).Run
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/providers/docker/node.go:130
sigs.k8s.io/kind/pkg/exec.CombinedOutputLines
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/exec/helpers.go:67
sigs.k8s.io/kind/pkg/cluster/internal/create/actions/kubeadmjoin.runKubeadmJoin
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/create/actions/kubeadmjoin/join.go:132
sigs.k8s.io/kind/pkg/cluster/internal/create/actions/kubeadmjoin.joinWorkers.func1
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/cluster/internal/create/actions/kubeadmjoin/join.go:107
sigs.k8s.io/kind/pkg/errors.UntilErrorConcurrent.func1
	/home/yuval/go/pkg/mod/sigs.k8s.io/kind@v0.7.0/pkg/errors/concurrent.go:30
runtime.goexit
	/usr/lib/golang/src/runtime/asm_amd64.s:1357

@aojea
Copy link
Contributor

aojea commented Jan 19, 2020

Try without apiServerAddress: "::1" first, please

kind: Cluster
apiVersion: kind.x-k8s.io/v1alpha4
networking:
  ipFamily: ipv6
nodes:
- role: control-plane
- role: worker

this config is tested in the CI, if this doesn't work we should try to see if there is something environmental that is breaking the multinode (iptables, ...)

@yuvalk
Copy link
Author

yuvalk commented Jan 19, 2020

this also fails, with same error

ERROR: failed to create cluster: failed to join node with kubeadm: command "docker exec --privileged yktst-worker kubeadm join --config /kind/kubeadm.conf --ignore-preflight-errors=all --v=6" failed with error: exit status 1

kubectl v1.17.1
kind v0.7.0
kindest/node v1.17.0

@yuvalk
Copy link
Author

yuvalk commented Jan 19, 2020

ok, it seems like firewall indeed.

it seems docker is trying to configure iptables
and did not even create chain for ipv6

WARNING: COMMAND_FAILED: '/usr/sbin/iptables -w10 -t nat -A DOCKER -p tcp -d ::1 --dport 32781 -j DNAT --to-destination 172.17.0.4:6443 ! -i docker0' failed: iptables v1.8.3 (legacy): host/network `::1' not found
...

@aojea
Copy link
Contributor

aojea commented Jan 19, 2020

🤔

from where is that command snippet?

it can't use ::1 at destination in that rule, is a log from docker?

@yuvalk
Copy link
Author

yuvalk commented Jan 19, 2020

it's from fedora firewalld log
it's not a kind issue anymore, I guess we can close this :-) 👍

once I disable firewall I can get a running ipv6 enabled cluster.

@aojea
Copy link
Contributor

aojea commented Jan 19, 2020

/close
thanks

@k8s-ci-robot
Copy link
Contributor

@aojea: Closing this issue.

In response to this:

/close
thanks

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Categorizes issue or PR as related to a bug. triage/needs-information Indicates an issue needs more information in order to work on it.
Projects
None yet
Development

No branches or pull requests

5 participants