Need a DESIGN.md document #5

jbeda · 2014-06-06T23:56:52Z

We should have a good overarching technical overview of the design of kubernetes. For new developers or those that want to understand a system deeply before using it.

This should lay out the major moving parts and how they work together.

@lavalamp says:

We should add this information to package comments, too, now that I've split it into multiple packages.

Add build-job-manager to list of built binaries and fix compilation erro...

Provisioner

more docs...

Add secrets client API

Fix a bug of running node selector predicate on kubelet introduced by #5...

Fixed indents and replaced 'kind' w/ 'resource'. Fixed some more indents. Tests: Replaced kind w/ resource once again, some minor tweaks. Fixed indents. Fixed indents. Only use the API request resolver on actual api prefixed requests. Updated doc for swagger policies. Address gofmt complaints. Consider api prefixes with more than 1 path fragment. ("api/123") Fix: incrementor missing. Refactored and tests added. Allow trailing slash. Addressed kubernetes#3, kubernetes#4, kubernetes#6, kubernetes#5, kubernetes#8, kubernetes#7 Enforce non-resource auth on all users, not only ns'ed. Conflicts: docs/admin/authorization.md pkg/apiserver/handlers_test.go pkg/auth/authorizer/abac/abac_test.go

Clean-up and making ENTRYPOINT preferred form...

Adding vSphere Cloud Provider Support for Instances and Zones

Added validation for opaque int resources.

Check that sever API provides certificates capabilities

Merge pull request kubernetes#86 from resouer/heapster-monitoring

Updated sig-apps group and slack

Missing events

Added missing error check that could cause kubelet to crash

GCE: change config-test to suppport windows node

…1.9.8+cpuset Revert "Revert "Enable to configure cpuset for kubepods cgroup""

Update logging to be debug only.

pkg/kubelet: try restoring the container spec if its nil

move pkg/kubelet/cm/cpumanager/containermap to pkg/kubelet/cm/contain…

Sharing the same connection for multiple streams should have worked, but ran into unexpected timeouts: I0227 08:07:49.754263 80029 portproxy.go:109] container "mock" in pod csi-mock-volumes-4037-2061/csi-mockplugin-0 is running E0227 08:07:49.779359 80029 portproxy.go:178] prepare forwarding csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: dialer failed: unable to upgrade connection: pod not found ("csi-mockplugin-0_csi-mock-volumes-4037-2061") I0227 08:07:50.782705 80029 portproxy.go:109] container "mock" in pod csi-mock-volumes-4037-2061/csi-mockplugin-0 is running I0227 08:07:50.809326 80029 portproxy.go:125] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: starting connection polling I0227 08:07:50.909544 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #0, 0 open I0227 08:07:50.912436 80029 portproxy.go:155] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: created a new connection #0 I0227 08:07:50.912503 80029 portproxy.go:286] forward listener for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: got a new connection #0 I0227 08:07:50.913161 80029 portproxy.go:322] forward connection #0 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: remote side closed the stream E0227 08:07:50.913324 80029 portproxy.go:242] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: an error occurred connecting to the remote port: error forwarding port 9000 to pod 66662ea1ab30b4193dac0102c49be840971d337c802cc0c8bbc074214522bd13, uid : failed to execute portforward in network namespace "/var/run/netns/cni-c15e4e36-dad9-8316-c301-33af9dad5717": failed to dial 9000: dial tcp4 127.0.0.1:9000: connect: connection refused I0227 08:07:50.913371 80029 portproxy.go:340] forward connection #0 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: closing our side W0227 08:07:50.913487 80029 server.go:669] grpc: Server.Serve failed to create ServerTransport: connection error: desc = "transport: http2Server.HandleStreams failed to receive the preface from client: EOF" I0227 08:07:51.009519 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #1, 0 open I0227 08:07:51.011912 80029 portproxy.go:155] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: created a new connection #1 I0227 08:07:51.011973 80029 portproxy.go:286] forward listener for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: got a new connection #1 I0227 08:07:51.013677 80029 portproxy.go:322] forward connection #1 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: remote side closed the stream I0227 08:07:51.013720 80029 portproxy.go:340] forward connection #1 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: closing our side W0227 08:07:51.013794 80029 server.go:669] grpc: Server.Serve failed to create ServerTransport: connection error: desc = "transport: http2Server.HandleStreams failed to receive the preface from client: EOF" E0227 08:07:51.017026 80029 portproxy.go:242] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: an error occurred connecting to the remote port: error forwarding port 9000 to pod 66662ea1ab30b4193dac0102c49be840971d337c802cc0c8bbc074214522bd13, uid : failed to execute portforward in network namespace "/var/run/netns/cni-c15e4e36-dad9-8316-c301-33af9dad5717": failed to dial 9000: dial tcp4 127.0.0.1:9000: connect: connection refused I0227 08:07:51.109515 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #2, 0 open I0227 08:07:51.111479 80029 portproxy.go:155] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: created a new connection #2 I0227 08:07:51.111519 80029 portproxy.go:286] forward listener for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: got a new connection #2 I0227 08:07:51.209519 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #3, 1 open I0227 08:07:51.766305 80029 csi.go:377] gRPC call: {"Method":"/csi.v1.Identity/Probe","Request":{},"Response":{"ready":{"value":true}},"Error":"","FullError":null} I0227 08:07:51.768304 80029 csi.go:377] gRPC call: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-csi-mock-volumes-4037","vendor_version":"0.3.0","manifest":{"url":"https://k8s.io/kubernetes/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null} I0227 08:07:51.770494 80029 csi.go:377] gRPC call: {"Method":"/csi.v1.Identity/GetPluginCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]},"Error":"","FullError":null} I0227 08:07:51.772899 80029 csi.go:377] gRPC call: {"Method":"/csi.v1.Controller/ControllerGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":9}}}]},"Error":"","FullError":null} I0227 08:08:21.209901 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating error stream: Timeout occurred I0227 08:08:21.209980 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #3, 1 open I0227 08:08:51.211522 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating data stream: Timeout occurred I0227 08:08:51.211566 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #3, 1 open I0227 08:08:51.213451 80029 portproxy.go:155] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: created a new connection #3 I0227 08:08:51.213498 80029 portproxy.go:286] forward listener for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: got a new connection #3 I0227 08:08:51.309540 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #4, 2 open I0227 08:08:52.215358 80029 portproxy.go:322] forward connection #3 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: remote side closed the stream I0227 08:08:52.215475 80029 portproxy.go:340] forward connection #3 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: closing our side I0227 08:09:21.310003 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating error stream: Timeout occurred I0227 08:09:21.310086 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #4, 1 open I0227 08:09:51.311854 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating data stream: Timeout occurred I0227 08:09:51.311908 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #4, 1 open I0227 08:09:51.314415 80029 portproxy.go:155] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: created a new connection #4 I0227 08:09:51.314497 80029 portproxy.go:286] forward listener for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: got a new connection #4 I0227 08:09:51.409527 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #5, 2 open I0227 08:09:52.326203 80029 portproxy.go:322] forward connection #4 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: remote side closed the stream I0227 08:09:52.326277 80029 portproxy.go:340] forward connection #4 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: closing our side I0227 08:10:21.409892 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating error stream: Timeout occurred I0227 08:10:21.409954 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #5, 1 open I0227 08:10:51.411455 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating data stream: Timeout occurred I0227 08:10:51.411557 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #5, 1 open I0227 08:10:51.413229 80029 portproxy.go:155] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: created a new connection #5 I0227 08:10:51.413274 80029 portproxy.go:286] forward listener for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: got a new connection #5 I0227 08:10:51.509508 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #6, 2 open I0227 08:10:52.414862 80029 portproxy.go:322] forward connection #5 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: remote side closed the stream I0227 08:10:52.414931 80029 portproxy.go:340] forward connection #5 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: closing our side I0227 08:11:21.509879 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating error stream: Timeout occurred I0227 08:11:21.509934 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #6, 1 open I0227 08:11:51.511519 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating data stream: Timeout occurred I0227 08:11:51.511568 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #6, 1 open I0227 08:11:51.513519 80029 portproxy.go:155] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: created a new connection #6 I0227 08:11:51.513571 80029 portproxy.go:286] forward listener for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: got a new connection #6 I0227 08:11:51.609504 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #7, 2 open I0227 08:11:52.517799 80029 portproxy.go:322] forward connection #6 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: remote side closed the stream I0227 08:11:52.517918 80029 portproxy.go:340] forward connection #6 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: closing our side I0227 08:12:21.609856 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating error stream: Timeout occurred I0227 08:12:21.609909 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #7, 1 open I0227 08:12:51.611494 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating data stream: Timeout occurred I0227 08:12:51.611555 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #7, 1 open I0227 08:12:51.613289 80029 portproxy.go:155] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: created a new connection #7 I0227 08:12:51.613343 80029 portproxy.go:286] forward listener for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: got a new connection #7 I0227 08:12:51.709535 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #8, 2 open I0227 08:12:52.615858 80029 portproxy.go:322] forward connection #7 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: remote side closed the stream I0227 08:12:52.615989 80029 portproxy.go:340] forward connection #7 for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: closing our side W0227 08:12:52.616116 80029 server.go:669] grpc: Server.Serve failed to create ServerTransport: connection error: desc = "transport: http2Server.HandleStreams failed to receive the preface from client: EOF" I0227 08:13:21.709934 80029 portproxy.go:151] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: no connection: error creating error stream: Timeout occurred I0227 08:13:21.709997 80029 portproxy.go:148] port forwarding for csi-mock-volumes-4037-2061/csi-mockplugin-0:9000: trying to create a new connection #8, 1 open Feb 27 08:13:30.916: FAIL: Failed to register CSIDriver csi-mock-csi-mock-volumes-4037 Unexpected error: <*errors.errorString | 0xc002666220>: { s: "error waiting for CSI driver csi-mock-csi-mock-volumes-4037 registration on node kind-worker2: timed out waiting for the condition", } error waiting for CSI driver csi-mock-csi-mock-volumes-4037 registration on node kind-worker2: timed out waiting for the condition occurred

optimization for list corner case && add Watch handler

bugfix: fix exec location when port is empty

jbeda added the test label Jun 6, 2014

jbeda self-assigned this Jun 6, 2014

jbeda mentioned this issue Jun 9, 2014

Add DESIGN.md to document core design. #31

Merged

brendandburns closed this as completed in #31 Jun 9, 2014

pmorie referenced this issue in pmorie/kubernetes Jul 23, 2014

Merge pull request #5 from pmorie/build-poc

02a0479

Add build-job-manager to list of built binaries and fix compilation erro...

vmarmol referenced this issue in vmarmol/kubernetes Nov 18, 2014

Merge pull request #5 from vmarmol/provisioner

043f1b6

Provisioner

goltermann added area/downward-api and removed area/downward-api labels Nov 18, 2014

jwhonce pushed a commit to jwhonce/kubernetes that referenced this issue Dec 11, 2014

Merge pull request kubernetes#5 from markturansky/pd_dev

6c312c9

more docs...

EricMountain-1A pushed a commit to EricMountain-1A/kubernetes that referenced this issue Feb 10, 2015

Merge pull request kubernetes#5 from pmorie/secrets_proposal_pr

c01318b

Add secrets client API

davidopp added a commit that referenced this issue Mar 24, 2015

Merge pull request #5870 from dchen1107/podstatus

c173098

Fix a bug of running node selector predicate on kubelet introduced by #5...

google-admin unassigned jbeda May 6, 2015

thockin mentioned this issue May 9, 2015

Add simple env var resolution #7936

Merged

kcao3 mentioned this issue May 19, 2015

CoreOS_Standalone: Redis-slave can't resolve redis-master:6379 in guestbook example #6158

Closed

csrwng mentioned this issue May 27, 2015

Improve handling of Aggregate errors in cmdutil.CheckErr #8680

Closed

rajnemani mentioned this issue Aug 24, 2015

docs: Kubernetes on Azure with CoreOS and Weave #4483

Merged

vishh referenced this issue in vishh/kubernetes Apr 6, 2016

Merge pull request #5 from JasonSwindle/patch-3

d5f9cbc

Clean-up and making ENTRYPOINT preferred form...

dagnello pushed a commit to dagnello/kubernetes that referenced this issue Apr 13, 2016

Merge pull request kubernetes#5 from dagnello/vsphere-instances

5b1ea4f

Adding vSphere Cloud Provider Support for Instances and Zones

ConnorDoyle referenced this issue in ConnorDoyle/kubernetes Aug 29, 2016

Merge pull request #5 from ConnorDoyle/validate-opaque-int

3b9f755

Added validation for opaque int resources.

errordeveloper added a commit to lukemarsden/kubernetes that referenced this issue Sep 11, 2016

Merge pull request kubernetes#5 from rustyrobot/err-kubeadm

6a6537a

Check that sever API provides certificates capabilities

resouer pushed a commit to resouer/kubernetes that referenced this issue Sep 20, 2016

Merge pull request kubernetes#5 from feiskyer/cherry-pick-86

b356b67

Merge pull request kubernetes#86 from resouer/heapster-monitoring

bbrowning referenced this issue in projectodd/kubernetes Sep 28, 2016

Remove stickiness to fix #5

384c8a1

xingzhou pushed a commit to xingzhou/kubernetes that referenced this issue Dec 15, 2016

Merge pull request kubernetes#5 from mattfarina/sig-apps-contact-update

56e91ed

Updated sig-apps group and slack

cheftako pushed a commit to cheftako/kubernetes that referenced this issue Apr 4, 2018

Merge pull request kubernetes#5 from cheftako/missingEvents

30c52da

Missing events

tossmilestone added a commit to tossmilestone/kubernetes that referenced this issue Jul 9, 2018

Merge pull request kubernetes#5 from tossmilestone/flex_race_fix

ebbdabf

Added missing error check that could cause kubelet to crash

LiuQIu7 mentioned this issue Oct 25, 2018

kube-proxy call iptables-save or iptables-restore cause kernel panic periodly #70229

Closed

yujuhong added a commit to yujuhong/kubernetes that referenced this issue Nov 6, 2018

Merge pull request kubernetes#5 from yujuhong/config-test

b9d3035

GCE: change config-test to suppport windows node

KubeStacker pushed a commit to KubeStacker/kubernetes that referenced this issue Dec 21, 2018

Merge pull request kubernetes#5 from es-container/revert-4-revert-2-v…

cb51931

…1.9.8+cpuset Revert "Revert "Enable to configure cpuset for kubepods cgroup""

varunmar pushed a commit to varunmar/kubernetes that referenced this issue Apr 26, 2019

Merge pull request kubernetes#5 from dnardo/ip-masq-agent-logging

8ba8f9c

Update logging to be debug only.

chenchix mentioned this issue Apr 26, 2019

iptables-restore fails applying rules if pod run in arm64 #77130

Closed

plutoid mentioned this issue May 10, 2019

Permission denied on hugetlb due to wrong filename #77169

Closed

awly pushed a commit to awly/kubernetes that referenced this issue Jun 13, 2019

Step kubernetes#5: Add Init logic for your transformer

a82c659

moshe010 pushed a commit to moshe010/kubernetes that referenced this issue Jul 18, 2019

Unit test for topology_hints.go (kubernetes#5)

2fe8783

vllry pushed a commit to vllry/kubernetes that referenced this issue Feb 18, 2020

Merge pull request kubernetes#5 from lyft/containerrecovery

c8994f6

pkg/kubelet: try restoring the container spec if its nil

cynepco3hahue pushed a commit to cynepco3hahue/kubernetes that referenced this issue Apr 5, 2020

Merge pull request kubernetes#5 from bg-chun/containermap_migrate

bf5dd2c

move pkg/kubelet/cm/cpumanager/containermap to pkg/kubelet/cm/contain…

saschagrunert mentioned this issue Jan 29, 2021

Switch to docker buildx for conformance image #98569

Merged

dims mentioned this issue Feb 19, 2021

Differentiate build process for non-amd platforms #82778

Merged

bobbypage mentioned this issue Jun 30, 2021

Feature: Support memory qos with cgroups v2 #102970

Merged

kishoremakkena mentioned this issue Nov 26, 2023

while creating kubernetes cluster over IPv6 using kubeam api-server is not coming up #122042

Closed

wm775825 pushed a commit to wm775825/kubernetes that referenced this issue Dec 4, 2023

Merge pull request kubernetes#5 from wm775825/release-1.28

fa4aab1

optimization for list corner case && add Watch handler

wm775825 pushed a commit to wm775825/kubernetes that referenced this issue Dec 21, 2023

Merge pull request kubernetes#5 from wm775825/release-1.28

1f75419

bugfix: fix exec location when port is empty

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Need a DESIGN.md document #5

Need a DESIGN.md document #5

jbeda commented Jun 6, 2014

Need a DESIGN.md document #5

Need a DESIGN.md document #5

Comments

jbeda commented Jun 6, 2014