Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make Cloud Builder Faster #245

Merged
merged 2 commits into from
Jun 6, 2018
Merged

Make Cloud Builder Faster #245

merged 2 commits into from
Jun 6, 2018

Conversation

markmandel
Copy link
Member

This should make Cloud Builder faster

  • Request an 8 core machine
  • Move the test and build steps to be parralel.

@markmandel markmandel added the area/build-tools Development tooling. I.e. pretty much everything in the `build` directory. label Jun 6, 2018
@markmandel markmandel added this to the 0.3.0 milestone Jun 6, 2018
@agones-bot
Copy link
Collaborator

Build Failed 😱

Build Id: 8e930155-f79a-46eb-a798-f7b089131070

Build Logs 
starting build "8e930155-f79a-46eb-a798-f7b089131070"

FETCHSOURCE
Initialized empty Git repository in /workspace/.git/
From https://source.developers.google.com/p/agones-images/r/agones
 * branch            f17ae894efc2bee8169da2e51c3ee9e01e9f9754 -> FETCH_HEAD
HEAD is now at f17ae89 Make Cloud Builder Faster
BUILD
Starting Step #4 - "build"
Starting Step #0
Starting Step #3 - "tests"
Step #0: Already have image (with digest): ubuntu
Step #3 - "tests": Pulling image: make-docker
Step #4 - "build": Pulling image: make-docker
Step #3 - "tests": Using default tag: latest
Step #4 - "build": Using default tag: latest
Finished Step #0
Starting Step #1
Step #1: Already have image (with digest): gcr.io/cloud-builders/docker
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #3 - "tests": Using default tag: latest
Step #4 - "build": Using default tag: latest
Step #1: Sending build context to Docker daemon  131.2MB

Step #1: Step 1/3 : FROM gcr.io/cloud-builders/docker
Step #1:  ---> 3c69959ba506
Step #1: Step 2/3 : RUN apt-get install make
Step #1:  ---> Running in 8cac2f64ec72
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #1: Reading package lists...
Step #1: Building dependency tree...
Step #1: Reading state information...
Step #1: Suggested packages:
Step #1:   make-doc
Step #1: The following NEW packages will be installed:
Step #1:   make
Step #1: 0 upgraded, 1 newly installed, 0 to remove and 3 not upgraded.
Step #1: Need to get 151 kB of archives.
Step #1: After this operation, 365 kB of additional disk space will be used.
Step #1: Get:1 http://archive.ubuntu.com/ubuntu xenial/main amd64 make amd64 4.1-6 [151 kB]
Step #3 - "tests": Using default tag: latest
Step #4 - "build": Using default tag: latest
Step #1: Fetched 151 kB in 0s (244 kB/s)
Step #1: Selecting previously unselected package make.
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #1: (Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 11239 files and directories currently installed.)
Step #1: Preparing to unpack .../archives/make_4.1-6_amd64.deb ...
Step #1: Unpacking make (4.1-6) ...
Step #1: Setting up make (4.1-6) ...
Step #1: Removing intermediate container 8cac2f64ec72
Step #1:  ---> f30cd28f3457
Step #1: Step 3/3 : ENTRYPOINT ["/usr/bin/make"]
Step #1:  ---> Running in e84196d6ef87
Step #3 - "tests": Using default tag: latest
Step #1: Removing intermediate container e84196d6ef87
Step #1:  ---> d77aaaa0c563
Step #1: Successfully built d77aaaa0c563
Step #1: Successfully tagged make-docker:latest
Step #4 - "build": Using default tag: latest
Finished Step #1
Starting Step #2
Step #2: Already have image: make-docker
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #2: docker pull gcr.io/agones-images/agones-build:77fc9af031 && docker tag gcr.io/agones-images/agones-build:77fc9af031 agones-build:77fc9af031
Step #2: 77fc9af031: Pulling from agones-images/agones-build
Step #2: c73ab1c6897b: Pulling fs layer
Step #2: 3091fac74ac3: Pulling fs layer
Step #2: 32ec8f15f1df: Pulling fs layer
Step #2: fac055c60f68: Pulling fs layer
Step #2: a59c15b8d483: Pulling fs layer
Step #2: 34efcc4fdf91: Pulling fs layer
Step #2: 84ff1f9b2468: Pulling fs layer
Step #2: 5168a6f2412d: Pulling fs layer
Step #2: 420eed74c2aa: Pulling fs layer
Step #2: 6f7712add452: Pulling fs layer
Step #2: dab7d4cc975f: Pulling fs layer
Step #2: 4c5943cfa1cc: Pulling fs layer
Step #2: a6abe2d36daf: Pulling fs layer
Step #2: 1c18bc879056: Pulling fs layer
Step #2: 8492be485b78: Pulling fs layer
Step #2: 55271adb1570: Pulling fs layer
Step #2: fac055c60f68: Waiting
Step #2: a59c15b8d483: Waiting
Step #2: 34efcc4fdf91: Waiting
Step #2: 84ff1f9b2468: Waiting
Step #2: 5168a6f2412d: Waiting
Step #2: 420eed74c2aa: Waiting
Step #2: 1c18bc879056: Waiting
Step #2: 8492be485b78: Waiting
Step #2: 4c5943cfa1cc: Waiting
Step #2: a6abe2d36daf: Waiting
Step #2: dab7d4cc975f: Waiting
Step #2: c73ab1c6897b: Verifying Checksum
Step #2: c73ab1c6897b: Download complete
Step #2: fac055c60f68: Verifying Checksum
Step #2: fac055c60f68: Download complete
Step #3 - "tests": Using default tag: latest
Step #4 - "build": Using default tag: latest
Step #2: 3091fac74ac3: Verifying Checksum
Step #2: 3091fac74ac3: Download complete
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #2: 34efcc4fdf91: Verifying Checksum
Step #2: 34efcc4fdf91: Download complete
Step #2: a59c15b8d483: Verifying Checksum
Step #2: a59c15b8d483: Download complete
Step #2: 5168a6f2412d: Verifying Checksum
Step #2: 5168a6f2412d: Download complete
Step #2: 420eed74c2aa: Verifying Checksum
Step #2: 420eed74c2aa: Download complete
Step #2: 6f7712add452: Download complete
Step #2: 84ff1f9b2468: Verifying Checksum
Step #2: 84ff1f9b2468: Download complete
Step #2: 4c5943cfa1cc: Verifying Checksum
Step #2: 4c5943cfa1cc: Download complete
Step #2: a6abe2d36daf: Download complete
Step #2: 1c18bc879056: Verifying Checksum
Step #2: 1c18bc879056: Download complete
Step #2: 8492be485b78: Download complete
Step #2: 55271adb1570: Verifying Checksum
Step #2: 55271adb1570: Download complete
Step #2: dab7d4cc975f: Verifying Checksum
Step #2: dab7d4cc975f: Download complete
Step #2: c73ab1c6897b: Pull complete
Step #3 - "tests": Using default tag: latest
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #2: 32ec8f15f1df: Verifying Checksum
Step #2: 32ec8f15f1df: Download complete
Step #4 - "build": Using default tag: latest
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #3 - "tests": Using default tag: latest
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #4 - "build": Using default tag: latest
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #3 - "tests": Using default tag: latest
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #2: 3091fac74ac3: Pull complete
Step #4 - "build": Using default tag: latest
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #3 - "tests": Using default tag: latest
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #4 - "build": Using default tag: latest
Step #3 - "tests": Using default tag: latest
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #4 - "build": Using default tag: latest
Step #3 - "tests": Using default tag: latest
Step #4 - "build": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
Step #3 - "tests": Error response from daemon: pull access denied for make-docker, repository does not exist or may require 'docker login'
ERROR: failed to pull because we ran out of retries.
Finished Step #3 - "tests"
Finished Step #2
ERROR
ERROR: build step 3 "make-docker" failed: error pulling build step 3 "make-docker": exit status 1

@markmandel
Make Cloud Builder Faster
b8d6e57 
This should make Cloud Builder faster
- Request an 8 core machine
- Move the test and build steps to be parralel.
@markmandel markmandel force-pushed the feature/faster-builds branch from f17ae89 to b8d6e57 Compare June 6, 2018 19:12
@agones-bot
Copy link
Collaborator

Build Succeeded 👏

Build Id: eca9992f-5865-4442-bb72-fe3f02f86d42

The following development artifacts have been built, and will exist for the next 30 days:

@markmandel
Copy link
Member Author

😲 Build time: 6 min 5 sec

@agones-bot
Copy link
Collaborator

Build Succeeded 👏

Build Id: b514c3a2-3053-43e9-ac40-52a47c18c80d

The following development artifacts have been built, and will exist for the next 30 days:

@markmandel markmandel merged commit d9786bf into googleforgames:master Jun 6, 2018
@markmandel markmandel deleted the feature/faster-builds branch June 6, 2018 23:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cyriltovena cyriltovena cyriltovena approved these changes

Assignees
No one assigned
Labels
area/build-tools Development tooling. I.e. pretty much everything in the `build` directory.
Projects
None yet
Milestone
0.3.0
Development

Successfully merging this pull request may close these issues.
3 participants
@markmandel @agones-bot @cyriltovena