Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add code to support publishing ea builds of JDK21 #740

Merged
merged 9 commits into from
Nov 13, 2023

Conversation

sxa
Copy link
Member

@sxa sxa commented Jun 27, 2023

Final part (probably) of the experiment in adoptium/temurin-build#3355 (comment)

I have no idea if this is the best place to achieve this, but it should work ... Happy to adjust approach later if desired.

Tested with jdk22 then adjusted back to jdk21 before creating the PR

Note this is based on #738 so that needs to be merged first.

@sxa sxa self-assigned this Jun 27, 2023
@github-actions
Copy link

Thank you for creating a pull request!

Please check out the information below if you have not made a pull request here before (or if you need a reminder how things work).

Code Quality and Contributing Guidelines

If you have not done so already, please familiarise yourself with our Contributing Guidelines and Code Of Conduct, even if you have contributed before.

Tests

Github actions will run a set of jobs against your PR that will lint and unit test your changes. Keep an eye out for the results from these on the latest commit you submitted. For more information, please see our testing documentation.

In order to run the advanced pipeline tests (executing a set of mock pipelines), it requires an admin to post run tests on this PR.
If you are not an admin, please ask for one's attention in #infrastructure on Slack or ping one here.
To run full set of tests, use "run tests"; a subset of tests on specific jdk version, use "run tests quick 11,20"

@sxa sxa mentioned this pull request Jun 28, 2023
@sxa sxa force-pushed the jdk21ea_autopublish branch from 71c2932 to 7d4ce94 Compare June 28, 2023 09:17
@sxa
Copy link
Member Author

sxa commented Jun 29, 2023

run tests

@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

✅ All pipelines passed! ✅

Copy link
Contributor

@karianna karianna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would be good to extract this into a publishEABinaries function - whitespace also seems a little out on this PR

Signed-off-by: Stewart X Addison <sxa@redhat.com>
@sxa
Copy link
Member Author

sxa commented Jun 30, 2023

Would be good to extract this into a publishEABinaries function

Bear in mind that the current implementation is currently consistent with the way we use the single function to ship nightly and release binaries, so this is extending that to do EAs as well. I can do the adjustments to support splitting it out but it'll have to wait til next week (changes to these pipelines are a pain to test :-( )

@sxa
Copy link
Member Author

sxa commented Oct 10, 2023

(it's been a while since I wrote this but I'll look at reviewing the comments some time soon!)

@sxa
Copy link
Member Author

sxa commented Nov 6, 2023

run tests

@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

❎ Some pipelines failed or the job was aborted! ❎
See the pipeline-build-check below for more information...

@sxa sxa force-pushed the jdk21ea_autopublish branch from bf4ea8e to 12e79d4 Compare November 6, 2023 14:55
@sxa
Copy link
Member Author

sxa commented Nov 6, 2023

run tests

Signed-off-by: Stewart X Addison <sxa@redhat.com>
@sxa sxa force-pushed the jdk21ea_autopublish branch from 12e79d4 to 544c05f Compare November 6, 2023 15:01
@sxa
Copy link
Member Author

sxa commented Nov 6, 2023

run tests

Signed-off-by: Stewart X Addison <sxa@redhat.com>
@sxa sxa force-pushed the jdk21ea_autopublish branch from caf47d4 to 6278420 Compare November 6, 2023 15:31
@sxa
Copy link
Member Author

sxa commented Nov 6, 2023

PR check job is failing due to the windows ones being hard coded to use win2012 labels which have all been decommissioned as the build pipelines have been switched to run on win2022 machines:

 15:06:42  No active node matches this label: win2012&&vs2017&&build&&windows&&x64

So these can be ignored if they are the only failures. Somewhat annoyingly they come out as "green" in the BlueOcean view although that view does show the problem underneath.

@sxa
Copy link
Member Author

sxa commented Nov 6, 2023

Hitting some issues undelated to this PR (Disk space exhausted on some, but it's not clear where since all the machines I've checked look ok) but I don't think there are any fundamental issues here.

@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

❎ Some pipelines failed or the job was aborted! ❎
See the pipeline-build-check below for more information...

@sxa
Copy link
Member Author

sxa commented Nov 7, 2023

Sigh ... failing PR tests:

Test Job link Diagnosis
JDK11/Win64 AccessDeniedException on Win2012
JDK11/Alpine NoSpaceLeftOnDevice
JDK11/Linux/aarch64 No obvious reason
JDK17/Alpine

... and others .... Ultimately something seems to have ran out of space. Maybe C3jenkins although it is showing 65Gb free just now. I'll try again and keep an eye on it ...

@sxa
Copy link
Member Author

sxa commented Nov 7, 2023

run tests

@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

✅ All pipelines passed! ✅

@sxa sxa force-pushed the jdk21ea_autopublish branch from a8f06b7 to 4bd9341 Compare November 7, 2023 15:41
Signed-off-by: Stewart X Addison <sxa@redhat.com>
@sxa sxa force-pushed the jdk21ea_autopublish branch from 4bd9341 to 4106ddc Compare November 7, 2023 15:46
@sxa
Copy link
Member Author

sxa commented Nov 7, 2023

Woohoo PR tester passed :-)

Would be good to extract this into a publishEABinaries function - whitespace also seems a little out on this PR

@karianna Are you ok with the whitespace now? And are you suggesting splitting the whole function in two so ending up with two separate places where we'd invoke the refactor_release_tool job? I'm inclined to prefer it inline so you can see the difference in logic side by side more clearly but open to other options ...

@andrew-m-leonard are you ok with this now - I think I've got all your feedback addressed and am using javaVersion where I can now. I'll do one more run tests after the last push because ... why not?

@sxa
Copy link
Member Author

sxa commented Nov 7, 2023

run tests

@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

❎ Some pipelines failed or the job was aborted! ❎
See the pipeline-build-check below for more information...

@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

✅ All pipelines passed! ✅

@andrew-m-leonard
Copy link
Contributor

andrew-m-leonard commented Nov 8, 2023

@sxa I think so, my only one doubt is line 794 setting of TIMESTAMP, whether it should check scmReference is not null, otherwise I think publishName maybe blank (if not a tag driven build), and publish will probably fail saying TIMESTAMP not specified...? although that maybe what we want if we want to prevent publishing non-tag nightly builds?

@sxa
Copy link
Member Author

sxa commented Nov 8, 2023

Good shout - I'd changed it for the TAG after your trailer content but not TIMESTAMP. Fixed.

@sxa
Copy link
Member Author

sxa commented Nov 8, 2023

run tests

@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

❎ Some pipelines failed or the job was aborted! ❎
See the pipeline-build-check below for more information...

@karianna
Copy link
Contributor

@sxa pipeline runs seem stuck, not sure how to restart them...

@sxa
Copy link
Member Author

sxa commented Nov 12, 2023

@sxa pipeline runs seem stuck, not sure how to restart them...

They've been misbehaving a bit in the last few runs, but an earlier one that had fundamentally the same basic functionality worked so I'm not too concerned: #740 (comment)

I'll try and initiate another one ... But bear in mind that since the PR tester won't test the publication those are almost irrelevant for this PR unless there's a syntax problem.

@sxa
Copy link
Member Author

sxa commented Nov 12, 2023

run tests

@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

❎ Some pipelines failed or the job was aborted! ❎
See the pipeline-build-check below for more information...

@andrew-m-leonard
Copy link
Contributor

Looks good I think jdk8 pipeline failed on Alpine due to the usual gpg timeout thingy...

@sxa
Copy link
Member Author

sxa commented Nov 13, 2023

run tests

@sxa sxa merged commit c0aa508 into adoptium:master Nov 13, 2023
17 of 28 checks passed
@eclipse-temurin-bot
Copy link
Collaborator

 PR TESTER RESULT 

❎ Some pipelines failed or the job was aborted! ❎
See the pipeline-build-check below for more information...

luhenry pushed a commit to luhenry/adoptium-ci-jenkins-pipelines that referenced this pull request Feb 3, 2024
* Fix weekly check logic

* Add login to be able to auto-publish JDK22 ea builds

* Fixes following linting/review

* Fixup whitespace

Signed-off-by: Stewart X Addison <sxa@redhat.com>

* Adjust for JDK21 and 22

Signed-off-by: Stewart X Addison <sxa@redhat.com>

* Adjust tag logic to handle publish of JDK21 weekly builds

Signed-off-by: Stewart X Addison <sxa@redhat.com>

* Updates following review

Signed-off-by: Stewart X Addison <sxa@redhat.com>

* Update build_base_file.groovy

---------

Signed-off-by: Stewart X Addison <sxa@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: Done
Development

Successfully merging this pull request may close these issues.

4 participants