Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use JavaTestUtil for all tck #4512

Merged
merged 1 commit into from
May 30, 2023
Merged

Conversation

Mesbah-Alam
Copy link
Contributor

@Mesbah-Alam Mesbah-Alam commented Apr 13, 2023

This PR replaces JavaTestRunner with JavaTestUtil as the tck automation wrapper.

Impact:

  1. Faster Execution: Absence of JavaTestRunner wrapper means we are using on less JVM instance. The JVM running the actual tests via tck harness jar is not run as a sub-process spawned by the JVM running JavaTeatRunner, but executed directly from playlist. This reduces overall time taken to run JCK builds.

  2. Easy maintenance: Having the ability to specify tck harness parameters directly in the playlist makes each tck playlist command line clearer, easier to maintain and update.

  3. Enhanced debug-ability: Absence of JavaTestRunner wrapper means less redirection hence more debug-ability for failures.

  4. Less overhead in running additional services: Since additional services like rmi registry, rmid, etc, will be launched directly, as opposed to via ProcessBuilder in JavaTestRunner, it should also contribute to overall improved performance of tck builds in Jenkins.

Related to backlog/issues/1013

@Mesbah-Alam Mesbah-Alam force-pushed the jtutil-migration branch 22 times, most recently from b893491 to 49576df Compare April 17, 2023 18:52
@Mesbah-Alam
Copy link
Contributor Author

Mesbah-Alam commented Apr 17, 2023

Test with JDK8 OpenJ9:

Platform sanity extended special
x64 Linux Grinder_JCK/1372. Green (1h 44m (8x))
x64 Mac Grinder_JCK/1329. GREEN(10m(4x)) Grinder_JCK/1377 (Green. 3h32m (4x))
x64 Windows Grinder_JCK/1363. GREEN(1h2m(4x)) Grinder_JCK/133. AMBER(4h19m (8x)). 1 failure, rerun: 32483 (green))
AIX Grinder_JCK/1339. GREEN(2h5m(4x))

JDK11 OpenJ9:

Platform sanity extended special dev
x64 Linux Grinder_JCK/1346. GREEN (42m (4x)) Grinder_JCK/1335. AMBER (4h39m (8x). 1 failure, rerun : 32483(green)) Grinder_JCK/1365. GREEN (18m (4x)) Grinder_JCK/1369. Green(4x)
x64 Mac Grinder_JCK/1360. GREEN (30m(4x)) Grinder_JCK/1323. AMBER (7h46m (4x)) Grinder_JCK/1382 (GREEN)
z/OS Grinder_JCK/1364. GREEN (2h19m(4x))
AIX

JDK17 OpenJ9:

Platform sanity extended special
x64 Mac Grinder_JCK/1313. AMBER (1h14m(1x). Rerun of 2 failed targets: Grinder/32493(Green))
s390x Grinder_JCK/1336. AMBER (5h33m(8x). 1 failure rerun: 32483(green))

JDK19 OpenJ9:

Platform sanity extended special
AIX Grinder_JCK/1334. GREEN! 45m(4x)) Grinder_JCK/1362. GREEN (4h12m(8x))
ppc64le Linux Grinder_JCK/1337. AMBER (5h48m(8x). 1 failure: rerun : 32483(green))

JDK20 OpenJ9:

Platform sanity extended special
Aarch64 Linux Grinder_JCK/1348. GREEN (4h22m(8x))
s390x Linux Grinder_JCK/1350. GREEN (52m(4x))

@Mesbah-Alam Mesbah-Alam force-pushed the jtutil-migration branch 7 times, most recently from f98b2a5 to 4d165c6 Compare April 18, 2023 16:15
@Mesbah-Alam Mesbah-Alam force-pushed the jtutil-migration branch 2 times, most recently from 70aadf2 to dcf0e35 Compare April 25, 2023 20:32
@Mesbah-Alam Mesbah-Alam force-pushed the jtutil-migration branch 2 times, most recently from de6ccfe to 9f1f507 Compare May 10, 2023 16:35
@Mesbah-Alam Mesbah-Alam marked this pull request as ready for review May 15, 2023 19:44
@Mesbah-Alam Mesbah-Alam requested review from llxia and smlambert May 15, 2023 19:44
@Mesbah-Alam Mesbah-Alam force-pushed the jtutil-migration branch 2 times, most recently from 699cd82 to 4696043 Compare May 16, 2023 15:38
jck/agent-drive.sh Show resolved Hide resolved
jck/agent-drive.sh Outdated Show resolved Hide resolved
@Mesbah-Alam Mesbah-Alam force-pushed the jtutil-migration branch 7 times, most recently from 139f2b2 to 77d1f02 Compare May 17, 2023 20:34
Signed-off-by: Mesbah Alam <Mesbah_Alam@ca.ibm.com>
Copy link
Contributor

@llxia llxia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @Mesbah-Alam

@karianna karianna merged commit d4e8916 into adoptium:master May 30, 2023
@Mesbah-Alam
Copy link
Contributor Author

Was it tested at @smlambert 's end before merging?

@smlambert
Copy link
Contributor

Yes, I ran tests at the temurin-compliance server, thanks for checking @Mesbah-Alam - I should have added a note!

@Mesbah-Alam
Copy link
Contributor Author

Perfect, Thanks @smlambert !

sxa added a commit to sxa/aqa-tests that referenced this pull request Jun 2, 2023
@sxa sxa mentioned this pull request Jun 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants