Topics of discussion from December AdoptOpenJDK mtg in Toronto

[smlambert]

This issue is to capture the main points of discussion in the in-person AdoptOpenJDK meetup in Toronto on Dec 9/10th, 2019 related to AdoptOpenJDK testing.

Some of these items will become standalone issues in this repo to be delivered in 2020 milestones.

• AdoptOpenJDK Quality Assurance (AQA) v2.0 Definition #1522 - next features to include in AQA v2.0 updates (expected in 1Q)

• discussion of performance benchmarks integrated into AQA (see Identify and prioritize open perf benchmarks  #1112)

• discuss criteria for bare metal machines for perf (approved by TSC for 2020)

• discussion of external (3rd party application tests as form of verification, see Add more container-based 3rd party application tests #172)

• crowd-sourcing external testing as a way to expand that aspect of Adopt testing

• overview of TRSS and how to use it for triaging release pipelines (action to Shelley to create a short tutorial to show others)

• demo of TRSS graphical perf views (and features of highcharts 3rd party graphing tool being used under open-source license)

• centralize and update test documentation (WIP, related: Update openjdk-test and TSC docs once this repo is populated TKG#1)

• monthly openjdk-tests meetings to be scheduled in 2020 (see issues labelled with AQAvit meeting label)

• adding support for smart parallelization in TKG / TRSS (Support for smart parallelization in TKG / TRSS #1563)

• overview of Azure Devops (and how TKG runs tests in that environment) (action to Sophia/Lan to get accounts to the Adopt public AzDo to experiment with it for future integration / envisioning a hybrid test farm in Jenkins/AzDo/other combinations where we can maximize our resources but continue to have a seamless triage experience)

• less fun tasks for 2020 include triaging all extended.openjdk tests

• switch over to use API v3 for testing Update to use API v3 #1532

[smlambert]

Closing this as it was just a way to capture the discussion notes.

[d3r3kk]

less fun tasks for 2020 include triaging all extended.openjdk tests

According to whom is this less fun exactly? Hmmmm?

[smlambert]

haha, you caught me, its my opinion that it is a 'less fun' task!