Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run smoke tests against latest published versions in release pipeline #15865

Merged
merged 3 commits into from
Jan 15, 2021

Conversation

benbp
Copy link
Member

@benbp benbp commented Dec 18, 2020

This PR updates the package release pipelines to run smoke tests against the latest published versions (GA and/or beta) after the release stage in the release pipeline. This only applies for packages that are included as dependencies in the smoke tests (keyvault, storage, eventhub).

Azure/azure-sdk#1999

@benbp benbp self-assigned this Dec 18, 2020
@benbp benbp added the Central-EngSys This issue is owned by the Engineering System team. label Dec 18, 2020
@benbp benbp force-pushed the benbp/smoke-test-on-release branch from 90e7211 to 7b534aa Compare December 18, 2020 02:10
Copy link
Member

@scbedd scbedd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't see any issues with this. The template looks mostly the same except for the two conditional injections.

I'd like to see a successful run of the template w/ these new changes, just to confirm we're not missing any requirements gotchas in the release stages.

@benbp
Copy link
Member Author

benbp commented Dec 18, 2020

@scbedd here's a run of the normal smoke tests pipeline: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=660094&view=results

Here's a run of just the smoke test portion of the release pipeline (with actual build/release steps commented out): https://dev.azure.com/azure-sdk/internal/_build/results?buildId=660110&view=results

If you can think of a way to exercise the whole release pipeline in a non-consequential way, I'd love to do that too.

@scbedd
Copy link
Member

scbedd commented Dec 18, 2020

@benbp Dozie has some excellent automation in place to execute a release of the template package (including all stages) with a version tagged by buildNumber. That's one way we can actually exercise it.

@scbedd
Copy link
Member

scbedd commented Dec 18, 2020

You're good to just merge this IMO though. That test you did with the actual stuff commented out works for me as well.

@benbp
Copy link
Member Author

benbp commented Dec 18, 2020

@scbedd awesome, I'll follow up with @chidozieononiwu to get that tested! Since I'm out for the next two weeks, I'm going to wait to merge this PR until I'm back, just in case it breaks anything (I don't anticipate anyone needing these changes until then anyway).

@benbp
Copy link
Member Author

benbp commented Jan 8, 2021

@weshaggard I updated this PR to pull in versions from the build artifacts, similar to the net and js PRs.

@benbp benbp force-pushed the benbp/smoke-test-on-release branch from b96ae1c to 4246c90 Compare January 9, 2021 00:21
Copy link
Member

@weshaggard weshaggard left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@benbp benbp force-pushed the benbp/smoke-test-on-release branch from 4246c90 to 698ff6c Compare January 15, 2021 19:45
@benbp benbp merged commit fbe7f4a into master Jan 15, 2021
@benbp benbp deleted the benbp/smoke-test-on-release branch January 15, 2021 21:28
rakshith91 pushed a commit to rakshith91/azure-sdk-for-python that referenced this pull request Jan 15, 2021
…Azure#15865)

* Run smoke tests on release

* Use pipeline artifact versions for smoke test on release

* Use correct logic for daily conditional
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Central-EngSys This issue is owned by the Engineering System team.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants