Skip to content

Commit

Permalink
Squashed commit of the following:
Browse files Browse the repository at this point in the history
commit 9824165
Author: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com>
Date:   Mon Sep 27 11:32:24 2021 -0700

    Use stress-test-resources file naming to avoid live test auto-discovery (#20828)

    Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>

commit 99ab168
Author: Rakshith Bhyravabhotla <sabhyrav@microsoft.com>
Date:   Mon Sep 27 11:17:48 2021 -0700

    Fix live tests (#20886)

    * Fix tests

    * Update sdk/monitor/azure-monitor-query/azure/monitor/query/_models.py

commit 5697a75
Author: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com>
Date:   Mon Sep 27 10:47:44 2021 -0700

    Sync eng/common directory with azure-sdk-tools for PR 2027 (#20798)

    * Handle assembly already loaded errors in deploy stress test script

    * Add dependency checks and installation links to deploy-stress-tests.ps1

    Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>

commit 883bdae
Author: Rakshith Bhyravabhotla <sabhyrav@microsoft.com>
Date:   Mon Sep 27 10:14:42 2021 -0700

    Query - samples + README + docstrings (#20869)

    * Samples fix

    * README

    * docstrings

    * mypy

    * lint

    * test fix

    * lint

commit 559840c
Author: Rakshith Bhyravabhotla <sabhyrav@microsoft.com>
Date:   Mon Sep 27 10:00:26 2021 -0700

    Metrics should be gettable by name (#20878)

    * Metrics should be gettable by name

    * lint

commit e6db587
Author: Xiang Yan <xiangsjtu@gmail.com>
Date:   Mon Sep 27 09:56:37 2021 -0700

    update changelog (#20810)

commit d32de70
Author: swathipil <76007337+swathipil@users.noreply.github.com>
Date:   Mon Sep 27 08:24:14 2021 -0700

    [SchemaRegistry] update positional args to req kwargs (#20763)

    * make params required kwargs

    * update changelog

    * adams comments

    * update avro tests + samples

    * fix samples

    * pylint error

    * adams comments

commit 55526df
Author: Jiefeng Chen <51037443+BigCat20196@users.noreply.github.com>
Date:   Mon Sep 27 09:40:16 2021 +0800

    [auto-issue-status]auto-assign and refactor (#20722)

    * release_iseus_status_auto_reply

    * issue_aoto_close_revert

    * Update main.py

    * Update main.py

    * Update update_issue_body.py

    * Update reply_generator.py

    * Update reply_generator.py

    * Update update_issue_body.py

    * Update main.py

    * Update update_issue_body.py

    * Update update_issue_body.py

    * Update main.py

    * Update reply_generator.py

    * Update main.py

    * Update update_issue_body.py

    * Update main.py

    * Update scripts/release_issue_status/update_issue_body.py

    * Update update_issue_body.py

    * Update main.py

    * Update reply_generator.py

    * Update update_issue_body.py

    * Update main.py

    * Update scripts/release_issue_status/main.py

    * Update main.py

    * Update scripts/release_issue_status/main.py

    * Update scripts/release_issue_status/main.py

    * Update scripts/release_issue_status/main.py

    * Update scripts/release_issue_status/update_issue_body.py

    * Update scripts/release_issue_status/main.py

    * Update scripts/release_issue_status/update_issue_body.py

    * Update reply_generator.py

    * Update main.py

    * Update scripts/release_issue_status/update_issue_body.py

    Co-authored-by: msyyc <70930885+msyyc@users.noreply.github.com>

    * Update scripts/release_issue_status/update_issue_body.py

    Co-authored-by: msyyc <70930885+msyyc@users.noreply.github.com>

    * Update reply_generator.py

    * Update update_issue_body.py

    * Update main.py

    * Update main.py

    * Update update_issue_body.py

    * Update main.py

    * Update scripts/release_issue_status/main.py

    * Update main.py

    * Update reply_generator.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update update_issue_body.py

    * Update main.py

    * Update update_issue_body.py

    * Update reply_generator.py

    * Update update_issue_body.py

    * Update main.py

    * Update update_issue_body.py

    * Update update_issue_body.py

    * Update update_issue_body.py

    * Update update_issue_body.py

    * Update update_issue_body.py

    * Update main.py

    * Update main.py

    * Update release_issue_status.yml for Azure Pipelines

    * Update main.py

    * Update reply_generator.py

    * Add files via upload

    * Update reply_generator.py

    * Update update_issue_body.py

    * Update reply_generator.py

    * Update auto_pipeline_run.py

    * Update auto_pipeline_run.py

    * add auto-close

    * Update release_issue_status.yml for Azure Pipelines

    * Update auto_close.py

    * Update main.py

    * Update release_issue_status.yml for Azure Pipelines

    * Update auto_pipeline_run.py

    * fix bug

    * Update main.py

    * Update auto_close.py

    * Update auto_close.py

    * Update main.py

    * Update reply_generator.py

    * Update main.py

    * Update main.py

    * Update auto_close.py

    * Update main.py

    * Update auto-close

    * Update auto_pipeline_run.py

    * Update update_issue_body.py

    * Update auto_pipeline_run.py

    * Update release_issue_status.yml for Azure Pipelines

    * Update auto_pipeline_run.py

    * Update release_issue_status.yml for Azure Pipelines

    * Update auto_pipeline_run.py

    * Update auto_pipeline_run.py

    * Add pipeline link

    * Update pipeline link

    * Update auto_pipeline_run.py

    * Update release_issue_status.yml for Azure Pipelines

    * Update auto_pipeline_run.py

    * Update requirement.txt

    * Update auto_pipeline_run.py

    * Add get_python_pipeline

    * Update auto_pipeline_run.py

    * test

    * test

    * add outputfolder

    * add label

    * Update main.py

    * Update get_python_pipeline.py

    * Update main.py

    * Update auto_pipeline_run.py

    * Add utils

    * Update main.py

    * Update main.py

    * Delete old py

    * Update reply_generator.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update utils.py

    * Update utils.py

    * Update main.py

    * Update main.py

    * Update reply_generator.py

    * Update utils.py

    * Add get_changelog function

    * Update utils.py

    * Update reply_generator.py

    * Update main.py

    * Update reply_generator.py

    * Update function

    * del useless code

    * Update utils.py

    * Update main.py

    * Update reply_generator.py

    * Update main.py

    * Update utils.py

    * Update utils.py

    * Update utils.py

    * Update utils.py

    * Update reply_generator.py

    * Update main.py

    * Update main.py

    * Update main.py

    * Update release_issue_status.yml for Azure Pipelines

    * Update main.py

    * Update release_issue_status.yml for Azure Pipelines

    * Update release_issue_status.yml for Azure Pipelines

    * Update main.py

    * Update utils.py

    Co-authored-by: Zed <601306339@qq.com>
    Co-authored-by: Zed Lei <59104634+RAY-316@users.noreply.github.com>
    Co-authored-by: msyyc <70930885+msyyc@users.noreply.github.com>

commit 6bba532
Author: msyyc <70930885+msyyc@users.noreply.github.com>
Date:   Sun Sep 26 15:09:42 2021 +0800

    Update dev_requirements.txt (#20873)

commit dc98de4
Author: Azure CLI Bot <azclibot@microsoft.com>
Date:   Sun Sep 26 14:17:56 2021 +0800

    [AutoRelease] t2-authorization-2021-09-26-80124 (#20872)

    * CodeGen from PR 15973 in Azure/azure-rest-api-specs
    Update readme and readme.python (#15973)

    * Update readme and readme.python

    * Update readme python

    * Update readme python

    * Update readme.python.md

    * Update readme python

    Co-authored-by: msyyc <70930885+msyyc@users.noreply.github.com>

    * version,CHANGELOG

    * test

    * Update test_cli_mgmt_authorization.py

    Co-authored-by: SDKAuto <sdkautomation@microsoft.com>
    Co-authored-by: msyyc <70930885+msyyc@users.noreply.github.com>
    Co-authored-by: PythonSdkPipelines <PythonSdkPipelines>
    Co-authored-by: Jiefeng Chen <51037443+BigCat20196@users.noreply.github.com>

commit d345d9d
Author: catalinaperalta <catalinaperaltah@hotmail.com>
Date:   Fri Sep 24 21:28:15 2021 -0400

    Cat & Krista FR beta work (#20834)

commit 35ee2fa
Author: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com>
Date:   Fri Sep 24 16:38:13 2021 -0700

    Add common policheck steps (#20832)

    Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>

commit cce4b29
Author: Rakshith Bhyravabhotla <sabhyrav@microsoft.com>
Date:   Fri Sep 24 15:33:24 2021 -0700

    Rename Query APIs (#20830)

commit f2b2cea
Author: Adam Ling (MSFT) <adam_ling@outlook.com>
Date:   Fri Sep 24 13:20:36 2021 -0700

    [EventHubs] Fix livetest (#20820)

    * fix livetest

    * rm bicep file

    * rename stress test file

commit 650943c
Author: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com>
Date:   Fri Sep 24 13:11:08 2021 -0700

    Sync eng/common directory with azure-sdk-tools for PR 2035 (#20825)

    * Add

    * Add more description to docs of where the variable is consumed

    Co-authored-by: Daniel Jurek <djurek@microsoft.com>

commit 0475f51
Author: Rakshith Bhyravabhotla <sabhyrav@microsoft.com>
Date:   Fri Sep 24 12:35:04 2021 -0700

    Update handling error in query (#20765)

    * samples

    * hide row

    * Handle errors

    * lint

    * lint

    * extract inner message

    * lint

    * lint

    * lint

    * api view fixes

    * more changes

    * Update sdk/monitor/azure-monitor-query/CHANGELOG.md

    * Apply suggestions from code review

    Co-authored-by: Krista Pratico <krpratic@microsoft.com>

    * changes

    Co-authored-by: Krista Pratico <krpratic@microsoft.com>

commit 1a9b633
Author: iscai-msft <43154838+iscai-msft@users.noreply.github.com>
Date:   Fri Sep 24 12:53:45 2021 -0400

    [rest] switch base responses to ABCs (#20448)

    * switch to protocol

    * update changelog

    * add initial tests

    * switch from protocol to abc

    * improve HttpResponse docstrings

    * lint

    * HeadersType -> MutableMapping[str, str]

    * remove iter_text and iter_lines

    * update tests

    * improve docstrings

    * have base impls handle more code

    * add set_read_checks

    * commit to restart pipelines

    * address xiang's comments

    * lint

    * clear json cache when encoding is updated

    * make sure content type is empty string if doesn't exist

    * update content_type to be None if there is no content type header

    * fix passing encoding to text method error

    * update is_stream_consumed docs

    * remove erroneous committed code

commit cc7e454
Author: Azure CLI Bot <azclibot@microsoft.com>
Date:   Fri Sep 24 09:35:39 2021 +0800

    [AutoRelease] t2-cosmosdb-2021-09-17-34565 (#20737)

    * CodeGen from PR 16052 in Azure/azure-rest-api-specs
    Update cosmos-db.json (#16052)

    Added viewDefinition as required property

    * version,CHANGELOG

    Co-authored-by: SDKAuto <sdkautomation@microsoft.com>
    Co-authored-by: PythonSdkPipelines <PythonSdkPipelines>

commit 04df600
Author: swathipil <76007337+swathipil@users.noreply.github.com>
Date:   Thu Sep 23 17:37:07 2021 -0700

    [SchemaRegistry] renaming from archboard feedback (#20766)

    addressing part of #20703

commit c94b8a6
Author: Xiang Yan <xiangsjtu@gmail.com>
Date:   Thu Sep 23 16:33:50 2021 -0700

    fix test_aiohttp_loop (#20811)

    * fix test_aiohttp_loop

    * fix collections import issue

commit 1380e05
Author: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Date:   Thu Sep 23 10:39:39 2021 -0700

    Writing dev version into package json file. (#20778)

commit 424c3c7
Author: Xiang Yan <xiangsjtu@gmail.com>
Date:   Thu Sep 23 09:17:27 2021 -0700

    integrate logs (#20300)

    * integrate logs

    * update

    * update

    * update

    * update

    * Update _universal.py

    * update

commit cbdaf08
Author: iscai-msft <43154838+iscai-msft@users.noreply.github.com>
Date:   Thu Sep 23 11:26:16 2021 -0400

    [qna] regenerate with 2021-07-15-preview (#20764)

commit 8a7ae28
Author: Azure CLI Bot <azclibot@microsoft.com>
Date:   Thu Sep 23 13:48:32 2021 +0800

    [AutoRelease] t2-servicebus-2021-09-23-30017(Do not merge) (#20801)

    * CodeGen from PR 16114 in Azure/azure-rest-api-specs
    [servicebus]Update readme.python.md (#16114)

    * Update readme.python.md

    * Update readme.python.md

    * version,CHANGELOG

    * test

    Co-authored-by: SDKAuto <sdkautomation@microsoft.com>
    Co-authored-by: PythonSdkPipelines <PythonSdkPipelines>

commit ef7fc5e
Author: Azure CLI Bot <azclibot@microsoft.com>
Date:   Thu Sep 23 09:55:28 2021 +0800

    [AutoRelease] t2-kusto-2021-09-22-40032 (#20790)

    * CodeGen from PR 16115 in Azure/azure-rest-api-specs
    Update readme.python.md (#16115)

    * version,CHANGELOG

    Co-authored-by: SDKAuto <sdkautomation@microsoft.com>
    Co-authored-by: PythonSdkPipelines <PythonSdkPipelines>

commit f4679b9
Author: Scott Beddall <45376673+scbedd@users.noreply.github.com>
Date:   Wed Sep 22 12:20:07 2021 -0700

    Add 3.10 to Nightly Edge Build (#20623)

    * update nightly edge build to run python 3.10 on both windows and linux agents
    * conditionally update `pytest` requirements in both ci_tools.txt and test_tools.txt for python 3.10
    * conditionally add some necessary python 3.10 windows wheels to test_tools.txt. These additions only affect python 3.10, which is not currently part of the test matrix

commit 30b196e
Author: iscai-msft <43154838+iscai-msft@users.noreply.github.com>
Date:   Wed Sep 22 12:32:29 2021 -0400

    [rest] add backcompat mixin to rest requests (#20599)

commit 4b3397d
Author: Adam Ling (MSFT) <adam_ling@outlook.com>
Date:   Wed Sep 22 09:09:32 2021 -0700

    [EventHubs] Stress test refactor (#20389)

    * init commit for stress

    * add dotenv dep

    * docker, helm, k8s

    * apply changes

    * run forever

    * add chaos

    * update chaos jos

    * Apply suggestions from code review

    Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

    * minor fixes

    * revert external targets

    Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

commit eca1c81
Author: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com>
Date:   Tue Sep 21 19:58:17 2021 -0700

    Clean-up changelog scripts (#20779)

    Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>

commit 518af90
Author: Azure CLI Bot <azclibot@microsoft.com>
Date:   Wed Sep 22 09:31:05 2021 +0800

    [AutoRelease] t2-containerinstance-2021-09-17-04542 (#20733)

    * CodeGen from PR 15721 in Azure/azure-rest-api-specs
    [Hub Generated] Review request for Microsoft.ContainerInstance to add version stable/2021-07-01 (#15721)

    * Adds base for updating Microsoft.ContainerInstance from version stable/2021-03-01 to version 2021-07-01

    * Updates readme

    * Updates API version in new specs and examples

    * Adding subnet IDs

    * Adding fixes from pending 03-01 update

    * Changing definition name to match convention

    * Adding network dependencies API

    * Adding MSI+ACR properties

    * Removing network profile

    * Updating example

    * Fixing JSON error

    * Removing network profile reference

    * Adding Integer format where missing

    * Removing comma

    * Fixing example

    * Fixing example

    * Ran Prettier to resolve check failure

    * Running prettier again for format

    * version,CHANGELOG

    * test

    Co-authored-by: SDKAuto <sdkautomation@microsoft.com>
    Co-authored-by: PythonSdkPipelines <PythonSdkPipelines>

commit f3144dc
Author: swathipil <76007337+swathipil@users.noreply.github.com>
Date:   Tue Sep 21 17:13:31 2021 -0700

    [SchemaRegistry] remove cache from client (#20760)

    * remove cache from client

    * changelog

commit f8ff686
Author: McCoy Patiño <39780829+mccoyp@users.noreply.github.com>
Date:   Tue Sep 21 11:08:50 2021 -0700

    Update add_sanitizer and doc (#20769)

commit 0e20469
Author: Wes Haggard <weshaggard@users.noreply.github.com>
Date:   Tue Sep 21 08:27:38 2021 -0700

    Enable release stage selection at queue time (#20767)

commit da36d30
Author: McCoy Patiño <39780829+mccoyp@users.noreply.github.com>
Date:   Mon Sep 20 17:21:33 2021 -0700

    [Key Vault] Add certificate import sample (#20641)

commit e7d3348
Author: Franko Morales <67804607+cochi2@users.noreply.github.com>
Date:   Mon Sep 20 16:51:38 2021 -0700

    Fixing VCR redirection (#20747)

    Using the location passed as part of the redirection response if
    it is an absolute URL.

commit 856f247
Author: Scott Addie <10702007+scottaddie@users.noreply.github.com>
Date:   Mon Sep 20 15:10:54 2021 -0500

    Link to Log Analytics throttling guidance from Monitor Query README (#20759)

commit ee9d553
Author: Chidozie Ononiwu (His Righteousness) <31145988+chidozieononiwu@users.noreply.github.com>
Date:   Mon Sep 20 11:15:59 2021 -0700

    Fix broken anchor tags (#20751)

commit 6d84c3a
Author: Scott Beddall <45376673+scbedd@users.noreply.github.com>
Date:   Mon Sep 20 09:08:23 2021 -0700

    avroserializer pins its dependency, which makes regression testing a … (#20735)

    …bit iffy

    @swathipil This will resolve your nightly failure. Still not understanding the specific repro I'm seeing when I run this thing locally though.
  • Loading branch information
zihzhan-msft committed Sep 27, 2021
1 parent 720ef1b commit f173513
Show file tree
Hide file tree
Showing 1,349 changed files with 193,442 additions and 100,851 deletions.
2 changes: 1 addition & 1 deletion doc/dev/docstring_typehint.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ All public methods should have docstrings to document the parameters, keywords,

* [Docstrings](#docstrings)
* [Method Docstrings](#method_docstrings)
* [Model and Client Docstrings](#model_and_Client_Docstrings)
* [Model and Client Docstrings](#model_and_client_docstrings)
* [Type Hints](#type_hints)
* [Type Hints for Python 2.7 and 3.5+](#type_hints_for_python_2.7_and_3.5+)
* [Type Hints for Python 3.5+](#type_hints_for_python_3.5+)
Expand Down
3 changes: 2 additions & 1 deletion doc/dev/test_proxy_migration_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -108,7 +108,8 @@ adding something like the following in the package's `conftest.py` file:
```python
from devtools_testutils import add_sanitizer

@pytest.fixture(scope="session")
# autouse=True will trigger this fixture on each pytest run, even if it's not explicitly used by a test method
@pytest.fixture(scope="session", autouse=True)
def sanitize_uris():
add_sanitizer(ProxyRecordingSanitizer.URI, value="fakeendpoint")
```
Expand Down
1 change: 1 addition & 0 deletions eng/.docsettings.yml
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,7 @@ known_content_issues:
- ['sdk/servicebus/azure-servicebus/tests/perf_tests/README.md', '#4554']
- ['sdk/servicefabric/azure-servicefabric/README.md', '#4554']
- ['sdk/storage/azure-storage-blob/swagger/README.md', '#4554']
- ['cognitivelanguage/azure-ai-language-questionanswering/swagger/README.md', '#4554']
- ['sdk/storage/azure-storage-file-datalake/swagger/README.md', '#4554']
- ['sdk/storage/azure-storage-file-share/swagger/README.md', '#4554']
- ['sdk/storage/azure-storage/README.md', '#4554']
Expand Down
3 changes: 2 additions & 1 deletion eng/ci_tools.txt
Original file line number Diff line number Diff line change
Expand Up @@ -28,8 +28,9 @@ json-delta==2.0
ConfigArgParse==1.2.3
six==1.14.0
pyyaml==5.3.1
pytest==5.4.2; python_version >= '3.5'
pytest==4.6.9; python_version == '2.7'
pytest==5.4.2; python_version >= '3.5' and python_version <= '3.9'
pytest==6.2.4; python_version >= '3.10'
pytest-cov==2.8.1

# local dev packages
Expand Down
36 changes: 36 additions & 0 deletions eng/common/pipelines/templates/steps/policheck.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
parameters:
ExclusionDataBaseFileName: ''
TargetDirectory: ''
PublishAnalysisLogs: false
PoliCheckBlobSAS: "$(azuresdk-policheck-blob-SAS)"
ExclusionFilePath: "$(Build.SourcesDirectory)/eng/guardian-tools/policheck/PolicheckExclusions.xml"

steps:
- pwsh: |
azcopy copy "https://azuresdkartifacts.blob.core.windows.net/policheck/${{ parameters.ExclusionDataBaseFileName }}.mdb?${{ parameters.PoliCheckBlobSAS }}" `
"$(Build.BinariesDirectory)"
displayName: 'Download PoliCheck Exclusion Database'
- task: securedevelopmentteam.vss-secure-development-tools.build-task-policheck.PoliCheck@2
displayName: 'Run PoliCheck'
inputs:
targetType: F
targetArgument: "$(Build.SourcesDirectory)/${{ parameters.TargetDirectory }}"
result: PoliCheck.sarif
optionsFC: 0
optionsXS: 1
optionsPE: 1|2|3|4
optionsRulesDBPath: "$(Build.BinariesDirectory)/${{ parameters.ExclusionDataBaseFileName }}.mdb"
optionsUEPATH: ${{ parameters.ExclusionFilePath }}

- task: securedevelopmentteam.vss-secure-development-tools.build-task-postanalysis.PostAnalysis@2
displayName: 'Post Analysis (PoliCheck)'
inputs:
GdnBreakAllTools: false
GdnBreakGdnToolPoliCheck: true
GdnBreakGdnToolPoliCheckSeverity: Warning
continueOnError: true

- ${{ if eq(parameters.PublishAnalysisLogs, 'true') }}:
- task: securedevelopmentteam.vss-secure-development-tools.build-task-publishsecurityanalysislogs.PublishSecurityAnalysisLogs@3
displayName: 'Publish Security Analysis Logs'
61 changes: 0 additions & 61 deletions eng/common/scripts/Collect-ChangeLogs.ps1

This file was deleted.

7 changes: 4 additions & 3 deletions eng/common/scripts/Update-ChangeLog.ps1
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@
# Unreleased: Default is true. If it is set to false, then today's date will be set in verion title. If it is True then title will show "Unreleased"
# ReplaceLatestEntryTitle: Replaces the latest changelog entry title.

[CmdletBinding()]
param (
[Parameter(Mandatory = $true)]
[String]$Version,
Expand Down Expand Up @@ -74,21 +75,21 @@ if ($ChangeLogEntries.Contains($Version))
{
if ($ChangeLogEntries[$Version].ReleaseStatus -eq $ReleaseStatus)
{
LogWarning "Version [$Version] is already present in change log with specificed ReleaseStatus [$ReleaseStatus]. No Change made."
LogDebug "Version [$Version] is already present in change log with specificed ReleaseStatus [$ReleaseStatus]. No Change made."
exit(0)
}

if ($Unreleased -and ($ChangeLogEntries[$Version].ReleaseStatus -ne $ReleaseStatus))
{
LogWarning "Version [$Version] is already present in change log with a release date. Please review [$ChangelogPath]. No Change made."
LogDebug "Version [$Version] is already present in change log with a release date. Please review [$ChangelogPath]. No Change made."
exit(0)
}

if (!$Unreleased -and ($ChangeLogEntries[$Version].ReleaseStatus -ne $CHANGELOG_UNRELEASED_STATUS))
{
if ((Get-Date ($ChangeLogEntries[$Version].ReleaseStatus).Trim("()")) -gt (Get-Date $ReleaseStatus.Trim("()")))
{
LogWarning "New ReleaseDate for version [$Version] is older than existing release date in changelog. Please review [$ChangelogPath]. No Change made."
LogDebug "New ReleaseDate for version [$Version] is older than existing release date in changelog. Please review [$ChangelogPath]. No Change made."
exit(0)
}
}
Expand Down
11 changes: 10 additions & 1 deletion eng/common/scripts/Update-DocsMsPackages.ps1
Original file line number Diff line number Diff line change
Expand Up @@ -18,10 +18,19 @@ packages which have not released to a central package manager.
.PARAMETER DocRepoLocation
Location of the docs.microsoft.com reference docs repo.
.PARAMETER PackageSourceOverride
Optional parameter to supply a different package source (useful for daily dev
docs generation from pacakges which are not published to the default feed). This
variable is meant to be used in the domain-specific business logic in
&$UpdateDocsMsPackagesFn
#>
param (
[Parameter(Mandatory = $true)]
$DocRepoLocation # the location of the cloned doc repo
[string] $DocRepoLocation, # the location of the cloned doc repo

[Parameter(Mandatory = $false)]
[string] $PackageSourceOverride
)

. (Join-Path $PSScriptRoot common.ps1)
Expand Down
1 change: 1 addition & 0 deletions eng/common/scripts/Verify-ChangeLog.ps1
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
# Wrapper Script for ChangeLog Verification
[CmdletBinding()]
param (
[String]$ChangeLogLocation,
[String]$VersionString,
Expand Down
55 changes: 47 additions & 8 deletions eng/common/scripts/stress-testing/deploy-stress-tests.ps1
Original file line number Diff line number Diff line change
Expand Up @@ -21,13 +21,12 @@ $ErrorActionPreference = 'Stop'
$FailedCommands = New-Object Collections.Generic.List[hashtable]

. (Join-Path $PSScriptRoot "../Helpers" PSModule-Helpers.ps1)
Install-ModuleIfNotInstalled "powershell-yaml" "0.4.1" | Import-Module
Install-ModuleIfNotInstalled "az" "6.4.0" | Import-Module

# Powershell does not (at time of writing) treat exit codes from external binaries
# as cause for stopping execution, so do this via a wrapper function.
# See https://github.com/PowerShell/PowerShell-RFC/pull/277
function Run() {
function Run()
{
Write-Host "`n==> $args`n" -ForegroundColor Green
$command, $arguments = $args
& $command $arguments
Expand All @@ -37,14 +36,16 @@ function Run() {
}
}

function RunOrExitOnFailure() {
function RunOrExitOnFailure()
{
run @args
if ($LASTEXITCODE) {
exit $LASTEXITCODE
}
}

function Login([string]$subscription, [string]$clusterGroup, [boolean]$pushImages) {
function Login([string]$subscription, [string]$clusterGroup, [boolean]$pushImages)
{
Write-Host "Logging in to subscription, cluster and container registry"
az account show *> $null
if ($LASTEXITCODE) {
Expand Down Expand Up @@ -120,8 +121,8 @@ function DeployStressPackage(
Run helm dependency update $pkg.Directory
if ($LASTEXITCODE) { return }

if (Test-Path "$($pkg.Directory)/test-resources.bicep") {
Run az bicep build -f "$($pkg.Directory)/test-resources.bicep"
if (Test-Path "$($pkg.Directory)/stress-test-resources.bicep") {
Run az bicep build -f "$($pkg.Directory)/stress-test-resources.bicep"
if ($LASTEXITCODE) { return }
}

Expand Down Expand Up @@ -165,7 +166,7 @@ function DeployStressPackage(
Write-Warning "The issue may be fixable by first running 'helm rollback -n $($pkg.Namespace) $($pkg.ReleaseName)'"
return
}

# Helm 3 stores release information in kubernetes secrets. The only way to add extra labels around
# specific releases (thereby enabling filtering on `helm list`) is to label the underlying secret resources.
# There is not currently support for setting these labels via the helm cli.
Expand All @@ -177,7 +178,45 @@ function DeployStressPackage(
Run kubectl label secret -n $pkg.Namespace --overwrite $helmReleaseConfig deployId=$deployId
}

function CheckDependencies()
{
$deps = @(
@{
Command = "docker";
Help = "Docker must be installed: https://docs.docker.com/get-docker/";
}
@{
Command = "kubectl";
Help = "kubectl must be installed: https://kubernetes.io/docs/tasks/tools/#kubectl";
},
@{
Command = "helm";
Help = "helm must be installed: https://helm.sh/docs/intro/install/";
},
@{
Command = "az";
Help = "Azure CLI must be installed: https://docs.microsoft.com/en-us/cli/azure/install-azure-cli";
}
)

Install-ModuleIfNotInstalled "powershell-yaml" "0.4.1" | Import-Module

$shouldError = $false
foreach ($dep in $deps) {
if (!(Get-Command $dep.Command -ErrorAction SilentlyContinue)) {
$shouldError = $true
Write-Error $dep.Help
}
}

if ($shouldError) {
exit 1
}

}

# Don't call functions when the script is being dot sourced
if ($MyInvocation.InvocationName -ne ".") {
CheckDependencies
DeployStressTests @PSBoundParameters
}
78 changes: 77 additions & 1 deletion eng/pipelines/templates/jobs/tests-nightly-python.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,83 @@ trigger:

jobs:

- job: Validate_RC_Python_Build_Windows
displayName: Validate Release Candidate Python - Windows
variables:
skipComponentGovernanceDetection: true
PythonVersion: '3.10.0-rc.2'

timeoutInMinutes: 90

pool:
vmImage: 'windows-2019'

steps:
- template: /eng/pipelines/templates/steps/use-python-version.yml
parameters:
versionSpec: $(PythonVersion)

- script: |
python -m pip freeze
python -m pip --version
pip install setuptools==56.0.0 wheel==0.37.0 tox==3.24.3 tox-monorepo==0.1.2 packaging==21.0
displayName: Install Dependencies
- script: |
python ./scripts/devops_tasks/setup_execute_tests.py "$(BuildTargetingString)" --junitxml="junit/test_results.xml" --toxenv="whl"
displayName: 'Setup - Run Filtered Tests For Python $(PythonVersion)'
env:
YARL_NO_EXTENSIONS: 1
continueOnError: true
- task: PublishTestResults@2
condition: always()
inputs:
testResultsFiles: '**/*test*.xml'
testRunTitle: 'Python $(PythonVersion)'
failTaskOnFailedTests: true

- job: Validate_RC_Python_Build_Linux
displayName: Validate Release Candidate Python - Linux
variables:
skipComponentGovernanceDetection: true
PythonVersion: '3.10.0-rc.2'

timeoutInMinutes: 90

pool:
vmImage: 'ubuntu-18.04'

steps:
- template: /eng/pipelines/templates/steps/use-python-version.yml
parameters:
versionSpec: $(PythonVersion)

- script: |
python -m pip freeze
python -m pip --version
pip install setuptools==56.0.0 wheel==0.37.0 tox==3.24.3 tox-monorepo==0.1.2 packaging==21.0
displayName: Install Dependencies
- script: |
find /usr/lib -name "libffi.so*"
ln -s /usr/lib/x86_64-linux-gnu/libffi.so.7 /usr/lib/x86_64-linux-gnu/libffi.so.6
python ./scripts/devops_tasks/setup_execute_tests.py "$(BuildTargetingString)" --junitxml="junit/test_results.xml" --toxenv="whl"
displayName: 'Setup - Run Filtered Tests For Python $(PythonVersion)'
env:
YARL_NO_EXTENSIONS: 1
continueOnError: true
- task: PublishTestResults@2
condition: always()
inputs:
testResultsFiles: '**/*test*.xml'
testRunTitle: 'Python $(PythonVersion)'
failTaskOnFailedTests: true

- job: Validate_Nightly_Python_Build
displayName: Validate Nightly Dev Python Build
variables:
skipComponentGovernanceDetection: true

Expand Down Expand Up @@ -48,5 +124,5 @@ jobs:
condition: always()
inputs:
testResultsFiles: '**/junit/test-results.xml'
testRunTitle: '$(OSName) Python $(PythonVersion)'
testRunTitle: 'Python Nightly'
failTaskOnFailedTests: true
Loading

0 comments on commit f173513

Please sign in to comment.