Release v1.16.0 #1147

mr0re1 · 2023-04-10T16:55:55Z

Improvements

New simple Lustre example. (blueprint, documentation)
htcondor-execute-point: Added option to HTCondor autoscaler for minimum number of idle VMs to decrease job startup time.
htcondor-execute-point: Added option to set boot disk size.
New validator reports unused deployment variables. (documentation)
Expanded options for skipping individual validators. (documentation)
terraform.tfvars file generated in the deployment folder is written in stable order, making it easier to track in version control.
Test and documentation updates.

Version updates

Slurm V5 modules minor update v5.6.0 > v5.6.2 (full changelog)
- Now compatible with Terraform 1.4.0.
- Resume failures now notify srun of the error.
- setup.log now discoverable in GCP Cloud Logger.
- Fix slurm and slurm-gcp logs not showing up in Cloud Logging.

Bumps [googleapis-common-protos](https://github.com/googleapis/python-api-common-protos) from 1.54.0 to 1.58.0. - [Release notes](https://github.com/googleapis/python-api-common-protos/releases) - [Changelog](https://github.com/googleapis/python-api-common-protos/blob/main/CHANGELOG.md) - [Commits](googleapis/python-api-common-protos@v1.54.0...v1.58.0) --- updated-dependencies: - dependency-name: googleapis-common-protos dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>

Bumps [httplib2](https://github.com/httplib2/httplib2) from 0.20.4 to 0.21.0. - [Release notes](https://github.com/httplib2/httplib2/releases) - [Changelog](https://github.com/httplib2/httplib2/blob/master/CHANGELOG) - [Commits](httplib2/httplib2@v0.20.4...v0.21.0) --- updated-dependencies: - dependency-name: httplib2 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>

Bumps [wrapt](https://github.com/GrahamDumpleton/wrapt) from 1.13.3 to 1.15.0. - [Release notes](https://github.com/GrahamDumpleton/wrapt/releases) - [Changelog](https://github.com/GrahamDumpleton/wrapt/blob/develop/docs/changes.rst) - [Commits](GrahamDumpleton/wrapt@1.13.3...1.15.0) --- updated-dependencies: - dependency-name: wrapt dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>

Bumps [django-extensions](https://github.com/django-extensions/django-extensions) from 3.1.5 to 3.2.1. - [Release notes](https://github.com/django-extensions/django-extensions/releases) - [Changelog](https://github.com/django-extensions/django-extensions/blob/main/CHANGELOG.md) - [Commits](django-extensions/django-extensions@3.1.5...3.2.1) --- updated-dependencies: - dependency-name: django-extensions dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>

Migrate settings for each MIG autoscaler to a SystemD configuration file

Will now update Classad immediately upon negotiation cycle

Add support for minimum # of idle VMs

…unity/front-end/ofe/develop/googleapis-common-protos-1.58.0 Bump googleapis-common-protos from 1.54.0 to 1.58.0 in /community/front-end/ofe

…unity/front-end/ofe/develop/httplib2-0.21.0 Bump httplib2 from 0.20.4 to 0.21.0 in /community/front-end/ofe

…unity/front-end/ofe/develop/wrapt-1.15.0 Bump wrapt from 1.13.3 to 1.15.0 in /community/front-end/ofe

Bumps [grpcio-status](https://grpc.io) from 1.43.0 to 1.51.3. --- updated-dependencies: - dependency-name: grpcio-status dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>

…unity/front-end/ofe/develop/django-extensions-3.2.1 Bump django-extensions from 3.1.5 to 3.2.1 in /community/front-end/ofe

* Remove `ModuleToGroup` from `DeploymentConfig`, as it duplicates state. * Remove passing `modToGrp` around; * Fix bug in `expandSimpleVariable` IGC-case.

Add enforcement of minimum # of idle VMs to HTCondor autoscaler

…unity/front-end/ofe/develop/grpcio-status-1.51.3 Bump grpcio-status from 1.43.0 to 1.51.3 in /community/front-end/ofe

Co-authored-by: Ivan Orlov <orlov@google.com>

Update year of Terraform deployment license

``` $ ./ghpc create tools/validate_configs/test_configs/use-resources.yaml -l ERROR --vars="project_id=io-playground" module homefs uses module network1, but matching setting and outputs were not found. This may be because the value is set explicitly or set by a prior used module module slurm_login uses module homefs, but matching setting and outputs were not found. This may be because the value is set explicitly or set by a prior used module module slurm_login uses module scratchfs, but matching setting and outputs were not found. This may be because the value is set explicitly or set by a prior used module module slurm_login uses module projectsfs, but matching setting and outputs were not found. This may be because the value is set explicitly or set by a prior used module One or more used modules could not have their settings and outputs linked. error: validator test_module_not_used failed ```

…test Add an integration test for chrome-remote-desktop module

… contention with unattended-upgrades

Fix: dependabot proposed incompatible requirements

Merge v1.14.1 back to develop

Add retries to apt tasks in chrome-remote-desktop to account for lock contention with unattended-upgrades

Fixing issue #1096, and dependency conflicts for OFE.

Bumps [google-auth](https://github.com/googleapis/google-auth-library-python) from 2.17.0 to 2.17.1. - [Release notes](https://github.com/googleapis/google-auth-library-python/releases) - [Changelog](https://github.com/googleapis/google-auth-library-python/blob/main/CHANGELOG.md) - [Commits](googleapis/google-auth-library-python@v2.17.0...v2.17.1) --- updated-dependencies: - dependency-name: google-auth dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>

Bumps [django-allauth](https://github.com/pennersr/django-allauth) from 0.53.1 to 0.54.0. - [Release notes](https://github.com/pennersr/django-allauth/releases) - [Changelog](https://github.com/pennersr/django-allauth/blob/master/ChangeLog.rst) - [Commits](pennersr/django-allauth@0.53.1...0.54.0) --- updated-dependencies: - dependency-name: django-allauth dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>

Unused deployment variables validator

Simplify test_module_not_used implementation

…unity/front-end/ofe/develop/django-allauth-0.54.0 Bump django-allauth from 0.53.1 to 0.54.0 in /community/front-end/ofe

…unity/front-end/ofe/develop/google-auth-2.17.1 Bump google-auth from 2.17.0 to 2.17.1 in /community/front-end/ofe

Bumps [django-extensions](https://github.com/django-extensions/django-extensions) from 3.1.5 to 3.2.1. - [Release notes](https://github.com/django-extensions/django-extensions/releases) - [Changelog](https://github.com/django-extensions/django-extensions/blob/main/CHANGELOG.md) - [Commits](django-extensions/django-extensions@3.1.5...3.2.1) --- updated-dependencies: - dependency-name: django-extensions dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>

…unity/front-end/ofe/develop/django-extensions-3.2.1 Bump django-extensions from 3.1.5 to 3.2.1 in /community/front-end/ofe

Track explicit connections between modules

Add ability to set disk size for htcondor execute point

Add terraform module `tools/cloud-build/provision` to manage all test infrastructure. In this PR define following triggers and schedule them: * `DAILY-project-cleanup` * `WEEKLY-build-dependency-check` * `WEEKLY-builder-image` * `ZEBUG-fast-build-failure` * `ZEBUG-fast-build-success`

nick-stroud · 2023-04-11T00:51:13Z

Note: Legacy build triggers all passed. Ignoring new build triggers that are only on develop at this point.

dependabot bot and others added 30 commits March 13, 2023 11:06

HTCondor MIG enhancement

af35483

Migrate settings for each MIG autoscaler to a SystemD configuration file

Configure HTCondor Negotiator

39e1679

Will now update Classad immediately upon negotiation cycle

HTCondor MIG enhancement

cdb22bd

Add support for minimum # of idle VMs

Merge pull request #1014 from GoogleCloudPlatform/dependabot/pip/comm…

21b7eb3

…unity/front-end/ofe/develop/googleapis-common-protos-1.58.0 Bump googleapis-common-protos from 1.54.0 to 1.58.0 in /community/front-end/ofe

Merge pull request #1015 from GoogleCloudPlatform/dependabot/pip/comm…

3d96b77

…unity/front-end/ofe/develop/httplib2-0.21.0 Bump httplib2 from 0.20.4 to 0.21.0 in /community/front-end/ofe

Merge pull request #1016 from GoogleCloudPlatform/dependabot/pip/comm…

81dbdb4

…unity/front-end/ofe/develop/wrapt-1.15.0 Bump wrapt from 1.13.3 to 1.15.0 in /community/front-end/ofe

Merge pull request #1018 from GoogleCloudPlatform/dependabot/pip/comm…

be391af

…unity/front-end/ofe/develop/django-extensions-3.2.1 Bump django-extensions from 3.1.5 to 3.2.1 in /community/front-end/ofe

Remove ModuleToGroup from DeploymentConfig (#1022)

8f738de

* Remove `ModuleToGroup` from `DeploymentConfig`, as it duplicates state. * Remove passing `modToGrp` around; * Fix bug in `expandSimpleVariable` IGC-case.

Address feedback in #983

3a95521

Merge pull request #983 from tpdownes/htcondor_idle_floor_autoscaler

a2d8380

Add enforcement of minimum # of idle VMs to HTCondor autoscaler

Merge pull request #1017 from GoogleCloudPlatform/dependabot/pip/comm…

e0403da

…unity/front-end/ofe/develop/grpcio-status-1.51.3 Bump grpcio-status from 1.43.0 to 1.51.3 in /community/front-end/ofe

Fix broken markfown link (#1024)

34645bd

Co-authored-by: Ivan Orlov <orlov@google.com>

Update year of Terraform deployment license

6cf7539

Merge pull request #1026 from tpdownes/license_year

2a4588d

Update year of Terraform deployment license

Fix: dependabot proposed incompatible requirements

fb100a9

Fix startup-options test (#1029)

8dce57c

Add an integration test for chrome-remote-desktop module

7b34c6a

Merge pull request #1027 from nick-stroud/remote-desktop-integration-…

5ba1446

…test Add an integration test for chrome-remote-desktop module

Add retries to apt tasks in chrome-remote-desktop to account for lock…

5948dc9

… contention with unattended-upgrades

Merge pull request #1028 from nick-stroud/rectify_ofe_requirements

8e2ee2b

Fix: dependabot proposed incompatible requirements

Merge pull request #1033 from GoogleCloudPlatform/main

1517b90

Merge v1.14.1 back to develop

Merge pull request #1025 from nick-stroud/retry-crd-apt

0e495af

Add retries to apt tasks in chrome-remote-desktop to account for lock contention with unattended-upgrades

Bring all provider_meta versions up to current version

f8e96b1

Update pre-commit hook repos

c35748f

cboneti and others added 25 commits March 31, 2023 09:18

Merge pull request #1099 from ek-nag/develop

1a6afd8

Fixing issue #1096, and dependency conflicts for OFE.

Address feedback from #1094

ea656f9

Merge pull request #1094 from tpdownes/track_deployment_edges

1cbf1ae

Create test_deployment_variable_not_used validator

e15eeb9

Document new test_deployment_variable_not_used validator

717bad0

Add test_deployment_variable_not_used to default validators

30f5bd8

Address test_deployment_variable_not_used failures in test blueprints

09987b2

Address feedback from #1101

0872ea4

add disk size

4b876e7

Merge pull request #1101 from tpdownes/unused_deployment_validator

ff0507b

Unused deployment variables validator

Simplify test_module_not_used implementation

0901b19

Merge pull request #1108 from tpdownes/simplify_module_unused

dbf6fcb

Simplify test_module_not_used implementation

Merge pull request #1104 from GoogleCloudPlatform/dependabot/pip/comm…

f5f2bc4

…unity/front-end/ofe/develop/django-allauth-0.54.0 Bump django-allauth from 0.53.1 to 0.54.0 in /community/front-end/ofe

Merge pull request #1102 from GoogleCloudPlatform/dependabot/pip/comm…

05d9572

…unity/front-end/ofe/develop/google-auth-2.17.1 Bump google-auth from 2.17.0 to 2.17.1 in /community/front-end/ofe

Track explicit connections between modules

0957672

Merge pull request #1103 from GoogleCloudPlatform/dependabot/pip/comm…

1799461

…unity/front-end/ofe/develop/django-extensions-3.2.1 Bump django-extensions from 3.1.5 to 3.2.1 in /community/front-end/ofe

Change disk_size_gb var type

eed60a0

Address feedback from #1109

874ac5e

Merge pull request #1109 from tpdownes/track_explicit_edges

ad302fd

Track explicit connections between modules

Merge pull request #1107 from thiagosgobe/htcondor_disk_size

3a20b57

Add ability to set disk size for htcondor execute point

version update

dfcae3a

mr0re1 assigned nick-stroud Apr 10, 2023

nick-stroud approved these changes Apr 11, 2023

View reviewed changes

nick-stroud merged commit 8bac6ec into main Apr 11, 2023

nick-stroud deleted the release-candidate branch April 11, 2023 00:54

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release v1.16.0 #1147

Release v1.16.0 #1147

mr0re1 commented Apr 10, 2023 •

edited by nick-stroud

Loading

nick-stroud commented Apr 11, 2023

Release v1.16.0 #1147

Release v1.16.0 #1147

Conversation

mr0re1 commented Apr 10, 2023 • edited by nick-stroud Loading

Improvements

Version updates

nick-stroud commented Apr 11, 2023

mr0re1 commented Apr 10, 2023 •

edited by nick-stroud

Loading