Code

Release candidate#3403

Code

Merged

nick-stroud merged 164 commits intomainGoogleCloudPlatform/cluster-toolkit:mainfrom release-candidateGoogleCloudPlatform/cluster-toolkit:release-candidateCopy head branch name to clipboardDec 19, 2024

+28,414-1,866

Commits

Commits on Oct 30, 2024

• Standardizing the network naming for the integration tests

  cdunbar13

  committed
  f9c5974

Commits on Nov 4, 2024

• Merge branch 'develop' of https://github.com/pawloch00/cluster-toolkit into develop

  pawloch00

  committed
  ee84ffe

Commits on Nov 15, 2024

• Update mount parallelstore script to support multiple parallelstore

  Show description for 02c7962
  harshthakkar01

  committed
  02c7962

Commits on Nov 20, 2024

• Update custom TAS scripts to support A3U

  ighosh98

  committed
  728c0c3

Commits on Nov 26, 2024

• Updating Slurm-GCP to 6.8.6

  cdunbar13

  committed
  5bcc159

Commits on Nov 27, 2024

• Merge pull request #3312 from cdunbar13/update-slurm-gcp-version

  Show description for 834fe90
  cdunbar13

  authored
  834fe90

• add kueue non tas integration tests

  ighosh98

  committed
  c1bc523

• SlurmGCP. Harden topology updates

  mr0re1

  committed
  d303813

• Fix the default disk which was updated as it seemed local ssd did not have NVME interface

  ankitkinra

  committed
  1e58ed3

• Merge pull request #3316 from mr0re1/topo_upd

  Show description for f25af1c
  mr0re1

  authored
  f25af1c

Commits on Nov 28, 2024

• tas tests added

  ighosh98

  committed
  2741f58

• support jobset 0.7.1

  annuay-google

  committed
  bfb5d70

• support jobset 0.7.1

  annuay-google

  committed
  e255640

• Merge pull request #3315 from ighosh98/develop-kueue-tests

  Show description for eb8dc53
  ighosh98

  authored
  eb8dc53

• Add dynamic setup of gpu_limit in gke-job-template module

  mohitchaurasia91

  committed
  cf0acd2

• fixed typo

  mohitchaurasia91

  committed
  9bb4d7a

• fixed typo

  mohitchaurasia91

  committed
  343e897

• deprecated comments

  mohitchaurasia91

  committed
  e5ace41

• fixed terraform issue

  mohitchaurasia91

  committed
  ca16871

• Merge branch 'develop' of https://github.com/pawloch00/cluster-toolkit into ppawl-add-pip3

  pawloch00

  committed
  9d36504

• add python-pip3

  Show description for 6bd24f0
  pawloch00

  committed
  6bd24f0

Commits on Nov 29, 2024

• install packages globally

  Show description for 9e9a03f
  pawloch00

  committed
  9e9a03f

• add support v0.9.1

  ighosh98

  committed
  209de06

• Merge pull request #3321 from ighosh98/develop-v0.9.1

  Show description for a80864f
  ighosh98

  authored
  a80864f

• merge develop

  annuay-google

  committed
  6ee4ffa

• Merge pull request #3318 from annuay-google/annuay/bump-jobset-version

  Show description for 1af5c6d
  annuay-google

  authored
  1af5c6d

• fix issue related to gpu shared config

  mohitchaurasia91

  committed
  97d8217

• use list instead of map for secondary ranges

  annuay-google

  committed
  c3463b8

• code refactored

  mohitchaurasia91

  committed
  8aa5e5c

Commits on Dec 1, 2024

• Bump golang.org/x/sys from 0.26.0 to 0.27.0

  Show description for d09823d
  dependabot[bot]

  authored
  d09823d

• Bump github.com/zclconf/go-cty from 1.15.0 to 1.15.1

  Show description for 0967097
  dependabot[bot]

  authored
  0967097

• Bump github.com/hashicorp/hcl/v2 from 2.22.0 to 2.23.0

  Show description for f9d4b9f
  dependabot[bot]

  authored
  f9d4b9f

• Add reservations to vm-instance

  cdunbar13

  committed
  5910ab1

Commits on Dec 2, 2024

• set GOOGLE_APPLICATION_CREDENTIALS

  Show description for 11742fd
  pawloch00

  committed
  11742fd

• remove setting creds path

  Show description for cc48407
  pawloch00

  committed
  cc48407

• Merge pull request #3317 from ankitkinra/fix-default-ssd

  Show description for b7c50ad
  ankitkinra

  authored
  b7c50ad

• Merge pull request #3325 from GoogleCloudPlatform/dependabot/go_modules/develop/github.com/hashicorp/hcl/v2-2.23.0

  Show description for 2924327
  alyssa-sm

  authored
  2924327

• Merge pull request #3324 from GoogleCloudPlatform/dependabot/go_modules/develop/github.com/zclconf/go-cty-1.15.1

  Show description for ebfd142
  alyssa-sm

  authored
  ebfd142

• Merge pull request #3323 from GoogleCloudPlatform/dependabot/go_modules/develop/golang.org/x/sys-0.27.0

  Show description for dbd6f47
  alyssa-sm

  authored
  dbd6f47

• add migration example to description

  annuay-google

  committed
  00d1223

Commits on Dec 3, 2024

• Make most of the variables optional on additional networks to reduce verbosity of defining interfaces

  wiktorn

  committed
  46d2c3d

• Refactor Python Integration Test

  alyssa-sm

  committed
  71da978

• Merge pull request #3319 from mohitchaurasia91/fix_gpu_limit

  Show description for 549e252
  mohitchaurasia91

  authored
  549e252

• Merge pull request #3295 from ighosh98/develop-tas-plugin

  Show description for e0c690b
  annuay-google

  authored
  e0c690b

• Addressing feedback for PR

  cdunbar13

  committed
  c04180d

• Merge pull request #3303 from wiktorn/simplify_additional_networks

  Show description for f032613
  mr0re1

  authored
  f032613

• Merge pull request #3331 from alyssa-sm/refactor-python-test

  Show description for 6eb555a
  alyssa-sm

  authored
  6eb555a

• Refactor obtaining "resume_data" and bulk-grouping nodes

  mr0re1

  committed
  8298714

Commits on Dec 4, 2024

• Merge pull request #3332 from mr0re1/resume_data

  Show description for f7161e8
  mr0re1

  authored
  f7161e8

• integrate tas plugin bug fixes

  ighosh98

  committed
  df854d8

• Merge pull request #3339 from ighosh98/tas-plugin

  Show description for c14e964
  ighosh98

  authored
  c14e964

• Add change to conditionally perform pip install based on gke_node_pool machine_type

  mohitchaurasia91

  committed
  54d2602

• Merge pull request #3327 from cdunbar13/vm-instance-reservation

  Show description for f326cb0
  cdunbar13

  authored
  f326cb0

• Add Python Integration Test Build Files

  alyssa-sm

  committed
  d93cac0

• Merge pull request #3335 from alyssa-sm/add-python-integration-test-build-files

  Show description for 08c7007
  alyssa-sm

  authored
  08c7007

• Redirect OpenFOAM tutorial to scientific computing examples demostration

  wardharold

  committed
  e0e6533

• Merge branch 'GoogleCloudPlatform:develop' into develop

  wkharold

  authored
  b61abfe

• Revert "integrate tas plugin bug fixes"

  ighosh98

  authored
  bfbcd6f

• Merge pull request #3344 from GoogleCloudPlatform/revert-3339-tas-plugin

  Show description for f6d86d0
  ankitkinra

  authored
  f6d86d0

• Update A3 High integration test with new base image

  tpdownes

  committed
  cfe7e6f

• SlurmGCP. Resume. Don't group nodes by non-exclusive jobs

  mr0re1

  committed
  6a650d5

• Address feedback during review of #3256

  Show description for 6888f3f
  tpdownes

  committed
  6888f3f

Commits on Dec 5, 2024

• Add python test build files to daily-tests

  alyssa-sm

  committed
  c38e59a

• Merge pull request #3346 from alyssa-sm/add-paramiko-to-docker

  Show description for 97e662d
  alyssa-sm

  authored
  97e662d

• Merge pull request #3340 from mr0re1/job_array

  Show description for 5f1092e
  mr0re1

  authored
  5f1092e

• SlurmGCP. Use generated placement policies with dense reservations.

  mr0re1

  committed
  994c6e9

• Add NodeAction classes to subsitute NodeStatus Enum

  abbas1902

  committed
  6684796

• Merge pull request #3338 from abbas1902/cut_action

  Show description for 8f8eb63
  abbas1902

  authored
  8f8eb63

• Merge pull request #3345 from tpdownes/update_a3high_test

  Show description for 41fa782
  tpdownes

  authored
  41fa782

• Merge pull request #3347 from mr0re1/reservation_pp

  Show description for 2cfd2f9
  mr0re1

  authored
  2cfd2f9

• Merge pull request #3256 from harshthakkar01/ps-fix-2

  Show description for c416381
  tpdownes

  authored
  c416381

• Merge pull request #3341 from mohitchaurasia91/gke-pip3-fix

  Show description for 6f3a643
  mohitchaurasia91

  authored
  6f3a643

• Merge pull request #3350 from GoogleCloudPlatform/main

  Show description for ca73935
  ighosh98

  authored
  ca73935

• Rename openfoam.md to README.md

  Show description for 31365dc
  wkharold

  authored
  31365dc

• Merge pull request #3320 from pawloch00/ppawl-add-pip3

  Show description for e6abf74
  rohitramu

  authored
  e6abf74

Commits on Dec 6, 2024

• update terraform to 6.12.0

  ighosh98

  committed
  0e7ba6b

• Enable PS CSI through google-container-cluster module

  mohitchaurasia91

  committed
  8d3c524

• Sync Toolkit with local development during review of #3256

  tpdownes

  committed
  767a2c7

• Ensure parallelstore mounts are restarted after DAOS agent restarts

  tpdownes

  committed
  b823c12

• Avoid spurious warnings upon reboot by creating apt source.list file upon every execution

  tpdownes

  committed
  bcb2004

• Fail early in Parallelstore client installation

  tpdownes

  committed
  94b5392

• make upgrade settings configurable

  ighosh98

  committed
  2e21505

• Merge pull request #3356 from ighosh98/update-terraform-provider

  Show description for 283ced3
  ighosh98

  authored
  283ced3

• Use relative path for remaining use of startup-script module

  tpdownes

  committed
  04de06e

• Merge pull request #3360 from tpdownes/fix_startup_usage

  Show description for 6c5233c
  tpdownes

  authored
  6c5233c

• SlurmGCP. Improve non-exclusive placement alloaction

  mr0re1

  committed
  f84c4f7

Commits on Dec 7, 2024

• Add future reservation support

  abbas1902

  committed
  b18d453

• Merge pull request #3227 from abbas1902/to_be_fulfilled

  Show description for 8b4d994
  abbas1902

  authored
  8b4d994

• Merge pull request #2 from mohitchaurasia91/develop

  Show description for b7a3602
  mohitchaurasia91

  authored
  b7a3602

• Merge pull request #3354 from mr0re1/chunk_pp

  Show description for c519141
  mr0re1

  authored
  c519141

• Add TTL to SSH key

  mr0re1

  committed
  182641e

• Merge pull request #3363 from mr0re1/ssh_key_expiration

  Show description for 3548189
  mr0re1

  authored
  3548189

Commits on Dec 9, 2024

• Merge pull request #3357 from mohitchaurasia91/enable-gcsfuse-ps-config

  Show description for 6ef1838
  mohitchaurasia91

  authored
  6ef1838

• refactor to use preconditions and throw specific errors

  ighosh98

  committed
  f969c00

• Merge branch 'develop' of https://github.com/pawloch00/cluster-toolkit into develop

  pawloch00

  committed
  4ef9dac

• set enable_private_endpoints to false

  Show description for 5981b96
  pawloch00

  committed
  5981b96

• Update terraform provider to 6.13.0

  alyssa-sm

  committed
  780ad26

• Merge pull request #3367 from alyssa-sm/update-terraform-provider

  Show description for a897961
  alyssa-sm

  authored
  a897961

• Fix node_is_fr to handle empty string instead

  abbas1902

  committed
  f774aa9

• Merge pull request #3369 from abbas1902/fr_fix

  Show description for ef29fd7
  abbas1902

  authored
  ef29fd7

Commits on Dec 10, 2024

• manage edge cases for upgrade settings gracefully

  ighosh98

  committed
  75a60c3

• Update image-builder.yaml link in README

  ighosh98

  authored
  6714b52

• Merge pull request #3373 from ighosh98/develop

  Show description for c7a0347
  ighosh98

  authored
  c7a0347

• Merge pull request #3359 from ighosh98/upgrade-settings

  Show description for e1b48a6
  ighosh98

  authored
  e1b48a6

• Merge pull request #3188 from cdunbar13/integration-test-network-standardization

  Show description for fc9b339
  cdunbar13

  authored
  fc9b339

• Promote the new nic-types in vm-instance

  cdunbar13

  committed
  f53c66c

• Merge pull request #3288 from cdunbar13/promote-vm-nic-types

  Show description for 2360811
  cdunbar13

  authored
  2360811

• Merge pull request #3348 from tpdownes/address_3256

  Show description for 1adc1bd
  tpdownes

  authored
  1adc1bd

• Migrate instance_template modules from slurm-gcp repo

  mr0re1

  committed
  8d1ae34

• Update to ensure that gpu-test is compatible with H200 and H100s for new machine-types

  cdunbar13

  committed
  ea0704d

• Merge pull request #3380 from mr0re1/move_tmpl2

  Show description for d3f3ceb
  mr0re1

  authored
  d3f3ceb

• skip setting disk_labels if disk_type is local-ssd

  abbas1902

  committed
  27ac4ab

Commits on Dec 11, 2024

• Merge pull request #3383 from abbas1902/labels_ssd

  Show description for 5f4bb52
  abbas1902

  authored
  5f4bb52

• Add Future Reservation guide

  abbas1902

  committed
  cff3d11

• Merge pull request #3365 from abbas1902/how_to

  Show description for 03c653b
  abbas1902

  authored
  03c653b

• Update community/modules/scheduler/schedmd-slurm-gcp-v6-controller/modules/slurm_files/scripts/tools/gpu-test

  Show description for 7fdd6d3
  

  cdunbar13

  and

  tpdownes

  authored
  7fdd6d3

• Merge pull request #3381 from cdunbar13/a3u-update-gpu-test

  Show description for 063530c
  cdunbar13

  authored
  063530c

• make changes backward compatible and port to older blueprints

  annuay-google

  committed
  e0ff3b9

• add validation

  annuay-google

  committed
  bf08e16

• use secondary ranges list where available, if not fall back to secondary ranges

  annuay-google

  committed
  5ba7bf7

• testing complete

  annuay-google

  committed
  b11a70c

• fix failing tests

  annuay-google

  committed
  e9ec97c

• gke v1.31 added to acceptable list for a3-mega

  sharabiani

  committed
  dabb494

• Merge pull request #3364 from pawloch00/ppawl-fix-a3-xpk

  Show description for 09f4b0c
  pawloch00

  authored
  09f4b0c

• update deprecation warning

  annuay-google

  committed
  f09b6f0

• An option added to disable/enable workload script execution for A3-High and A3-Mega

  sharabiani

  committed
  146a9f8

• Merge pull request #3322 from annuay-google/annuay/prefix-based-resource-names-gke

  Show description for 14d473b
  annuay-google

  authored
  14d473b

• Formatting markdown

  nick-stroud

  committed
  354f10a

• Adding network_profile to the VPC modules

  cdunbar13

  committed
  4351862

• Merge pull request #3342 from wkharold/develop

  Show description for a4b03cf
  nick-stroud

  authored
  a4b03cf

• Merge pull request #3388 from sharabiani/gke-ver-check

  Show description for ebda34f
  sharabiani

  authored
  ebda34f

• Merge pull request #3389 from sharabiani/optional-workload-script

  Show description for 125b5ec
  sharabiani

  authored
  125b5ec

• Update python integration tests to throw errors

  alyssa-sm

  committed
  6a57e7f

• Merge pull request #3361 from alyssa-sm/update-python-tests-to-throw

  Show description for 796a00b
  alyssa-sm

  authored
  796a00b

Commits on Dec 12, 2024

• Merge pull request #3387 from cdunbar13/vpc-network-profile

  Show description for e7dae4e
  cdunbar13

  authored
  e7dae4e

• TopologyAwareScheduling enabled by default

  sharabiani

  committed
  8202f72

• Merge pull request #3394 from GoogleCloudPlatform/main

  Show description for b6bb0c5
  harshthakkar01

  authored
  b6bb0c5

• tolerations added back

  sharabiani

  committed
  53f9646

• Migrate _slurm_instance and slurm_tpu_nodeset modules from slurm-gcp repo

  abbas1902

  committed
  7f7dc6b

• Update to ensure that gpu-test is compatible with H200 and H100s for new machine-types

  cdunbar13

  committed
  37912df

• Update community/modules/scheduler/schedmd-slurm-gcp-v6-controller/modules/slurm_files/scripts/tools/gpu-test

  Show description for 755acfa
  

  cdunbar13

  and

  tpdownes

  committed
  755acfa

• Initial commit of gpu-vpc module

  cdunbar13

  committed
  bca3956

• PR review updates

  cdunbar13

  committed
  7a4d256

• Merge pull request #3396 from sharabiani/support-kueue-v0-9-1

  Show description for 64f812e
  sharabiani

  authored
  64f812e

• Merge pull request #3391 from cdunbar13/gpu-vpc-promo

  Show description for 76d2e38
  cdunbar13

  authored
  76d2e38

• Merge pull request #3390 from abbas1902/the_modules_are_coming

  Show description for 0283c4d
  abbas1902

  authored
  0283c4d

• Increase version to 1.44.0

  harshthakkar01

  committed
  ed822a5

• Merge pull request #3399 from GoogleCloudPlatform/version/v1.44.0

  Show description for ed25c4d
  harshthakkar01

  authored
  ed25c4d

Commits on Dec 19, 2024

• Add terraform setup to github workflow config

  

  abbas1902

  authored and

  ighosh98

  committed
  4dda16b

• Update README for parallelstore related example blueprint

  mohitchaurasia91

  committed
  5ada631

• Update README with GKE parallelstore related example blueprint details

  mohitchaurasia91

  committed
  e74ca30

• Update README with GKE parallelstore related example blueprint details

  mohitchaurasia91

  committed
  2e497b1

• Updated blueprint name from gke-storage-parallelstore to gke-storage-managed-parallelstore

  mohitchaurasia91

  committed
  d7723f4

• Update ops to operation

  mohitchaurasia91

  committed
  2bc964e

• Fix gke parallelstore blueprint name going beyond network char limit

  mohitchaurasia91

  committed
  ee06379

• Updated ansible playbook test file name

  mohitchaurasia91

  committed
  f613347

• Merge pull request #3436 from ighosh98/release-branch

  Show description for 0b570bc
  nick-stroud

  authored
  0b570bc

• Merge branch 'release-candidate' into release-branch

  mohitchaurasia91

  authored
  77be2dd

• add reservations for kueue integration tests

  ighosh98

  committed
  9e39b30

• Merge pull request #3431 from ighosh98/release-candidate

  Show description for 8bb384f
  nick-stroud

  authored
  8bb384f

• Merge branch 'release-candidate' into release-branch

  nick-stroud

  authored
  dbc0740

• Merge pull request #3437 from mohitchaurasia91/release-branch

  Show description for 4d362f6
  nick-stroud

  authored
  4d362f6

• Fix typo if scheduiling.provisioningModel field

  mr0re1

  committed
  fd6ca50

• Merge pull request #3443 from mr0re1/rc_resbound

  Show description for 9ec27bb
  nick-stroud

  authored
  9ec27bb