Updating CI env with 2022.01 jcoin.datacommons.io 1643912611

[PlanXCyborg]

Applying version 2022.01 to jcoin.datacommons.io

[PlanXCyborg]

jcoin.datacommons.io/manifest.json

Deployment changes

• hatchery
  • Add pay-models-dynamodb-table to the Hatchery configuration file to fetch pay model data from DynamoDB (PR fix(dataguids.org): add manifest.json #35) (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Update the Hatchery configuration file pay-models block to change the user field name to user_id (PR fix(dataguids.org): add manifest.json #35) (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Add gen3-volume-location to the Hatchery configuration file for each container to overwrite the directory that API key will be saved to (PR fix(account): portal to master #33) (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Update the Hatchery configuration file pay-models block to add option ecs for enabling ECS decoupled workspace (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Update the Hatchery configuration file pay-models block to add option subnet for setup transit gateway subnet addresses (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Add pay-models-dynamodb-table to the Hatchery configuration file to fetch pay model data from DynamoDB (PXP-8341 Fetch pay models from DynamoDB hatchery#35)
  • Update the Hatchery configuration file pay-models block to change the user field name to user_id (PXP-8341 Fetch pay models from DynamoDB hatchery#35)
• indexd
  • Include example secrets to load PostgreSQL settings for indexd (Add files for psql ssl support indexd#317)
• metadata
  • A job has been created to make aggregate MDS population more robust feat(agg-mds-job): add new agg mds job cloud-automation#1722 (feat(populate): improved populate script, docs metadata-service#33)
  • Must set the appropriate AGG_MDS_NAMESPACE value in metadata.env (Feat/mds adapter metadata-service#29)
  • Per chore(metadata): migrate agg MDS configs #3332 a metadata/aggregate_config.json file should be created as part of the manifest config for a commons and the appropriate environment vars for metadata should be defined in the manifest JSON (chore(configs): remove configs from source control metadata-service#30)
  • The new command to populate an aggregate MDS is kubectl exec $(gen3 pod metadata) -- python /src/src/mds/populate.py --config /aggregate_config.json --hostname esproxy-service --port 9200 (chore(configs): remove configs from source control metadata-service#30)
• portal
  • The pay model support depends on this PR: PXP-8779 HP-347 Feat/ecs hatchery#38 (PXP-8520 Feat/paymodels data-portal#900)
  • set "showExternalLoginsOnProfile": true for showing external logins on the profile page (Feat/profile fed auth data-portal#934)
  • Discovery: introduced a new config section discoveryConfig.features.search.tagSearchDropdown, see portal-config.md for more info (HP-555 Feat/disco tag dropdown viewer data-portal#927)
  • To enable this check, set features.exportToWorkspace.verifyExternalLogins flag to true in gitops (Check all WTS OIDCs are signed in before download/export to WS data-portal#921)
  • Misc: add option for bundle name: ecosystem, which is the same as heal bundle under the hood (Chore/discovery for more bundles data-portal#918)
• sower
  • PS: This is follow-up on this one: feat(dcf): dcf prod release 2.2.7 #24 ([PXP-8941] [PXP-8859] Feat/update go 1.17 sower#25)
• ssjdispatcher
  • PS: This is follow-up on this one: Kids First ETL Mapping #39 ([PXP-8943] [PXP-8859] Feat/update go 1.17 ssjdispatcher#40)

[PlanXCyborg]

jcoin.datacommons.io/manifest.json

Deployment changes

• hatchery
  • Add pay-models-dynamodb-table to the Hatchery configuration file to fetch pay model data from DynamoDB (PR fix(dataguids.org): add manifest.json #35) (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Update the Hatchery configuration file pay-models block to change the user field name to user_id (PR fix(dataguids.org): add manifest.json #35) (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Add gen3-volume-location to the Hatchery configuration file for each container to overwrite the directory that API key will be saved to (PR fix(account): portal to master #33) (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Update the Hatchery configuration file pay-models block to add option ecs for enabling ECS decoupled workspace (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Update the Hatchery configuration file pay-models block to add option subnet for setup transit gateway subnet addresses (PXP-8779 HP-347 Feat/ecs hatchery#38)
  • Add pay-models-dynamodb-table to the Hatchery configuration file to fetch pay model data from DynamoDB (PXP-8341 Fetch pay models from DynamoDB hatchery#35)
  • Update the Hatchery configuration file pay-models block to change the user field name to user_id (PXP-8341 Fetch pay models from DynamoDB hatchery#35)
• indexd
  • Include example secrets to load PostgreSQL settings for indexd (Add files for psql ssl support indexd#317)
• metadata
  • A job has been created to make aggregate MDS population more robust feat(agg-mds-job): add new agg mds job cloud-automation#1722 (feat(populate): improved populate script, docs metadata-service#33)
  • Must set the appropriate AGG_MDS_NAMESPACE value in metadata.env (Feat/mds adapter metadata-service#29)
  • Per chore(metadata): migrate agg MDS configs #3332 a metadata/aggregate_config.json file should be created as part of the manifest config for a commons and the appropriate environment vars for metadata should be defined in the manifest JSON (chore(configs): remove configs from source control metadata-service#30)
  • The new command to populate an aggregate MDS is kubectl exec $(gen3 pod metadata) -- python /src/src/mds/populate.py --config /aggregate_config.json --hostname esproxy-service --port 9200 (chore(configs): remove configs from source control metadata-service#30)
• portal
  • The pay model support depends on this PR: PXP-8779 HP-347 Feat/ecs hatchery#38 (PXP-8520 Feat/paymodels data-portal#900)
  • set "showExternalLoginsOnProfile": true for showing external logins on the profile page (Feat/profile fed auth data-portal#934)
  • Discovery: introduced a new config section discoveryConfig.features.search.tagSearchDropdown, see portal-config.md for more info (HP-555 Feat/disco tag dropdown viewer data-portal#927)
  • To enable this check, set features.exportToWorkspace.verifyExternalLogins flag to true in gitops (Check all WTS OIDCs are signed in before download/export to WS data-portal#921)
  • Misc: add option for bundle name: ecosystem, which is the same as heal bundle under the hood (Chore/discovery for more bundles data-portal#918)
• sower
  • PS: This is follow-up on this one: feat(dcf): dcf prod release 2.2.7 #24 ([PXP-8941] [PXP-8859] Feat/update go 1.17 sower#25)
• ssjdispatcher
  • PS: This is follow-up on this one: Kids First ETL Mapping #39 ([PXP-8943] [PXP-8859] Feat/update go 1.17 ssjdispatcher#40)