Reduce qa.planx-pla.net footprint

[haraprasadj]

Link to Jira ticket if there is one:

Environments

Description of changes

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• thor

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• thor

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• thor

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• thor

Deployment changes

• fence
  • Requires a Fence DB migration (PXP-10541 Client credentials rotation fence#1068)
  • Configure the ALLOWED_DATA_UPLOAD_BUCKETS setting to allow users to upload to buckets other than DATA_UPLOAD_BUCKET (PXP-10361 Allow specifying the upload bucket fence#1051)
  • B/c the default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP, you MUST ensure that an instance that should comply with FedRAMP does NOT override this fence configuration (e.g. it should be 15 minutes) SESSION_TIMEOUT: 900 (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • New portal config options to exclude File nodes from the charts added: use "graphql.chartNodesExcludeFiles" to exclude File nodes from graphql chart, or use "components.index.homepageChartNodesExcludeFiles" to exclude File nodes from homepage chart. Note both of them are default to false so you have to explicitly set them to true to enable them (PXP-10565/PPS-177 fix: exclude file nodes from chart with options data-portal#1208)
  • this change assumes WTS is already a core/central service. The dependency is hereby moved to the homepage (instead of the ./workspace page) (Centralize WTS refresh token initialization data-portal#1095)
  • Use "discoveryUseAggWTS" in "featureFlags" to enable "True Access" for aggregate discovery (Feat/agg mds true access brh changes data-portal#1089)
  • "True Access" for aggregate discovery depends on WTS 0.4.0+ (Feat/agg mds true access brh changes data-portal#1089)
• sheepdog
  • Sheepdog does not rely on configuration files in the cloud-automation repository anymore. The Sheepdog configuration files are in the Sheepdog repository. (PXP-6245 PXP-9633 Poetry + Python 3.9 sheepdog#387)

Breaking changes

• arborist
  • The GET /auth/mapping endpoint does not accept username as a query parameter anymore. It only supports parsing the username from the provided JWT. To specify a username, use the POST /auth/mapping endpoint. (PXP-10229 Client auth mapping arborist#153)
• fence
  • Default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • Replaced loading the data in iframes in Workspace page with Redirect component. (Add Workspace Registration to Data-Portal data-portal#1067)
  • Deprecating the use of default-workspaces i. e an individual commons will no longer be able to deploy standalone jupyterhub images, they may use hatchery service instead. (Add Workspace Registration to Data-Portal data-portal#1067)
  • studyRegistrationConfig in gitops.json must now be placed within the regsitrationConfigs.features block [Refer this PR] (Add Workspace Registration to Data-Portal data-portal#1067)
  • Discovery component will now require a supportedValues section in its discoveryConfig.features.authorization config (e.g. test WTS and data portal changes cdis-manifest#5138, see testing in qa-heal https://ctds-planx.atlassian.net/browse/BRH-254) (Feat/agg mds true access brh changes data-portal#1089)
  • Discovery component will now require a studies section in its discoveryConfig config, by default it can be a empty list [], fro example: "studies: []" (Feat/agg mds true access brh changes data-portal#1089)

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• thor

Deployment changes

• fence
  • Requires a Fence DB migration (PXP-10541 Client credentials rotation fence#1068)
  • Configure the ALLOWED_DATA_UPLOAD_BUCKETS setting to allow users to upload to buckets other than DATA_UPLOAD_BUCKET (PXP-10361 Allow specifying the upload bucket fence#1051)
  • B/c the default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP, you MUST ensure that an instance that should comply with FedRAMP does NOT override this fence configuration (e.g. it should be 15 minutes) SESSION_TIMEOUT: 900 (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • New portal config options to exclude File nodes from the charts added: use "graphql.chartNodesExcludeFiles" to exclude File nodes from graphql chart, or use "components.index.homepageChartNodesExcludeFiles" to exclude File nodes from homepage chart. Note both of them are default to false so you have to explicitly set them to true to enable them (PXP-10565/PPS-177 fix: exclude file nodes from chart with options data-portal#1208)
  • this change assumes WTS is already a core/central service. The dependency is hereby moved to the homepage (instead of the ./workspace page) (Centralize WTS refresh token initialization data-portal#1095)
  • Use "discoveryUseAggWTS" in "featureFlags" to enable "True Access" for aggregate discovery (Feat/agg mds true access brh changes data-portal#1089)
  • "True Access" for aggregate discovery depends on WTS 0.4.0+ (Feat/agg mds true access brh changes data-portal#1089)

Breaking changes

• arborist
  • The GET /auth/mapping endpoint does not accept username as a query parameter anymore. It only supports parsing the username from the provided JWT. To specify a username, use the POST /auth/mapping endpoint. (PXP-10229 Client auth mapping arborist#153)
• fence
  • Default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • Replaced loading the data in iframes in Workspace page with Redirect component. (Add Workspace Registration to Data-Portal data-portal#1067)
  • Deprecating the use of default-workspaces i. e an individual commons will no longer be able to deploy standalone jupyterhub images, they may use hatchery service instead. (Add Workspace Registration to Data-Portal data-portal#1067)
  • studyRegistrationConfig in gitops.json must now be placed within the regsitrationConfigs.features block [Refer this PR] (Add Workspace Registration to Data-Portal data-portal#1067)
  • Discovery component will now require a supportedValues section in its discoveryConfig.features.authorization config (e.g. test WTS and data portal changes cdis-manifest#5138, see testing in qa-heal https://ctds-planx.atlassian.net/browse/BRH-254) (Feat/agg mds true access brh changes data-portal#1089)
  • Discovery component will now require a studies section in its discoveryConfig config, by default it can be a empty list [], fro example: "studies: []" (Feat/agg mds true access brh changes data-portal#1089)

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• thor

Deployment changes

• fence
  • Requires a Fence DB migration (PXP-10541 Client credentials rotation fence#1068)
  • Configure the ALLOWED_DATA_UPLOAD_BUCKETS setting to allow users to upload to buckets other than DATA_UPLOAD_BUCKET (PXP-10361 Allow specifying the upload bucket fence#1051)
  • B/c the default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP, you MUST ensure that an instance that should comply with FedRAMP does NOT override this fence configuration (e.g. it should be 15 minutes) SESSION_TIMEOUT: 900 (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • New portal config options to exclude File nodes from the charts added: use "graphql.chartNodesExcludeFiles" to exclude File nodes from graphql chart, or use "components.index.homepageChartNodesExcludeFiles" to exclude File nodes from homepage chart. Note both of them are default to false so you have to explicitly set them to true to enable them (PXP-10565/PPS-177 fix: exclude file nodes from chart with options data-portal#1208)
  • this change assumes WTS is already a core/central service. The dependency is hereby moved to the homepage (instead of the ./workspace page) (Centralize WTS refresh token initialization data-portal#1095)
  • Use "discoveryUseAggWTS" in "featureFlags" to enable "True Access" for aggregate discovery (Feat/agg mds true access brh changes data-portal#1089)
  • "True Access" for aggregate discovery depends on WTS 0.4.0+ (Feat/agg mds true access brh changes data-portal#1089)

Breaking changes

• arborist
  • The GET /auth/mapping endpoint does not accept username as a query parameter anymore. It only supports parsing the username from the provided JWT. To specify a username, use the POST /auth/mapping endpoint. (PXP-10229 Client auth mapping arborist#153)
• fence
  • Default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • Replaced loading the data in iframes in Workspace page with Redirect component. (Add Workspace Registration to Data-Portal data-portal#1067)
  • Deprecating the use of default-workspaces i. e an individual commons will no longer be able to deploy standalone jupyterhub images, they may use hatchery service instead. (Add Workspace Registration to Data-Portal data-portal#1067)
  • studyRegistrationConfig in gitops.json must now be placed within the regsitrationConfigs.features block [Refer this PR] (Add Workspace Registration to Data-Portal data-portal#1067)
  • Discovery component will now require a supportedValues section in its discoveryConfig.features.authorization config (e.g. test WTS and data portal changes cdis-manifest#5138, see testing in qa-heal https://ctds-planx.atlassian.net/browse/BRH-254) (Feat/agg mds true access brh changes data-portal#1089)
  • Discovery component will now require a studies section in its discoveryConfig config, by default it can be a empty list [], fro example: "studies: []" (Feat/agg mds true access brh changes data-portal#1089)

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• thor

Deployment changes

• fence
  • Requires a Fence DB migration (PXP-10541 Client credentials rotation fence#1068)
  • Configure the ALLOWED_DATA_UPLOAD_BUCKETS setting to allow users to upload to buckets other than DATA_UPLOAD_BUCKET (PXP-10361 Allow specifying the upload bucket fence#1051)
  • B/c the default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP, you MUST ensure that an instance that should comply with FedRAMP does NOT override this fence configuration (e.g. it should be 15 minutes) SESSION_TIMEOUT: 900 (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • New portal config options to exclude File nodes from the charts added: use "graphql.chartNodesExcludeFiles" to exclude File nodes from graphql chart, or use "components.index.homepageChartNodesExcludeFiles" to exclude File nodes from homepage chart. Note both of them are default to false so you have to explicitly set them to true to enable them (PXP-10565/PPS-177 fix: exclude file nodes from chart with options data-portal#1208)
  • this change assumes WTS is already a core/central service. The dependency is hereby moved to the homepage (instead of the ./workspace page) (Centralize WTS refresh token initialization data-portal#1095)
  • Use "discoveryUseAggWTS" in "featureFlags" to enable "True Access" for aggregate discovery (Feat/agg mds true access brh changes data-portal#1089)
  • "True Access" for aggregate discovery depends on WTS 0.4.0+ (Feat/agg mds true access brh changes data-portal#1089)

Breaking changes

• arborist
  • The GET /auth/mapping endpoint does not accept username as a query parameter anymore. It only supports parsing the username from the provided JWT. To specify a username, use the POST /auth/mapping endpoint. (PXP-10229 Client auth mapping arborist#153)
• fence
  • Default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • Replaced loading the data in iframes in Workspace page with Redirect component. (Add Workspace Registration to Data-Portal data-portal#1067)
  • Deprecating the use of default-workspaces i. e an individual commons will no longer be able to deploy standalone jupyterhub images, they may use hatchery service instead. (Add Workspace Registration to Data-Portal data-portal#1067)
  • studyRegistrationConfig in gitops.json must now be placed within the regsitrationConfigs.features block [Refer this PR] (Add Workspace Registration to Data-Portal data-portal#1067)
  • Discovery component will now require a supportedValues section in its discoveryConfig.features.authorization config (e.g. test WTS and data portal changes cdis-manifest#5138, see testing in qa-heal https://ctds-planx.atlassian.net/browse/BRH-254) (Feat/agg mds true access brh changes data-portal#1089)
  • Discovery component will now require a studies section in its discoveryConfig config, by default it can be a empty list [], fro example: "studies: []" (Feat/agg mds true access brh changes data-portal#1089)

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• qabot
• thor

Deployment changes

• fence
  • Requires a Fence DB migration (PXP-10541 Client credentials rotation fence#1068)
  • Configure the ALLOWED_DATA_UPLOAD_BUCKETS setting to allow users to upload to buckets other than DATA_UPLOAD_BUCKET (PXP-10361 Allow specifying the upload bucket fence#1051)
  • B/c the default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP, you MUST ensure that an instance that should comply with FedRAMP does NOT override this fence configuration (e.g. it should be 15 minutes) SESSION_TIMEOUT: 900 (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• peregrine
  • Peregrine does not rely on configuration files in the cloud-automation repository anymore. The Peregrine configuration files are in the Peregrine repository. (PXP-10163 Python 3.9 peregrine#191)
• portal
  • New portal config options to exclude File nodes from the charts added: use "graphql.chartNodesExcludeFiles" to exclude File nodes from graphql chart, or use "components.index.homepageChartNodesExcludeFiles" to exclude File nodes from homepage chart. Note both of them are default to false so you have to explicitly set them to true to enable them (PXP-10565/PPS-177 fix: exclude file nodes from chart with options data-portal#1208)
  • this change assumes WTS is already a core/central service. The dependency is hereby moved to the homepage (instead of the ./workspace page) (Centralize WTS refresh token initialization data-portal#1095)
  • Use "discoveryUseAggWTS" in "featureFlags" to enable "True Access" for aggregate discovery (Feat/agg mds true access brh changes data-portal#1089)
  • "True Access" for aggregate discovery depends on WTS 0.4.0+ (Feat/agg mds true access brh changes data-portal#1089)
• sheepdog
  • Sheepdog does not rely on configuration files in the cloud-automation repository anymore. The Sheepdog configuration files are in the Sheepdog repository. (PXP-6245 PXP-9633 Poetry + Python 3.9 sheepdog#387)

Breaking changes

• arborist
  • The GET /auth/mapping endpoint does not accept username as a query parameter anymore. It only supports parsing the username from the provided JWT. To specify a username, use the POST /auth/mapping endpoint. (PXP-10229 Client auth mapping arborist#153)
• fence
  • Default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • Replaced loading the data in iframes in Workspace page with Redirect component. (Add Workspace Registration to Data-Portal data-portal#1067)
  • Deprecating the use of default-workspaces i. e an individual commons will no longer be able to deploy standalone jupyterhub images, they may use hatchery service instead. (Add Workspace Registration to Data-Portal data-portal#1067)
  • studyRegistrationConfig in gitops.json must now be placed within the regsitrationConfigs.features block [Refer this PR] (Add Workspace Registration to Data-Portal data-portal#1067)
  • Discovery component will now require a supportedValues section in its discoveryConfig.features.authorization config (e.g. test WTS and data portal changes cdis-manifest#5138, see testing in qa-heal https://ctds-planx.atlassian.net/browse/BRH-254) (Feat/agg mds true access brh changes data-portal#1089)
  • Discovery component will now require a studies section in its discoveryConfig config, by default it can be a empty list [], fro example: "studies: []" (Feat/agg mds true access brh changes data-portal#1089)

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• qabot
• thor

Deployment changes

• fence
  • Requires a Fence DB migration (PXP-10541 Client credentials rotation fence#1068)
  • Configure the ALLOWED_DATA_UPLOAD_BUCKETS setting to allow users to upload to buckets other than DATA_UPLOAD_BUCKET (PXP-10361 Allow specifying the upload bucket fence#1051)
  • B/c the default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP, you MUST ensure that an instance that should comply with FedRAMP does NOT override this fence configuration (e.g. it should be 15 minutes) SESSION_TIMEOUT: 900 (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• peregrine
  • Peregrine does not rely on configuration files in the cloud-automation repository anymore. The Peregrine configuration files are in the Peregrine repository. (PXP-10163 Python 3.9 peregrine#191)
• portal
  • New portal config options to exclude File nodes from the charts added: use "graphql.chartNodesExcludeFiles" to exclude File nodes from graphql chart, or use "components.index.homepageChartNodesExcludeFiles" to exclude File nodes from homepage chart. Note both of them are default to false so you have to explicitly set them to true to enable them (PXP-10565/PPS-177 fix: exclude file nodes from chart with options data-portal#1208)
  • this change assumes WTS is already a core/central service. The dependency is hereby moved to the homepage (instead of the ./workspace page) (Centralize WTS refresh token initialization data-portal#1095)
  • Use "discoveryUseAggWTS" in "featureFlags" to enable "True Access" for aggregate discovery (Feat/agg mds true access brh changes data-portal#1089)
  • "True Access" for aggregate discovery depends on WTS 0.4.0+ (Feat/agg mds true access brh changes data-portal#1089)
• sheepdog
  • Sheepdog does not rely on configuration files in the cloud-automation repository anymore. The Sheepdog configuration files are in the Sheepdog repository. (PXP-6245 PXP-9633 Poetry + Python 3.9 sheepdog#387)

Breaking changes

• arborist
  • The GET /auth/mapping endpoint does not accept username as a query parameter anymore. It only supports parsing the username from the provided JWT. To specify a username, use the POST /auth/mapping endpoint. (PXP-10229 Client auth mapping arborist#153)
• fence
  • Default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • Replaced loading the data in iframes in Workspace page with Redirect component. (Add Workspace Registration to Data-Portal data-portal#1067)
  • Deprecating the use of default-workspaces i. e an individual commons will no longer be able to deploy standalone jupyterhub images, they may use hatchery service instead. (Add Workspace Registration to Data-Portal data-portal#1067)
  • studyRegistrationConfig in gitops.json must now be placed within the regsitrationConfigs.features block [Refer this PR] (Add Workspace Registration to Data-Portal data-portal#1067)
  • Discovery component will now require a supportedValues section in its discoveryConfig.features.authorization config (e.g. test WTS and data portal changes cdis-manifest#5138, see testing in qa-heal https://ctds-planx.atlassian.net/browse/BRH-254) (Feat/agg mds true access brh changes data-portal#1089)
  • Discovery component will now require a studies section in its discoveryConfig config, by default it can be a empty list [], fro example: "studies: []" (Feat/agg mds true access brh changes data-portal#1089)

[PlanXCyborg]

qa.planx-pla.net/manifest.json

⚠️ Services on branch

• jenkins
• jenkins-worker
• jenkins-ci-worker
• qabot
• thor

Deployment changes

• fence
  • Requires a Fence DB migration (PXP-10541 Client credentials rotation fence#1068)
  • Configure the ALLOWED_DATA_UPLOAD_BUCKETS setting to allow users to upload to buckets other than DATA_UPLOAD_BUCKET (PXP-10361 Allow specifying the upload bucket fence#1051)
  • B/c the default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP, you MUST ensure that an instance that should comply with FedRAMP does NOT override this fence configuration (e.g. it should be 15 minutes) SESSION_TIMEOUT: 900 (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• peregrine
  • Peregrine does not rely on configuration files in the cloud-automation repository anymore. The Peregrine configuration files are in the Peregrine repository. (PXP-10163 Python 3.9 peregrine#191)
• portal
  • New portal config options to exclude File nodes from the charts added: use "graphql.chartNodesExcludeFiles" to exclude File nodes from graphql chart, or use "components.index.homepageChartNodesExcludeFiles" to exclude File nodes from homepage chart. Note both of them are default to false so you have to explicitly set them to true to enable them (PXP-10565/PPS-177 fix: exclude file nodes from chart with options data-portal#1208)
  • this change assumes WTS is already a core/central service. The dependency is hereby moved to the homepage (instead of the ./workspace page) (Centralize WTS refresh token initialization data-portal#1095)
  • Use "discoveryUseAggWTS" in "featureFlags" to enable "True Access" for aggregate discovery (Feat/agg mds true access brh changes data-portal#1089)
  • "True Access" for aggregate discovery depends on WTS 0.4.0+ (Feat/agg mds true access brh changes data-portal#1089)
• sheepdog
  • Sheepdog does not rely on configuration files in the cloud-automation repository anymore. The Sheepdog configuration files are in the Sheepdog repository. (PXP-6245 PXP-9633 Poetry + Python 3.9 sheepdog#387)

Breaking changes

• arborist
  • The GET /auth/mapping endpoint does not accept username as a query parameter anymore. It only supports parsing the username from the provided JWT. To specify a username, use the POST /auth/mapping endpoint. (PXP-10229 Client auth mapping arborist#153)
• fence
  • Default session expiration changed from 30 minutes to 15 minutes to comply with FedRAMP (feat(session): change default to 15 minutes [PPS-122] fence#1040)
• portal
  • Replaced loading the data in iframes in Workspace page with Redirect component. (Add Workspace Registration to Data-Portal data-portal#1067)
  • Deprecating the use of default-workspaces i. e an individual commons will no longer be able to deploy standalone jupyterhub images, they may use hatchery service instead. (Add Workspace Registration to Data-Portal data-portal#1067)
  • studyRegistrationConfig in gitops.json must now be placed within the regsitrationConfigs.features block [Refer this PR] (Add Workspace Registration to Data-Portal data-portal#1067)
  • Discovery component will now require a supportedValues section in its discoveryConfig.features.authorization config (e.g. test WTS and data portal changes cdis-manifest#5138, see testing in qa-heal https://ctds-planx.atlassian.net/browse/BRH-254) (Feat/agg mds true access brh changes data-portal#1089)
  • Discovery component will now require a studies section in its discoveryConfig config, by default it can be a empty list [], fro example: "studies: []" (Feat/agg mds true access brh changes data-portal#1089)