Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prune workflows based on changed files #4634

Merged
merged 24 commits into from
Oct 1, 2024
Merged
Changes from 2 commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
f225033
Prune workflows based on changed files
KyleFromNVIDIA Aug 27, 2024
af357f9
Ignore README and CONTRIBUTING
KyleFromNVIDIA Aug 27, 2024
ba4269a
Ignore mg_utils and readme_pages for cpp
KyleFromNVIDIA Aug 27, 2024
23b72fd
Try shared workflow
KyleFromNVIDIA Aug 30, 2024
619fda4
Re-run CI
KyleFromNVIDIA Aug 30, 2024
28c8eae
== "true"
KyleFromNVIDIA Aug 30, 2024
2e507be
Parentheses
KyleFromNVIDIA Aug 30, 2024
fb91dcc
Change notebook and force it to fail
KyleFromNVIDIA Aug 30, 2024
7bbec5d
Add TODO
KyleFromNVIDIA Aug 30, 2024
b06fb5d
Use default transform_expr
KyleFromNVIDIA Aug 30, 2024
66bbd96
Change naming convention
KyleFromNVIDIA Aug 31, 2024
428843f
Change output name
KyleFromNVIDIA Sep 16, 2024
9e16a04
Merge branch 'branch-24.10' into test-pruning
KyleFromNVIDIA Sep 16, 2024
694f602
Add note
KyleFromNVIDIA Sep 16, 2024
ca20308
Remove temporary failure
KyleFromNVIDIA Sep 16, 2024
0ced7c4
Merge branch 'branch-24.10' into test-pruning
KyleFromNVIDIA Sep 17, 2024
e2b561f
Use main branch
KyleFromNVIDIA Sep 17, 2024
cb335e1
Switch to branch-24.10
KyleFromNVIDIA Sep 17, 2024
f4a49ba
Merge branch 'branch-24.10' into test-pruning
KyleFromNVIDIA Sep 18, 2024
d0d970e
Re-run CI
KyleFromNVIDIA Sep 18, 2024
12df269
Merge branch 'branch-24.10' into test-pruning
KyleFromNVIDIA Sep 18, 2024
b1708fa
Merge branch 'branch-24.12' into test-pruning
KyleFromNVIDIA Sep 26, 2024
a70959a
Ignore .devcontainers changes
KyleFromNVIDIA Sep 26, 2024
a68da53
Merge branch 'branch-24.12' into test-pruning
KyleFromNVIDIA Sep 30, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
80 changes: 71 additions & 9 deletions .github/workflows/pr.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ concurrency:
jobs:
pr-builder:
needs:
- changed-files
- checks
- conda-cpp-build
- conda-cpp-tests
Expand All @@ -35,6 +36,58 @@ jobs:
- devcontainer
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/pr-builder.yaml@branch-24.10
if: always()
with:
needs: ${{ toJSON(needs) }}
changed-files:
runs-on: ubuntu-latest
name: "Check changed files"
outputs:
test_cpp: ${{ steps.changed-files.outputs.cpp_any_changed == 'true' }}
test_notebooks: ${{ steps.changed-files.outputs.notebooks_any_changed == 'true' }}
test_python: ${{ steps.changed-files.outputs.python_any_changed == 'true' }}
steps:
- name: Get PR info
id: get-pr-info
uses: rapidsai/shared-actions/get-pr-info@main
- name: Checkout code repo
uses: actions/checkout@v4
with:
ref: ${{ inputs.sha }}
fetch-depth: ${{ fromJSON(steps.get-pr-info.outputs.pr-info).commits }}
persist-credentials: false
- name: Get changed files
id: changed-files
uses: tj-actions/changed-files@v45
with:
base_sha: ${{ fromJSON(steps.get-pr-info.outputs.pr-info).base.sha }}
files_yaml: |
cpp:
- '**'
- '!CONTRIBUTING.md'
- '!README.md'
KyleFromNVIDIA marked this conversation as resolved.
Show resolved Hide resolved
- '!docs/**'
- '!img/**'
- '!notebooks/**'
- '!python/**'
# TODO: Remove this before merging
- '!.github/**'
notebooks:
- '**'
- '!CONTRIBUTING.md'
- '!README.md'
- '!docs/**'
# TODO: Remove this before merging
- '!.github/**'
python:
- '**'
- '!CONTRIBUTING.md'
- '!README.md'
- '!docs/**'
- '!img/**'
- '!notebooks/**'
# TODO: Remove this before merging
- '!.github/**'
checks:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/checks.yaml@branch-24.10
Expand All @@ -48,9 +101,10 @@ jobs:
build_type: pull-request
node_type: cpu32
conda-cpp-tests:
needs: conda-cpp-build
needs: [conda-cpp-build, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-tests.yaml@branch-24.10
if: needs.changed-files.outputs.test_cpp == 'true'
with:
build_type: pull-request
conda-cpp-checks:
Expand All @@ -68,15 +122,17 @@ jobs:
with:
build_type: pull-request
conda-python-tests:
needs: conda-python-build
needs: [conda-python-build, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-python-tests.yaml@branch-24.10
if: needs.changed-files.outputs.test_python == 'true'
with:
build_type: pull-request
conda-notebook-tests:
needs: conda-python-build
needs: [conda-python-build, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@branch-24.10
if: needs.changed-files.outputs.test_notebooks == 'true'
with:
build_type: pull-request
node_type: "gpu-v100-latest-1"
Expand Down Expand Up @@ -105,9 +161,10 @@ jobs:
extra-repo-deploy-key: CUGRAPH_OPS_SSH_PRIVATE_DEPLOY_KEY
node_type: cpu32
wheel-tests-pylibcugraph:
needs: wheel-build-pylibcugraph
needs: [wheel-build-pylibcugraph, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.10
if: needs.changed-files.outputs.test_python == 'true'
KyleFromNVIDIA marked this conversation as resolved.
Show resolved Hide resolved
with:
build_type: pull-request
script: ci/test_wheel_pylibcugraph.sh
Expand All @@ -122,9 +179,10 @@ jobs:
extra-repo-sha: branch-24.10
extra-repo-deploy-key: CUGRAPH_OPS_SSH_PRIVATE_DEPLOY_KEY
wheel-tests-cugraph:
needs: wheel-build-cugraph
needs: [wheel-build-cugraph, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.10
if: needs.changed-files.outputs.test_python == 'true'
with:
build_type: pull-request
script: ci/test_wheel_cugraph.sh
Expand All @@ -136,9 +194,10 @@ jobs:
build_type: pull-request
script: ci/build_wheel_nx-cugraph.sh
wheel-tests-nx-cugraph:
needs: wheel-build-nx-cugraph
needs: [wheel-build-nx-cugraph, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.10
if: needs.changed-files.outputs.test_python == 'true'
with:
build_type: pull-request
script: ci/test_wheel_nx-cugraph.sh
Expand All @@ -150,9 +209,10 @@ jobs:
build_type: pull-request
script: ci/build_wheel_cugraph-dgl.sh
wheel-tests-cugraph-dgl:
needs: wheel-build-cugraph-dgl
needs: [wheel-build-cugraph-dgl, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.10
if: needs.changed-files.outputs.test_python == 'true'
with:
build_type: pull-request
script: ci/test_wheel_cugraph-dgl.sh
Expand All @@ -165,9 +225,10 @@ jobs:
build_type: pull-request
script: ci/build_wheel_cugraph-pyg.sh
wheel-tests-cugraph-pyg:
needs: wheel-build-cugraph-pyg
needs: [wheel-build-cugraph-pyg, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.10
if: needs.changed-files.outputs.test_python == 'true'
with:
build_type: pull-request
script: ci/test_wheel_cugraph-pyg.sh
Expand All @@ -179,9 +240,10 @@ jobs:
build_type: pull-request
script: ci/build_wheel_cugraph-equivariant.sh
wheel-tests-cugraph-equivariant:
needs: wheel-build-cugraph-equivariant
needs: [wheel-build-cugraph-equivariant, changed-files]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.10
if: needs.changed-files.outputs.test_python == 'true'
with:
build_type: pull-request
script: ci/test_wheel_cugraph-equivariant.sh
Expand Down
Loading