Commits on Aug 30, 2022

1. Dockerize CI + Release builds …

   Gets both CI and Release builds integrated in one workflow.
   Mount ccache and pip cache as required for fast iterative builds
   Current Release docker builds still run with root perms, fix it
   in the future to run as the same user.
   
   There may be some corner cases left especially when switching
   build types etc.
   
   Docker build TEST plan:
   
   tl;dr:
   Build everythin: Releases (Python 3.8, 3.9, 3.10) and CIs.
     TM_PACKAGES="torch-mlir out-of-tree in-tree"
     2.57s user 2.49s system 0% cpu 30:33.11 total
   
   Out of Tree + PyTorch binaries:
   
     Fresh build (purged cache):
       TM_PACKAGES="out-of-tree"
       0.47s user 0.51s system 0% cpu 5:24.99 total
   
     Incremental with ccache:
       TM_PACKAGES="out-of-tree"
       0.09s user 0.08s system 0% cpu 34.817 total
   
   Out of Tree + PyTorch from source
   
     Incremental
       TM_PACKAGES="out-of-tree" TM_USE_PYTORCH_BINARY=OFF
       1.58s user 1.81s system 2% cpu 1:59.61 total
   
   In-Tree + PyTorch binaries:
   
     Fresh build and tests: (purge ccache)
     TM_PACKAGES="in-tree"
     0.53s user 0.49s system 0% cpu 6:23.35 total
   
     Fresh build/ but with prior ccache
     TM_PACKAGES="in-tree"
     0.45s user 0.66s system 0% cpu 3:57.47 total
   
     Incremental in-tree with all tests and regression tests
     TM_PACKAGES="in-tree"
     0.16s user 0.09s system 0% cpu 2:18.52 total
   
   In-Tree + PyTorch from source
   
     Fresh build and tests: (purge ccache)
     TM_PACKAGES="in-tree" TM_USE_PYTORCH_BINARY=OFF
     2.03s user 2.28s system 0% cpu 11:11.86 total
   
     Fresh build/ but with prior ccache
     TM_PACKAGES="in-tree" TM_USE_PYTORCH_BINARY=OFF
     1.58s user 1.88s system 1% cpu 4:53.15 total
   
     Incremental in-tree with all tests and regression tests
     TM_PACKAGES="in-tree" TM_USE_PYTORCH_BINARY=OFF
     1.09s user 1.10s system 1% cpu 3:29.84 total
   
     Incremental without tests
     TM_PACKAGES="in-tree" TM_USE_PYTORCH_BINARY=OFF TM_SKIP_TESTS=ON
     1.52s user 1.42s system 3% cpu 1:15.82 total
   
   In-tree+out-of-tree + Pytorch Binaries
     TM_PACKAGES="out-of-tree in-tree"
     0.25s user 0.18s system 0% cpu 3:01.91 total
   
   To clear all artifacts:
   rm -rf build build_oot llvm-build libtorch docker_venv
   externals/pytorch/build

   

   powderluv committed Aug 30, 2022
   Configuration menu

   • View commit details
   • Copy full SHA for b0570d7
   • Browse repository at this point

   Copy the full SHA

   b0570d7 View commit details

   Browse the repository at this point in the history