Tracking issue for improvements to install_KLU_Sundials.py and build infrastructure

[agriyakhetarpal]

Warning

Following an imminent migration for the build system and/or choice of build-backend for PyBaMM, not all of the listed points may not be applicable for completion. Please refer to #3564 for more information.

There are a number of improvements that can be introduced to improve the installation of the build-time dependencies (SuiteSparse and SUNDIALS) and the IDAKLU extension module and general improvements to the installation scripts:

• Incorporate the SHA-256 hashes of the SuiteSparse and SUNDIALS release tarballs as constants in the script in order to save bandwidth and skip downloading the tarball every time. (Replace wget with urllib for downloading and parallelize with concurrent.futures for efficiency #3719)
• Do not install locally if the binaries are already present at the installation location (Allow pybamm-requires to return early if an existing SUNDIALS installation is found #3418) (Replace wget with urllib for downloading and parallelize with concurrent.futures for efficiency #3719)
• Set parallel builds via the use of the CMAKE_BUILD_PARALLEL_LEVEL environment variable (Set CMAKE_BUILD_PARALLEL_LEVEL to speed up SUNDIALS and IDAKLU compilation #3646)
• Introduce PEP 723 support (needs triage and should be reviewed at a later time in 2024) (PEP 723 support for SuiteSparse and SUNDIALS installation script #3647) (Add PEP 723 support for SuiteSparse and SUNDIALS installation script #3716)
  (noted by @kratman: we install gcc in CI for macOS, but it is never used!)
• Remove wget as a dependency and use urllib from the Python standard library for downloading. In addition to this, use multiprocessing.Pool or concurrent.futures to download both tarballs in parallel to save time (Replace wget with urllib for downloading and parallelize with concurrent.futures for efficiency #3719)

These tasks have a mixture of easy and medium difficulty. Some of them have a higher priority than the rest, I am glad to take those up myself.

Tip

The rest of the tasks have been moved to #3564.

[agriyakhetarpal]

Closing this issue and moving individual remaining items over to #3564 – they can be tracked better there and that issue is now more relevant to the discussion.