[Do not merge] Add offload in rocm CI. #7138

Job	Run time
macos (macOS-GCC14-NoMPI-Real)	14m 51s
spack-centos-stream (GCC11-NoMPI-Debug-Real)	19m 40s
spack-centos-stream (GCC11-NoMPI-NoOMP-Real)	18m 44s
linux (GCC9-NoMPI-Debug-Real)	16m 51s
spack-centos-stream (GCC11-NoMPI-NoOMP-Complex)	18m 53s
linux (GCC9-NoMPI-NoOMP-Real)	16m 19s
spack-centos-stream (GCC11-NoMPI-Sandbox-Real)	4m 28s
linux (GCC9-NoMPI-NoOMP-Complex)	17m 9s
linux (GCC9-MPI-Sandbox-Real)	3m 48s
linux (GCC9-NoMPI-Sandbox-Complex)	3m 52s
linux (GCC9-MPI-Gcov-Real)	27m 5s
linux (GCC9-MPI-Gcov-Complex)	27m 6s
linux (GCC12-NoMPI-Werror-Real)	19m 38s
linux (GCC12-NoMPI-Werror-Complex)	19m 14s
linux (GCC12-NoMPI-Werror-Real-Mixed)	19m 4s
linux (GCC12-NoMPI-Werror-Complex-Mixed)	18m 27s
linux (Clang14-NoMPI-ASan-Real)	24m 30s
linux (Clang14-NoMPI-ASan-Complex)	24m 3s
linux (Clang14-NoMPI-UBSan-Real)	23m 45s
linux (Clang16-NoMPI-Offload-Real)	22m 0s
linux (Clang16-NoMPI-Offload-Complex)	22m 9s
	6h 21m 36s

Provide feedback