Skip to content
Back to pull request #6508

metal : add BS=1 kernel for flash attention #10386

Sign in to view logs

metal : add BS=1 kernel for flash attention

metal : add BS=1 kernel for flash attention #10386

Triggered via pull request April 5, 2024 15:02
@ggerganovggerganov
opened #6508
gg/flash-attn-vec
Status Failure
Total duration 32m 49s
Artifacts –

build.yml

on: pull_request
Matrix: windows-latest-cmake-cuda
Matrix: windows-latest-cmake
macOS-latest-cmake-arm64
3m 23s
macOS-latest-cmake-arm64
macOS-latest-cmake-x64
6m 23s
macOS-latest-cmake-x64
ubuntu-focal-make
2m 8s
ubuntu-focal-make
ubuntu-latest-cmake
2m 55s
ubuntu-latest-cmake
macOS-latest-make
3m 17s
macOS-latest-make
macOS-latest-cmake
4m 5s
macOS-latest-cmake
ubuntu-focal-make-curl
1m 18s
ubuntu-focal-make-curl
ubuntu-22-cmake-vulkan
1m 59s
ubuntu-22-cmake-vulkan
ubuntu-22-cmake-sycl
5m 51s
ubuntu-22-cmake-sycl
ubuntu-22-cmake-sycl-fp16
6m 4s
ubuntu-22-cmake-sycl-fp16
macOS-latest-cmake-ios
1m 29s
macOS-latest-cmake-ios
macOS-latest-cmake-tvos
1m 32s
macOS-latest-cmake-tvos
windows-latest-cmake-sycl
15m 20s
windows-latest-cmake-sycl
ios-xcode-build
1m 0s
ios-xcode-build
android-build
5m 39s
android-build
Matrix: macOS-latest-swift
Matrix: ubuntu-latest-cmake-mpi
release
0s
release
Fit to window
Zoom out
Zoom in

Annotations

19 errors and 6 warnings
windows-latest-cmake (arm64, -A ARM64 -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DBUILD_SHARED_L...
Process completed with exit code 1.
windows-latest-cmake (openblas, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_BLAS=ON -DBUIL...
The job was canceled because "arm64_-A_ARM64_-DLLAMA_NA" failed.
windows-latest-cmake (vulkan, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_VULKAN=ON -DBUIL...
The job was canceled because "arm64_-A_ARM64_-DLLAMA_NA" failed.
windows-latest-cmake (kompute, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_KOMPUTE=ON -DKO...
The job was canceled because "arm64_-A_ARM64_-DLLAMA_NA" failed.
windows-latest-cmake (kompute, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_KOMPUTE=ON -DKO...
The operation was canceled.
windows-latest-cmake (avx512, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX512=ON -DBUIL...
The job was canceled because "arm64_-A_ARM64_-DLLAMA_NA" failed.
windows-latest-cmake (avx512, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX512=ON -DBUIL...
The operation was canceled.
windows-latest-cmake (avx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX2=OFF -DBUILD_SH...
The job was canceled because "arm64_-A_ARM64_-DLLAMA_NA" failed.
windows-latest-cmake (avx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX2=OFF -DBUILD_SH...
The operation was canceled.
windows-latest-cmake (clblast, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_CLBLAST=ON -DBU...
The job was canceled because "arm64_-A_ARM64_-DLLAMA_NA" failed.
windows-latest-cmake (clblast, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_CLBLAST=ON -DBU...
The operation was canceled.
windows-latest-cmake (avx2, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DBUILD_SHARED_LIBS=ON)
The job was canceled because "arm64_-A_ARM64_-DLLAMA_NA" failed.
windows-latest-cmake (avx2, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DBUILD_SHARED_LIBS=ON)
The operation was canceled.
windows-latest-cmake (noavx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX=OFF -DLLAMA_A...
The job was canceled because "arm64_-A_ARM64_-DLLAMA_NA" failed.
windows-latest-cmake (noavx, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX=OFF -DLLAMA_A...
The operation was canceled.
macOS-latest-cmake-x64
Process completed with exit code 8.
windows-latest-cmake-cuda (11.7.1, cuda)
Process completed with exit code 1.
windows-latest-cmake-cuda (12.2.0, cuda)
The job was canceled because "_11_7_1_cuda" failed.
windows-latest-cmake-cuda (12.2.0, cuda)
The operation was canceled.
ubuntu-22-cmake-sycl
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
ubuntu-22-cmake-sycl
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
ubuntu-22-cmake-sycl-fp16
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
ubuntu-22-cmake-sycl-fp16
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
android-build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
windows-latest-cmake-cuda (11.7.1, cuda)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Jimver/cuda-toolkit@v0.2.11. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.