#

sparse-attn

Here is 1 public repository matching this topic...

kyegomez / SparseAttention

Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"

machine-learning artificial-intelligence sparse-matrix attention-mechanism attention-is-all-you-need attention-mechanisms sparse-attn

Updated Nov 11, 2024
Python

Improve this page

Add a description, image, and links to the sparse-attn topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sparse-attn topic, visit your repo's landing page and select "manage topics."