[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"
-
Updated
Dec 19, 2024 - Python
#
rotary-position-embedding
Here are 3 public repositories matching this topic...
[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
-
Updated
Mar 12, 2024 - Python
Decoder-only LLM trained on the Harry Potter books.
transformer byte-pair-encoding rotary-position-embedding large-language-model flash-attention grouped-query-attention
-
Updated
Dec 20, 2024 - Python
Improve this page
Add a description, image, and links to the rotary-position-embedding topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the rotary-position-embedding topic, visit your repo's landing page and select "manage topics."