PyTorch implementation of some attentions for Deep Learning Researchers.
pytorch attention multi-head-attention location-sensitive-attension dot-product-attention location-aware-attention additive-attention relative-positional-encoding relative-multi-head-attention
-
Updated
Mar 4, 2022 - Python