🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
-
Updated
Dec 6, 2024 - Python
#
linear-layers
Here are 5 public repositories matching this topic...
This repository contains deep learning models on FashionMNIST(state-of-art dataset).
-
Updated
Nov 14, 2022 - Jupyter Notebook
MNIST Image reconstruction using Autoencoders
deep-learning image-reconstruction encoder decoder cnn mnist neural-networks convolutional-layers autoencoder convolutional-neural-networks upsampling mnist-handwriting-recognition transpose-convolution linear-layers
-
Updated
Sep 17, 2020 - Jupyter Notebook
Python from-scratch implementation of a Neural Network Classifier. Dive into the fundamentals of approximation, non-linearity, regularization, gradients, and backpropagation.
python deep-learning image-classification gradient-descent backpropagation multilayer-perceptron fashion-mnist relu-activation linear-layers dropout-layers deep-dives
-
Updated
Jul 25, 2024 - Jupyter Notebook
Annotated vanilla implementation in PyTorch of the Transformer model introduced in 'Attention Is All You Need'.
pytorch feedforward-neural-network softmax transfomer attention-is-all-you-need multihead-attention self-attention gelu dot-product-attention encoder-decoder-architecture positional-encoding linear-layers dropout-layers normalization-layers
-
Updated
Feb 19, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the linear-layers topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the linear-layers topic, visit your repo's landing page and select "manage topics."