Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[skip ci] ViT TTNN Tech Report #12800

Merged
merged 23 commits into from
Sep 22, 2024
Merged

[skip ci] ViT TTNN Tech Report #12800

Show file tree
Hide file tree
Changes from 16 commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
27254c8
#0: Add ViT Tech Report
vshenoyTT Sep 13, 2024
85cf695
#0: Add ViT Tech Report
vshenoyTT Sep 13, 2024
752173f
#0: ViT Tech report
mbahnasTT Sep 14, 2024
758bdc5
#0: ViT Tech report
mbahnasTT Sep 14, 2024
fb8f62a
#0: ViT Tech report
mbahnasTT Sep 14, 2024
b45837a
#0: ViT Tech report
mbahnasTT Sep 14, 2024
a1b4bd8
#0: ViT Tech report
mbahnasTT Sep 14, 2024
9da9822
#0: ViT Tech report
mbahnasTT Sep 15, 2024
bfc3683
#0: ViT Tech report
mbahnasTT Sep 15, 2024
3f83763
#0: ViT Tech report
mbahnasTT Sep 15, 2024
83422b6
#0: ViT Tech report
mbahnasTT Sep 15, 2024
c3f3cc6
#0: ViT tech report
mbahnasTT Sep 18, 2024
77da226
#0: ViT tech report
mbahnasTT Sep 18, 2024
aa0e0a1
#0: ViT tech report
mbahnasTT Sep 18, 2024
666080c
#0: ViT tech report
mbahnasTT Sep 18, 2024
1a1971a
#0: ViT tech report
mbahnasTT Sep 18, 2024
51d9b39
#0: ViT tech report
mbahnasTT Sep 18, 2024
77c437d
#0: ViT tech report
mbahnasTT Sep 18, 2024
b5bc95a
#0: ViT tech report
mbahnasTT Sep 19, 2024
c37acc1
#0: edits
mbahnasTT Sep 22, 2024
68f40c7
#0: edits
mbahnasTT Sep 22, 2024
4d2e258
#0: edits
mbahnasTT Sep 22, 2024
22e9337
Merge branch 'main' into mbahnas/vit_tech_report
mbahnasTT Sep 22, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added tech_reports/ViT-TTNN/images/.DS_Store
View file
Open in desktop
Binary file not shown.
Binary file added tech_reports/ViT-TTNN/images/addnorm.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/attention.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/diagram.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/ffn.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/layernorm.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/laynormlinear.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/legend.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/mha_ttnn_1.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/mha_ttnn_2.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/qkvlinear.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/qkvsplit.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/selfoutput.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/sharding_concept.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/sharding_example.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added tech_reports/ViT-TTNN/images/value.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
676 changes: 676 additions & 0 deletions tech_reports/ViT-TTNN/vit.md
View file
Open in desktop

Large diffs are not rendered by default.

Loading