Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Profile and optimize host dispatch times #8865

Open
nemanjagrujic opened this issue May 27, 2024 · 0 comments
Open

Profile and optimize host dispatch times #8865

nemanjagrujic opened this issue May 27, 2024 · 0 comments
Assignees
@nemanjagrujic

Comments

@nemanjagrujic
Copy link
Contributor

nemanjagrujic commented May 27, 2024 •
edited
Loading

  • Develop python based infrastructure for profiling operation dispatch times
  • Add support for all ttnn ops
  • Identify ops with low dispatch times
  • Optimises low dispatch time ops
@nemanjagrujic nemanjagrujic self-assigned this May 27, 2024
nemanjagrujic added a commit that referenced this issue May 27, 2024
@nemanjagrujic
#8865: Add profling support for host overhead
c662ca0
nemanjagrujic added a commit that referenced this issue May 28, 2024
@nemanjagrujic
#8865: Add bcast to host overhead profiling
e416e25
nemanjagrujic added a commit that referenced this issue May 28, 2024
@nemanjagrujic
#8865: Add more ops for profiling
377d29c
nemanjagrujic added a commit that referenced this issue May 28, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
9920db8
nemanjagrujic added a commit that referenced this issue May 30, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
5ad1550
nemanjagrujic added a commit that referenced this issue May 31, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
e6766ad
nemanjagrujic added a commit that referenced this issue May 31, 2024
@nemanjagrujic
#8865: Add profling support for host overhead
08016b2
nemanjagrujic added a commit that referenced this issue May 31, 2024
@nemanjagrujic
#8865: Add bcast to host overhead profiling
3b02007
nemanjagrujic added a commit that referenced this issue May 31, 2024
@nemanjagrujic
#8865: Add more ops for profiling
4f44d0c
nemanjagrujic added a commit that referenced this issue May 31, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
69b4863
nemanjagrujic added a commit that referenced this issue May 31, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
4ed33ae
nemanjagrujic added a commit that referenced this issue May 31, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
17f808f
nemanjagrujic added a commit that referenced this issue Jun 3, 2024
@nemanjagrujic
#8865: Add profling support for host overhead
533f12a
nemanjagrujic added a commit that referenced this issue Jun 3, 2024
@nemanjagrujic
#8865: Add bcast to host overhead profiling
3b1f591
nemanjagrujic added a commit that referenced this issue Jun 3, 2024
@nemanjagrujic
#8865: Add more ops for profiling
50c94d0
nemanjagrujic added a commit that referenced this issue Jun 3, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
fa592fd
nemanjagrujic added a commit that referenced this issue Jun 3, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
a09b842
nemanjagrujic added a commit that referenced this issue Jun 3, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
352e595
nemanjagrujic added a commit that referenced this issue Jun 3, 2024
@nemanjagrujic
#8865: Add tracy output to host profiling
eef7d83
nemanjagrujic added a commit that referenced this issue Jun 4, 2024
@nemanjagrujic
#8865: Add subprocesses for each op for host profiling with tracy
211a27c
nemanjagrujic added a commit that referenced this issue Jun 4, 2024
@nemanjagrujic
#8865: Use name_append with tracy in host side op profiling
2518c95
nemanjagrujic added a commit that referenced this issue Jun 6, 2024
@nemanjagrujic
#8865: Use DumpDeviceProfiler in host side op profiling
7a70b41
nemanjagrujic added a commit that referenced this issue Jun 7, 2024
@nemanjagrujic
#8865: Fix crash in host profiling infra
3d1aaeb
nemanjagrujic added a commit that referenced this issue Jun 10, 2024
@nemanjagrujic
#8865: Add profling support for host overhead
0f45035
nemanjagrujic added a commit that referenced this issue Jun 10, 2024
@nemanjagrujic
#8865: Add bcast to host overhead profiling
91f45c8
nemanjagrujic added a commit that referenced this issue Jun 10, 2024
@nemanjagrujic
#8865: Add more ops for profiling
0e17570
nemanjagrujic added a commit that referenced this issue Jun 10, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
6c98fbe
nemanjagrujic added a commit that referenced this issue Jun 10, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
b8d720e
nemanjagrujic added a commit that referenced this issue Jun 10, 2024
@nemanjagrujic
#8865: Add more ops for host side profiling
20c9816
nemanjagrujic added a commit that referenced this issue Sep 24, 2024
@nemanjagrujic
#8865: Add sharded tensor support to dispatch profile infra
ff0f6f6
nemanjagrujic added a commit that referenced this issue Sep 24, 2024
@nemanjagrujic
#8865: Updated dispatch reference times
f2cf901
nemanjagrujic added a commit that referenced this issue Sep 24, 2024
@nemanjagrujic
#8865: Fix dispatch prifling reference times
a80be51
nemanjagrujic added a commit that referenced this issue Sep 24, 2024
@nemanjagrujic
#8865: Add dispatch time measurement for bcast h shardedkernels
448e90f
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Add sharded tensor support to dispatch profile infra
aecbc4d
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Updated dispatch reference times
c950fbb
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Fix dispatch prifling reference times
9df829d
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Add dispatch time measurement for bcast h shardedkernels
c7b8b5e
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Add bcast sweep test
d66682f
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Add sharded tensor support to dispatch profile infra
6ef8a0e
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Updated dispatch reference times
45075c4
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Fix dispatch prifling reference times
f8bc280
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Add dispatch time measurement for bcast h shardedkernels
cfe414d
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Add bcast sweep test
ffaf8ca
nemanjagrujic added a commit that referenced this issue Sep 25, 2024
@nemanjagrujic
#8865: Add bcast sweep test
6562d50
nemanjagrujic added a commit that referenced this issue Sep 26, 2024
@nemanjagrujic
#8865: Add sharded tensor support to dispatch profile infra
a850835
nemanjagrujic added a commit that referenced this issue Sep 26, 2024
@nemanjagrujic
#8865: Updated dispatch reference times
083b8d6
nemanjagrujic added a commit that referenced this issue Sep 26, 2024
@nemanjagrujic
#8865: Fix dispatch prifling reference times
77ec367
nemanjagrujic added a commit that referenced this issue Sep 26, 2024
@nemanjagrujic
#8865: Add dispatch time measurement for bcast h shardedkernels
463cd45
nemanjagrujic added a commit that referenced this issue Sep 26, 2024
@nemanjagrujic
#8865: Add bcast sweep test
c0aec97
nemanjagrujic added a commit that referenced this issue Sep 26, 2024
@nemanjagrujic
#8865: Add bcast sweep test
3dce9e0
nemanjagrujic added a commit that referenced this issue Sep 26, 2024
@nemanjagrujic
#8865: Remove bcast h sharded sweep tests which dont wokr
865e4af
nemanjagrujic added a commit that referenced this issue Sep 27, 2024
@nemanjagrujic
#8865: Add sharded tensor support to dispatch profile infra
6b53440
nemanjagrujic added a commit that referenced this issue Sep 27, 2024
@nemanjagrujic
#8865: Updated dispatch reference times
198f206
nemanjagrujic added a commit that referenced this issue Sep 27, 2024
@nemanjagrujic
#8865: Fix dispatch prifling reference times
403754a
nemanjagrujic added a commit that referenced this issue Sep 27, 2024
@nemanjagrujic
#8865: Add dispatch time measurement for bcast h shardedkernels
2625e74
nemanjagrujic added a commit that referenced this issue Sep 27, 2024
@nemanjagrujic
#8865: Add bcast sweep test
1d3bcca
nemanjagrujic added a commit that referenced this issue Sep 27, 2024
@nemanjagrujic
#8865: Add bcast sweep test
b9705b7
nemanjagrujic added a commit that referenced this issue Sep 27, 2024
@nemanjagrujic
#8865: Remove bcast h sharded sweep tests which dont wokr
6fcb109
nemanjagrujic added a commit that referenced this issue Sep 27, 2024
@nemanjagrujic
#8865: Add sharded tensor support to dispatch profile infra (#12871)
be9b991 
* #8865: Add sharded tensor support to dispatch profile infra
* #8865: Updated dispatch reference times
* #8865: Add bcast sweep test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nemanjagrujic nemanjagrujic

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@nemanjagrujic