Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable Mi300 Roofline #285

Open
coleramos425 opened this issue Feb 28, 2024 · 8 comments
Open

Enable Mi300 Roofline #285

coleramos425 opened this issue Feb 28, 2024 · 8 comments
Assignees
Labels
Customer Req enhancement New feature or request Roofline Related to Omniperf's Roofline Analysis
Milestone

Comments

@coleramos425
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
Both national labs, internal customers, and others are asking for a Mi300 based roofline analysis. In v2.0 release this was temporarily disabled.

The microbenchmark has been adjusted with help from @rwvo . However, I still want to stress test the arithmetic intensity calculation and put the model through the wringer with some test applications.

Describe the solution you'd like

  1. Start by working with @nwolfey21 to check in on status. His expertise could help inform any adjustments required on arithmetic intensity
  2. Initial tests on the beta-version, iterate, and adjust
  3. Select test suite and verify results
@coleramos425 coleramos425 added enhancement New feature or request Roofline Related to Omniperf's Roofline Analysis Customer Req labels Feb 28, 2024
@coleramos425 coleramos425 added this to the v2.0.1 milestone Feb 28, 2024
@nwolfey21
Copy link

Happy to help. Let me know what you need.
I'm good at breaking things ;)

@skyreflectedinmirrors
Copy link
Contributor

Add me to this as well. @coleramos425 you want to set something up ?

@coleramos425
Copy link
Collaborator Author

I'll add you to the meeting @skyreflectedinmirrors

@lizamd
Copy link

lizamd commented Jun 4, 2024

hi @coleramos425 is mi300 roofline enabled in omniperf? get similar request, thanks!

@coleramos425
Copy link
Collaborator Author

@lizamd we're still developing roofline support. If you ping me on Teams I can provide more detail.

@lizamd
Copy link

lizamd commented Jun 4, 2024

cool, thanks for the quick response, will ping you!

@itej89
Copy link

itej89 commented Jul 15, 2024

Hi @coleramos425, I am also trying to use roofline for bench-marking llama.cpp. Any workarounds or temporary solutions to get it to work would be of great help. Thanks in advance!!

@coleramos425
Copy link
Collaborator Author

Update 8/16

Just received a beta version of microbenchmark from Rene. @cfallows-amd will be working to validate that work while myself and others work on adjustments to the arithmetic intensity calculation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Customer Req enhancement New feature or request Roofline Related to Omniperf's Roofline Analysis
Projects
None yet
Development

No branches or pull requests

7 participants