You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I recommend running a benchmark on your machine with the following number of tokens: 1024, 2048, 3072, 4096, 5120 and comparing these to the A100 numbers we report.
Hi,
I am curious to learn the inference speed of AF3 when deployed on H100 GPUs. Could this be released? Thank you!
The text was updated successfully, but these errors were encountered: