Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[INTERPRETER] Fix tl.dot tests #3571

Merged
merged 3 commits into from
Apr 5, 2024

Conversation

tongyuantongyu
Copy link
Contributor

Fix some issues in interpreter unittest:

  • 3xTF32 precision listed in interpreter options as tf32x3 but is called 3xtf32 in other places.
  • numpy can't handle bf16 anf fp8-s, so skip these cases.

@tongyuantongyu tongyuantongyu requested a review from ptillet as a code owner April 4, 2024 17:40
@jlebar jlebar requested a review from Jokeren April 4, 2024 18:14
Copy link
Contributor

@Jokeren Jokeren left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this line is wrong (just for test_dot).

check_cuda_only(device)

It should be is_interpreter() or check_cuda_only(device).

@@ -2957,6 +2957,8 @@ def test_dot(M, N, K, num_warps, col_a, col_b, epilogue, input_precision, in_dty
pytest.skip("float8e4nv and float8e5 not supported on HIP")
if is_hip() and (input_precision != "ieee"):
pytest.skip(f"{input_precision} not supported on HIP")
if is_interpreter() and (in_dtype == 'bfloat16' or in_dtype == 'float8e4nv' or in_dtype == 'float8e5'):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can move this skip up to the point where we check check_cuda_only.

if is_interpreter():
   if precision checks
else:
  check_cuda_only

@tongyuantongyu tongyuantongyu requested a review from Jokeren April 5, 2024 01:50
@Jokeren Jokeren enabled auto-merge (squash) April 5, 2024 03:20
@Jokeren Jokeren merged commit 74b63f7 into triton-lang:main Apr 5, 2024
5 checks passed
@tongyuantongyu tongyuantongyu deleted the interpreter_dot_test_fix branch April 6, 2024 08:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants