Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[inductor] Fix alignment issue with new runtime #1412

Merged
merged 1 commit into from
Sep 29, 2022

Conversation

jansel
Copy link
Contributor

@jansel jansel commented Sep 29, 2022

This fixes a minor issue in #1338 that only shows up in one internal model.

@soumith
Copy link
Member

soumith commented Sep 29, 2022

add a test?

@jansel
Copy link
Contributor Author

jansel commented Sep 29, 2022

add a test?

I was trying to make a more minimal repro for this but having a hard time. Passing the wrong alignment hints to Triton don't always produce invalid code.

@jansel jansel requested a review from ngimel September 29, 2022 19:40
if isinstance(arg, TensorArg)
or V.graph.sizevars.maybe_guard_multiple_of(arg.expr, JITFunction.divisibility)
]
divisible_by_16 = [i for i, arg in enumerate(args) if is_aligned(arg)]
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lol the place I worried about turned out to be problematic

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah it did :)

@jansel jansel merged commit fa0a9f3 into pytorch:main Sep 29, 2022
@jansel jansel deleted the alignment202209 branch September 29, 2022 20:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants