Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix dtype casting in OFT module #14546

Merged
merged 1 commit into from
Jan 6, 2024
Merged

Fix dtype casting in OFT module #14546

merged 1 commit into from
Jan 6, 2024

Conversation

KohakuBlueleaf
Copy link
Collaborator

Description

  • Fix the dtype casting in OFT module to fit how we implement it in other module
  • This changes is needed for FP8 system since pytorch fp8 doesn't support any operation(expect scale_mm in H100 for now)

Checklist:

@AUTOMATIC1111 AUTOMATIC1111 merged commit 8b6848c into dev Jan 6, 2024
6 checks passed
@AUTOMATIC1111 AUTOMATIC1111 deleted the fix-oft-dtype branch January 6, 2024 07:50
@w-e-w w-e-w mentioned this pull request Feb 17, 2024
Closed
@pawel665j pawel665j mentioned this pull request Apr 16, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@AUTOMATIC1111 AUTOMATIC1111 AUTOMATIC1111 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@KohakuBlueleaf @AUTOMATIC1111