Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

optimized attention #177

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

optimized attention #177

wants to merge 2 commits into from

Conversation

neonsecret
Copy link

adapted my optimized attention module for original fork

@AmericanPresidentJimmyCarter

The author has previously claimed this results in a massive reduction in memory usage. If it works, It would be great to get it merged.

basujindal#103

@Ouro17
Copy link

Ouro17 commented Sep 4, 2022

I suggest to have only the actual changes in the pr and not changes to the style of the code (spaces, tabs, etc), which makes the pr way harder to review.

@@ -1,9 +1,10 @@
from inspect import isfunction

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please don't include style changes such as import rearrangements or whitespace changes in a commit request

Copy link

@david-ford david-ford Sep 5, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI, you can make git fix some of that automagically. See -> https://github.com/lstein/stable-diffusion/blob/main/.gitattributes

Though, not sure how relevant in this case at second glance. >.>

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I rolled this back already

@neonsecret
Copy link
Author

okay I will change it back

Birch-san added a commit to Birch-san/stable-diffusion that referenced this pull request Sep 11, 2022
I didn't implement the most consequential part (splitting the softmax in two) because M1 Mac is not so VRAM-constrained.
but I implemented the reference-freeing, and also freed x earlier.
Birch-san added a commit to Birch-san/stable-diffusion that referenced this pull request Sep 11, 2022
JustinGuese pushed a commit to JustinGuese/stable-diffusion-original that referenced this pull request Sep 14, 2022
Bugfixes to image generation logic
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants