Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bug]: model manager doesn't download 16-bit weights #4127

Closed
1 task done
keturn opened this issue Aug 1, 2023 · 1 comment · Fixed by #4129
Closed
1 task done

[bug]: model manager doesn't download 16-bit weights #4127

keturn opened this issue Aug 1, 2023 · 1 comment · Fixed by #4129
Assignees
Labels
bug Something isn't working model manager

Comments

@keturn
Copy link
Contributor

keturn commented Aug 1, 2023

Is there an existing issue for this?

  • I have searched the existing issues

OS

Linux

GPU

cuda

VRAM

12GB

What version did you experience this issue on?

eb64265

What happened?

invokeai-configure downloaded only 32-bit safetensors, not 16-bit ones, even though the huggingface repo has .fp16.safetensors file available and I have precision set to auto. (I don't think setting the precision explicitly to float16 helped either.)

Reproduction plan:

  • run invokeai-configure
  • let it install stable-diffusion-v1-5
  • look in models/sd-1/main/stable-diffusion-v1-5/unet/, see it has the 3.4 GB safetensors file, not the 1.7 GB fp16.safetensors file.
@lstein
Copy link
Collaborator

lstein commented Aug 2, 2023

Thanks for noticing this. The referenced PR should fix it.

StAlKeR7779 added a commit that referenced this issue Aug 4, 2023
… config (#4129)

## What type of PR is this? (check all applicable)

- [ ] Refactor
- [ ] Feature
- [X] Bug Fix
- [ ] Optimization
- [ ] Documentation Update
- [ ] Community Node Submission


## Have you discussed this change with the InvokeAI team?
- [X] Yes
- [ ] No, because:

      
## Have you updated all relevant documentation?
- [X] Yes
- [ ] No


## Description

At install time, when the user's config specified "auto" precision, the
installer was downloading the fp32 models even when an fp16 model would
be appropriate for the OS.


## Related Tickets & Documents

<!--
For pull requests that relate or close an issue, please include them
below. 

For example having the text: "closes #1234" would connect the current
pull
request to issue 1234.  And when we merge the pull request, Github will
automatically close the issue.
-->

- Closes #4127
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working model manager
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants