Flux NF4 model has been released

[xingewh]

Flux NF4 model has been released, and it seems to have better quality and faster speed than FP8.” 或者 “The Flux NF4 model has been launched, and it appears to possess better quality and a higher speed than FP8.

https://huggingface.co/lllyasviel/flux1-dev-bnb-nf4/blob/main/flux1-dev-bnb-nf4.safetensors

[gmf1982]

It has been used in comfyui. My graphics card is 2060super 8GB. Using flux1-schnell-nf4.safetensors, it only takes 23 seconds to generate a 1024*1024 picture. The effect is very good. I hope krita-ai-diffusion will support NF4 soon.

[xingewh]

V2:
https://huggingface.co/lllyasviel/flux1-dev-bnb-nf4/blob/main/flux1-dev-bnb-nf4-v2.safetensors

[AlexYez]

Cool, this version don't need separate clip encoders and vae

[xingewh]

很酷，这个版本不需要单独的夹子编码器和 vae

Yes, in fact, we only need to install this node https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4.
Then edit the comfy_workflow.py, and replace return self.add_cached("CheckpointLoaderSimple", 3, ckpt_name=checkpoint) with return self.add_cached("CheckpointLoaderNF4", 3, ckpt_name=checkpoint), then we can use the NF4 model in Krita AI.
I have successfully used the NF4 v2 model in my Krita AI.

[xingewh]

However, after installing this node, some errors occurred. I'm not sure whether their specific reasons are related to it.

[xingewh]

After testing, after I uninstalled the ComfyUI_bitsandbytes_NF4 node, the malfunction where some sdxl models generated error prompts when generating pictures was eliminated. It might be that it conflicts with some current components.

[yen-shi-lun]

Thank you very much, I will try it too

[xingewh]

I conducted a test. On my 4070Ti 12G, the NF4 version takes only 32 seconds to generate a 1024*1024 image in 20 steps.

[nesmonmehdydeal]

In Krita those zip do not intalled in plugin inpot inside Krita

• https://github.com/city96/ComfyUI-GGUF
• https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4
  How to do it manually ?

[xingewh]

I am using an independent ComfyUI. Nodes can be installed by scanning through plugin management or manually added to the custom_nodes directory for installation.

[nesmonmehdydeal]

Thanks.

[tilllt]

Is there a simple to follow how-to on installing flux models with krita-ai-diffusion? I dropped the models into the model folder but the config doesn't seem to "see" them...

[gmf1982]

Try updating comfyui-inpaint-nodes and comfyui-tooling-nodes

[tilllt]

update as in redownload the nodes and overwrite their old code or is there a specific procedure to update nodes in comfyUI (have rarely used comfUi standalone, just in Krita.

[gmf1982]

You can download the node overwrite, or you can go to custom_nodes>node that needs to be updated>enter CMD in the address bar to open the terminal, and update it with the “git pull“” command.

[yecai2024]

I updated all the nodes, but Krita still can't find all flux models.

Try updating comfyui-inpaint-nodes and comfyui-tooling-nodes

[gmf1982]

step1:update Comfyui
step2:updating comfyui-inpaint-nodes and comfyui-tooling-nodes(Make sure you have updated successfully)
step3:Download the model and put it in the models/checkpoints folder.
step4:Restart Comfyui and Krita
This is the solution I had when I encountered the same problem。

[tilllt]

I tried upgrading the nodes, I even tried reinstalling a standalone ComfyUI now, the results are the same: the images come out extremely "ghostly", blurry, like you can just guess what the prompt was suppsoed to create. Is there something like a step-by-step walkthrough how to install flux, with which models (including fp4/fp8) etc to get it to work?