Ongoing Issue with inpaint

[githubUser01946]

I am using Inpainting model: sd-v1-5-inpainting. ckpt [3e16efc8]
The commit hash for my version of Automatic1111 is: 81973091bc07c706d056809d89221bafcd01b38a

I have an image and would like to add another subject to it, I mask off/paint black the area I want the object to be.

The prompt I have tried to use is simple a humanoid astronaut looking down thats it, nothing more, nothing less but recently inpainting takes that as fill the area with whatever is currently there but change the pattern or colour slightly.

One result did give me something and that was two small stones on the floor....which is ok but not what I asked for at all.
I have tried with fill/original, the latent options and I never get what I have asked for. Even tried asking for something else like a building or a rabbit etc but nope.

It has been suggested on Discord that I try and use Photoshop to "doodle" what I want but I dont have access to Photoshop and that wouldn't solve my problem.

I have tried various samplers, cfg levels and de-noising strengths and nothing gives me the result I want.

[TKoestlerx]

Generally speaking, to add new elements "latent noise" with denoising to "1.0" is the right choice.

Then, depending on the size, it may make sense to select "inpaint at full resolution". This reduces the view range of the AI to the area of the change and the prompt describing the new object has room to develop.

Alternatively you can extend the prompt. Connect the new object with the existing one: "Astronaut in front of the tree" etc.

Then increase the cfg value until you are at the end of the scale, or successful in the creation.

And the last possibility: use a basic painting app to paint a stick figure astronaut into the picture, use "original" as noise and use 0.8 - 1.0 in the denoising scale.

[githubUser01946]

Why would it try to get rid of the other when its masked and also the prompt is different to the initial image?

Also, the other creature was never referred to as an astronaut.

[TKoestlerx]

Because masked out means : dont change this pixels. But the ai will "see" the outside even with "inpaint at full resolution".

And it knows the relation between "a astronaut" and "astronauts" or "two astronauts".
So, if the prompt is "a astronaut" there is no need for the ai to create another one. But there is a reason for it to prevent a 2. one.

Edit: While the prompt "two astronauts" will give the ai an clear indication of what is missing.

[githubUser01946]

Because masked out means : dont change this pixels. But the ai will "see" the outside even with "inpaint at full resolution".

And it knows the relation between "a astronaut" and "astronauts" or "two astronauts". So, if the prompt is "a astronaut" there is no need for the ai to create another one. But there is a reason for it to prevent a 2. one.

I thought the masked area is for the AI to know that it should paint within it and to leave everything else?

I have had progress using the same prompt as you but I want something resembling what I masked so am I best unticking the inpaint at full resolution box to get that?

[TKoestlerx]

give it a try.

In this case (without inpaint at full resolution) the ai will see the entire picture.

With inpaint at full resolution the ai will see a border region of the padding pixels + some more for technical reasons. (keeping aspect ratios sane, keeping dimensions dividable by 64...)

[githubUser01946]

Nothing seems to be working, pretty sure its either really buggy or just broke.

[Tollanador]

Have you tried swapping out the inpainting model to the standard 1.5 model when trying to add in an entirely separate subject to the scene?

[githubUser01946]

I had tried a few things tbh so yeah probably. I probably tried the 1.4 model too.
It did work for a while before without much issue but it's not like that now.

I have actually come across another issue related to saving an outpainting via inpaint which I have posted about #4438 , maybe the issue is connected. I just dont know.