Update 'monkeypatched' controlnet class

[StAlKeR7779]

What type of PR is this? (check all applicable)

• Refactor
• Feature
• Bug Fix
• Optimization
• Documentation Update
• Community Node Submission

Have you discussed this change with the InvokeAI team?

• Yes
• No, because:

Have you updated all relevant documentation?

• Yes
• No

Description

Related Tickets & Documents

• Related Issue #
• Closes #

QA Instructions, Screenshots, Recordings

Added/updated tests?

• Yes
• No : please replace this line with details on why tests
  have not been included

[optional] Are there any post deployment tasks we need to perform?

Should be removed when added in diffusers
huggingface/diffusers#4599

[GreggHelt2]

Just want to understand the plan here.
Comparing this monkeypatch for ControlNetModel to diffusers ControlNetModel, looks like all changes in this PR are to integrate changes to diffusers ControlNetModel since the monnkeypatch was created?
But I see you also have a PR out to diffusers: PR #4599: Add encoder_attention_mask argument to controlnet model #4599 to get monkeypatched stuff into diffusers ControlNet Model.
So is the intent still to eliminate the monkeypatch once diffusers PR gets approved?

If so this PR makes sense to me, at least until diffusers PR goes through. I think original purpose of monkeypatch was to support long prompts when using ControlNet? If so I can post on diffusers PR showing how this makes a difference when using long prompts.

[lstein]

LGTM, but we need to remember to pull this out when diffusers is updated. Is there a way you can add some code prior to the monkeypatch being installed that checks whether the current version of diffusers is already patched and issues a log message to this effect?