Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LLLite CNs don't work correctly with Hotshot #74

Open
sjuxax opened this issue Feb 26, 2024 · 5 comments
Open

LLLite CNs don't work correctly with Hotshot #74

sjuxax opened this issue Feb 26, 2024 · 5 comments

Comments

@sjuxax
Copy link

sjuxax commented Feb 26, 2024

I haven't had any success using ControlNet-LLLite CNs together with Hotshot. It just turns into a bunch of junk. The same CNs work well without the motion module. I haven't tested with ADXL.

@Kosinkadink
Copy link
Owner

Can you give example of which ControlLLLITE models you've tried? During development I tried out canny and lineart with Hotshot, and those worked as expected.

@sjuxax
Copy link
Author

sjuxax commented Mar 4, 2024

https://huggingface.co/bdsqlsz/qinglong_controlnet-lllite/blob/main/bdsqlsz_controlllite_xl_normal.safetensors is one example -- this works for single images, but not with AD.

@Kosinkadink
Copy link
Owner

I had someone try it out, and it worked fine with Hotshot on their end. Can you post a screenshot of a basic workflow where it doesn't work for you?

@kijai
Copy link
Contributor

kijai commented Mar 4, 2024

@sjuxax
Copy link
Author

sjuxax commented Mar 9, 2024

So I troubleshot with @kijai in Discord and found it's a resolution thing. If I use a resolution divisible by 32 on both width and height (896x512 in this case), things work well. If I don't (was using 872x500), I get junky output like this:
2024-03-04_01-40-49, which needless to say, doesn't match the normal map I was feeding in.

Maybe there should be a resolution warning when using LLLite CNs with incompatible resolutions, or some internal rounding to prevent this? Not sure on a good way to resolve smoothly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants