Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why is text embedding linear interpolated? #18

Open
wtliao opened this issue Oct 15, 2024 · 1 comment
Open

Why is text embedding linear interpolated? #18

wtliao opened this issue Oct 15, 2024 · 1 comment

Comments

@wtliao
Copy link

wtliao commented Oct 15, 2024

Many thanks for sharing your impressive work and code. I am reading your code line by line for better understanding. One point I cannot figure out is that, why is text embedding also linearly interpolated (emb_list = auto_lerp(tlist, emb0, emb1) )? In my opinion, this kind of interpolated will change the condition (i.e. prompt), and all initial noisy input should share the same prompt condition. Please help me understand it. Many thanks again!

@JiayiGuo821
Copy link
Collaborator

In the paper cases, two input images for interpolation share the same prompt, i.e., emb0=emb1. Therefore, the linear interpolation makes no difference for these cases since (1-a)*emb+a*emb=emb. We provide this prompt linear interpolation for potential user testing for interpolating images with different prompts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants