Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

网络结构问题 #4

Open
diyiiyiii opened this issue Dec 14, 2022 · 1 comment
Open

网络结构问题 #4

diyiiyiii opened this issue Dec 14, 2022 · 1 comment

Comments

@diyiiyiii
Copy link

您好，感谢您的分享。在您的论文网络结构图里，GT文字部分会通过CLIP text编码传入到diffusion模块。那测试阶段没有GT caption 如何操作？期待您的回复。
@xu-shitong
Copy link
Owner

文本的GT clip编码只会在训练时使用classification-free guidance的时候才会被使用。最终的模型里并没有使用classification-free guidance。结构图里有主要是为了解释实验

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@xu-shitong @diyiiyiii