Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How did you calculate the perplexity of DiffusionLM #31

Open
SpaceHunterInf opened this issue Jan 15, 2024 · 0 comments
Open

How did you calculate the perplexity of DiffusionLM #31

SpaceHunterInf opened this issue Jan 15, 2024 · 0 comments

Comments

@SpaceHunterInf
Copy link

Greetings,

I am currently working on diffusion for text generation as well. In your paper you have included the PPL of DiffusionLM in your results for comparison. I would I assume you have derived this from the ELBO from the loss of the model, right? Would you please share more details of the computation? For example, what loss you are using and whether you have estimate the token level PPL or the sequence level PPL. It would be great if you can share the code for this part as well.

Thank you very much. Your help is appreciated as we would like to cite this method.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant