Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing requirements file #18

Open
ghazi-f opened this issue Dec 15, 2021 · 1 comment
Open

Missing requirements file #18

ghazi-f opened this issue Dec 15, 2021 · 1 comment

Comments

@ghazi-f
Copy link

ghazi-f commented Dec 15, 2021

Thank your for sharing this great work !

I have been trying some of your checkpoints but they don't even seem to perform reconstruction right (even at beta=0).
Then I tried performing interpolation between a sentence and the same sentence with 10 steps (which should give 10 times the same sentence). But it yields differents sentences.

I suspect this is because of a difference in the version of the python libraries we use (since I didn't modify anything in your scripts).
Could you please provide a requirements.txt file with the exact version of the libraries you used ?
Thanks a lot !

@ghazi-f
Copy link
Author

ghazi-f commented Dec 16, 2021

I found the problem with interpolation: interpolating between a sentence and itself gave different sentences because of the random sampling.
I set top_k to 1 and top_p to 0.0 and it gave the same sentence for the 10 steps of interpolation. However, reconstruction is still fairly far off from the original sentence even with the beta=0 model checkpoint. Actually it is the same reconstruction with the 3 checkpoints (beta=0, beta=0.5, and beta=1.0). I'm using the wikipedia pretrained models. Is this normal ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant