Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

Nucleus sampling with beam? #4882

Answered by klshuster
lenbrocki asked this question in Q&A

You must be logged in to vote

When using sampling, you can think of the beam_size parameter as more of a best_of_n parameter; if you specify e.g. --beam-size 5 with nucleus sampling, ParlAI will sample 5 generations in parallel and output the one with the highest score at the end.

Replies: 1 comment 1 reply

You must be logged in to vote
1 reply
@lenbrocki

Answer selected by lenbrocki
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants