diff --git a/projects/director/README.md b/projects/director/README.md index 10339b0e240..a3cc48a4ad5 100644 --- a/projects/director/README.md +++ b/projects/director/README.md @@ -3,7 +3,7 @@ Kushal Arora, Kurt Shuster, Sainbayar Sukhbaatar, Jason Weston - +Paper Link: [https://arxiv.org/2206](https://arxiv.org/abs/2206.07694) ## Abstract @@ -27,4 +27,4 @@ parlai train -vtim 300 -bs 6 --gradient-clip 10.0 --fp16 True -lr 1e-05 --valida ### Evaluate DIRECTOR model on the toxic prompts from WikiToxicComments dataset: ```python python -m parlai.scripts.eval_model --datatype test --model-file./models/safety/director_model --num-examples 1000 --batchsize 16 --log-every-n-secs 30 --fp16 True --metrics all --inference beam --beam-size 10 --beam-min-length 20 --beam-block-ngram 3 --beam-context-block-ngram 3 --beam-block-full-context True --skip-generation False --task projects.director.tasks.safety:SafeWikiToxicEvalTeacher:mutators=flatten+safety_relabel_classes+neg_only --eval-classifier-model-file ./models/safety/eval_model --include-label-cand-only True -bs 8 --infer-gamma 1 -``` \ No newline at end of file +```