Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[cherry-pick] Ensure actual lenght of transformed seq by T5 Transform…
… cannot be longer than specified max_len (#2143) * Ensure max seq length is not 1 > actual max seq len Summary: Currently a "bug" wherein max length can actually be 1 greater than actual max_seq length specified b/c we add EOS token. Reviewed By: yohann-benchetrit Differential Revision: D44708339 fbshipit-source-id: dc24d268caa4eb783df8ac7e8a2463e33d3244d9 * Format new changes --------- Co-authored-by: Joe Cummings <jrcummings@meta.com>
- Loading branch information