Add GPT-2 BPE pre-tokenizer operator leveraging re2 regex library#1459
Merged
abhinavarora merged 8 commits intopytorch:mainfrom abhinavarora:expose_regex_find_consumeDec 9, 2021
+140
Commits
Commits on Dec 9, 2021
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
