Revert "Default to using tokenizer eos and bos in convert_text_to_mds.py"#825

irenedea merged 1 commit intomainmosaicml/llm-foundry:mainfrom

revert-823-tokmosaicml/llm-foundry:revert-823-tokCopy head branch name to clipboard