feat: lazy tokenizer loading and defensive asserts#307

ThomasK33 merged 1 commit intomaincoder/cmux:mainfrom

thomask33/10-17-improve_tokenizer_loadingcoder/cmux:thomask33/10-17-improve_tokenizer_loadingCopy head branch name to clipboard