tokenizer max limit on input size#324

OlivierDehaene merged 1 commit intomainhuggingface/text-embeddings-inference:mainfrom

feature/upper-limit-for-tokenizerhuggingface/text-embeddings-inference:feature/upper-limit-for-tokenizerCopy head branch name to clipboard