Skip to content

Add 'source_code_default' tokenizer with preset filters.#3655

Merged
fmassot merged 4 commits intomainfrom fmassot/rename-source-code-tokenizerJul 18, 2023

Commits

Commits on Jul 17, 2023

Commits on Jul 18, 2023