Code

Optimize regexes used in tiktoken#7020

Code

Merged

tarekgh merged 3 commits intodotnet:maindotnet/machinelearning:mainfrom stephentoub:regexoptstephentoub/machinelearning:regexoptCopy head branch name to clipboardFeb 23, 2024

+8-16

Commits

Commits on Feb 20, 2024

• Optimize regexes used in tiktoken

  stephentoub

  committed
  32444f1

  Copy full SHA for 32444f1

Commits on Feb 22, 2024

• Merge branch 'main' into regexopt

  stephentoub

  committed
  fdd2a27

  Copy full SHA for fdd2a27

• Add comment and consolidate duplicate regex from Roberta

  stephentoub

  committed
  849097e

  Copy full SHA for 849097e