Skip to content

Actions: daulet/tokenizers

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
60 workflow runs
60 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

feat: add option to retrieve offsets from tokenizer (#21)
CI #35: Commit 7bb47dd pushed by daulet
August 9, 2024 21:38 6m 27s main
August 9, 2024 21:38 6m 27s
Add tiktoken vs tokenizers bench
CI #30: Commit d9aff87 pushed by daulet
July 14, 2024 05:39 2m 12s main
July 14, 2024 05:39 2m 12s
improve rust bench to exclude drop time
CI #29: Commit fce4681 pushed by daulet
July 10, 2024 15:24 1m 46s main
July 10, 2024 15:24 1m 46s
fix Bazel build
CI #28: Commit 867bf62 pushed by daulet
July 10, 2024 15:14 2m 24s main
July 10, 2024 15:14 2m 24s
upgrade to 0.19.1
CI #27: Commit 217df12 pushed by daulet
July 9, 2024 07:52 1m 51s main
July 9, 2024 07:52 1m 51s
update benchmarks before upgrade to 0.19.1
CI #26: Commit a735742 pushed by daulet
July 9, 2024 07:48 2m 19s main
July 9, 2024 07:48 2m 19s
update README with linker param requirement
CI #25: Commit ba0db9d pushed by daulet
July 9, 2024 07:44 6m 28s main
July 9, 2024 07:44 6m 28s
Update to allow for platform dependent libs in CGO (#18)
CI #24: Commit d503b5b pushed by daulet
June 12, 2024 01:36 4m 28s main
June 12, 2024 01:36 4m 28s
Update to allow for platform dependent libs in CGO
CI #23: Pull request #18 synchronize by jmoney
June 6, 2024 13:41 3m 9s jsm.pull-request
June 6, 2024 13:41 3m 9s
Update to allow for platform dependent libs in CGO
CI #22: Pull request #18 opened by jmoney
June 4, 2024 20:18 4m 18s jsm.pull-request
June 4, 2024 20:18 4m 18s
expose encodeSpecialTokens functionality
CI #21: Commit 3a615e6 pushed by daulet
April 10, 2024 23:25 52s main
April 10, 2024 23:25 52s
update to tokenizers v0.15.2
CI #20: Commit b14c306 pushed by daulet
April 10, 2024 17:22 4m 31s main
April 10, 2024 17:22 4m 31s
exclude release from bazel build as it is not compatible
CI #19: Commit 8531b2b pushed by daulet
January 7, 2024 00:37 4m 16s main
January 7, 2024 00:37 4m 16s
fix cross compilation: libc::c_char is platform dependent
CI #18: Commit 6e58579 pushed by daulet
January 7, 2024 00:24 2m 19s main
January 7, 2024 00:24 2m 19s
add contribution README
CI #16: Commit 4fd5a66 pushed by daulet
November 19, 2023 16:55 1m 19s main
November 19, 2023 16:55 1m 19s
support more attributes from the Encoding structure (#5)
CI #15: Commit 38a9a14 pushed by daulet
November 15, 2023 15:40 59s main
November 15, 2023 15:40 59s
enable triggering CI action manually
CI #14: Commit 786da40 pushed by daulet
November 15, 2023 15:29 55s main
November 15, 2023 15:29 55s
Update ci.yaml
CI #13: Commit d2b3892 pushed by daulet
November 15, 2023 15:16 58s main
November 15, 2023 15:16 58s
November 9, 2023 23:26 1m 10s
November 9, 2023 23:25 1m 14s