Unit test

Update test_tokenize.py #424

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
unittest (ubuntu-latest, 3.13)	4m 15s
unittest (ubuntu-latest, 3.12)	3m 4s
unittest (ubuntu-latest, 3.11)	2m 19s
unittest (ubuntu-latest, 3.10)	2m 8s
unittest (ubuntu-latest, 3.9)	1m 58s
unittest (windows-latest, 3.13)	5m 9s
unittest (windows-latest, 3.12)	2m 49s
unittest (windows-latest, 3.11)	2m 55s
unittest (windows-latest, 3.10)	2m 36s
unittest (windows-latest, 3.9)	2m 29s
unittest (macos-latest, 3.13)	2m 27s
unittest (macos-latest, 3.12)	2m 2s
unittest (macos-latest, 3.11)	2m 22s
unittest (macos-latest, 3.10)	2m 0s
unittest (macos-latest, 3.9)	2m 54s
	41m 27s