Skip to content

Fractal Randomness for Aggregate Compression; a Tokenizer Alternative Looping over Seeds

License

Notifications You must be signed in to change notification settings

ScienceArtMagic/FRACTALS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FRACTALS: Fractal Randomness for Aggregate Compression; a Tokenizer Alternative Looping over Seeds

Paper (VERY rough draft)

There's not much to see yet. The byte-level encoder and decoder (non-parametric, with optional UTF-8 normalization forms and automatic conversion to/from emoji/shortcodes or vice versa) are available in fractals/text.py.

Compression mechanisms are still in the works. Stay tuned.

About

Fractal Randomness for Aggregate Compression; a Tokenizer Alternative Looping over Seeds

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages