This website requires JavaScript.
Explore
Help
Register
Sign In
tomo
/
typeset
Watch
1
Star
0
Fork
0
You've already forked typeset
Code
Issues
1
Pull Requests
Packages
Projects
Releases
12
Wiki
Activity
66
Commits
2
Branches
12
Tags
107
KiB
fe23b63070
Commit Graph
4 Commits
Author
SHA1
Message
Date
Sasha Koshka
ff8f86e034
5 is the appears to be the sweet spot for average token len
2024-09-19 09:40:00 -04:00
Sasha Koshka
288a1fb9ef
Fix token slice size estimation to massively reduce waste
2024-09-19 09:36:01 -04:00
Sasha Koshka
5171cbac16
Fix the memory problem
2024-09-18 23:48:21 -04:00
Sasha Koshka
569defdb36
Add parsing stage
2024-09-10 11:19:57 -04:00