Content
@
0 reply
0 recast
0 reaction
Ed O'Shaughnessy
@eddieosh
https://www.johndcook.com/blog/2025/03/07/tokens-and-words/
1 reply
0 recast
1 reaction
Leo
@lsn
I wonder how this works for scripts like Chinese characters Could feasibly be one token per character
1 reply
0 recast
0 reaction
