Show HN: Jevgpt – reinventing the wheel with another wheel
Felt extra autistic today and made jev an autoregressive chatbot by classifier small token vocabularies.
https://github.com/giga-james/jevgpt
had some trouble getting it to explore enough token options so i did a small spec decoding pass to expand token vocab (jev as drafter and verifier lol)
it aint much and it aint honest work either
This is amazing. I don't think I fully understand how it works, but the core of having Jev (or some classifier), generate the words/tokens it's going to output by picking/classifying the words/tokens, is very cool
Where do you see the biggest potential improvement gains?
Really interesting approach. I’m curious how much the verifier pass improves the output quality compared to just increasing the token vocabulary.