Article URL: https://reasonablypolymorphic.com/blog/solving-lcsa/
Comments URL: https://news.ycombinator.com/item?id=43977147
Points: 5
# Comments: 1
Erstellt
3d
|
13.05.2025, 22:10:15
Melden Sie sich an, um einen Kommentar hinzuzufügen
Andere Beiträge in dieser Gruppe

Hey everyone!
Over the past two years I threw myself back into full-time engineering with a simple goal: write code that gives back to the community. After a lot of late-night FOMO (“AI w


Article URL: https://cacm.acm.org/news/the-collapse-of-gpt/

I discovered that in LLM inference, keys and values in the KV cache have very different quantization sensitivities. Keys need higher precision than values to maintain quality.
I patched llama.cp
Article URL: https://clojurescript.org/news/2025-05-16-release
