Article URL: https://economics.mit.edu/news/assuring-accurate-research-record
Comments URL: https://news.ycombinator.com/item?id=44006426
Points: 30
# Comments: 5
https://economics.mit.edu/news/assuring-accurate-research-record
Létrehozva
6h
|
2025. máj. 16. 17:20:14
Jelentkezéshez jelentkezzen be
EGYÉB POSTS Ebben a csoportban

I discovered that in LLM inference, keys and values in the KV cache have very different quantization sensitivities. Keys need higher precision than values to maintain quality.
I patched llama.cp
Article URL: https://clojurescript.org/news/2025-05-16-release




Article URL: https://bobacollection.staxmuseum.org/
Comments URL: https://news.y