Article URL: https://www.theregister.com/2025/04/12/ai_code_suggestions_sabotage_supply_chain/
Comments URL: https://news.ycombinator.com/item?id=43663777
Points: 5
# Comments: 0
https://www.theregister.com/2025/04/12/ai_code_suggestions_sabotage_supply_chain/
Erstellt
1mo
|
12.04.2025, 12:40:06
Melden Sie sich an, um einen Kommentar hinzuzufügen
Andere Beiträge in dieser Gruppe

I discovered that in LLM inference, keys and values in the KV cache have very different quantization sensitivities. Keys need higher precision than values to maintain quality.
I patched llama.cp
Article URL: https://clojurescript.org/news/2025-05-16-release




Article URL: https://bobacollection.staxmuseum.org/
Comments URL: https://news.y