Article URL: https://www.photonicsonline.com/doc/a-super-solid-made-using-pho-tons-0001
Comments URL: https://news.ycombinator.com/item?id=43329427
Points: 3
# Comments: 0
https://www.photonicsonline.com/doc/a-super-solid-made-using-pho-tons-0001
Created
2mo
|
Mar 11, 2025, 6:10:06 AM
Login to add comment
Other posts in this group

I discovered that in LLM inference, keys and values in the KV cache have very different quantization sensitivities. Keys need higher precision than values to maintain quality.
I patched llama.cp
Article URL: https://clojurescript.org/news/2025-05-16-release




Article URL: https://bobacollection.staxmuseum.org/
Comments URL: https://news.y