X X^t can be faster

Hey everyone!

Over the past two years I threw myself back into full-time engineering with a simple goal: write code that gives back to the community. After a lot of late-night FOMO (“AI w

Article URL: https://www.ft.com/content/e456ea34-c6ad-43fe-abe9-d4ce781c07b4

Comments URL:

Article URL: https://www.nytimes.com/2025/05/04/books/review/the-dazzling-paget-sisters-aria

Article URL: https://cacm.acm.org/news/the-collapse-of-gpt/

Comments URL:

I discovered that in LLM inference, keys and values in the KV cache have very different quantization sensitivities. Keys need higher precision than values to maintain quality.

I patched llama.cp

Article URL: https://clojurescript.org/news/2025-05-16-release

Comments URL:

Article URL: https://aeon.co/essays/who-needs-ai-text-generation-when-theres-erasmus-of-rotterdam