Article URL: https://medium.com/@aazo11/local-llm-inference-897a06cc17a2
Comments URL: https://news.ycombinator.com/item?id=43753890
Points: 8
# Comments: 5
созданный
11d
|
21 апр. 2025 г., 19:10:21
Войдите, чтобы добавить комментарий
Другие сообщения в этой группе


Article URL: https://www.ubicloud.com/blog/building-burstables-cpu-slicing-with-cgroups
Comments URL

Article URL: https://www.ycombinator.com/companies/toma/jobs

Article URL: https://matthewstrom.com/writing/album-art/
Comments URL: http

Hi HN!
BLAST is a high-performance serving engine for browser-augmented LLMs, designed to make deploying web-browsing AI easy, fast, and cost-manageable.
The goal with BLAST is to ultimately a