Hey HN, Henry and Roman here - we've been building a cross-platform framework for deploying LLMs, VLMs, Embedding Models and TTS models locally on smartphones.
Ollama enables deploying LLMs models locally on laptops and edge severs, Cactus enables deploying on phones. Deploying directly on phones facilitates building AI apps and agents capable of phone use without breaking privacy, supports real-time inference with no latency, we have seen personalised RAG pipelines for users and more.
A
Article URL: https://openfront.io/
Comments URL: https://news.ycombinator.com/item?id=44528943
Points: 33
# Comments: 5
Article URL: https://formularsumo.co.uk/blog/2025/apple-vs-the-law/
Comments URL: https://news.ycombinator.com/item?id=44529061
Points: 97
# Comments: 47
Article URL: https://www.nber.org/papers/w33989
Comments URL: https://news.ycombinator.com/item?id=44529456
Points: 5
# Comments: 1
Article URL: https://bentoml.com/llm/
Comments URL: https://news.ycombinator.com/item?id=44527947
Points: 7
# Comments: 0
Article URL: https://simonwillison.net/2025/Jul/11/grok-musk/
Comments URL: https://news.ycombinator.com/item?id=44527190
Points: 147
# Comments: 69
Article URL: https://www.abc.net.au/news/2025-07-11/age-verification-search-engines/105516256
Comments URL: https://news.ycombinator.com/item?id=44528204
Points: 70
# Comments: 50
https://www.abc.net.au/news/2025-07-11/age-verification-search-engines/105516256
Pangolin is an open source self-hosted tunneled reverse proxy management server with identity and access control, designed to securely expose private resources through encrypted WireGuard tunnels running in user space.
We made Pangolin so you retain full control over your infrastructure while providing a user-friendly and feature-rich solution for managing proxies, authentication, and access, all with a clean and simple dashboard web UI.