Show HN: Simple wrapper for Chrome's built-in local LLM (Gemini Nano)

Chrome now includes a native on-device LLM (Gemini Nano) starting in version 138. I've been building with it since it was in origin trials, it's powerful but the official Prompt API is still a bit awkward:

- Enforces sessions even for basic usage

- Requires user-triggered downloads

- Lacks type safety or structured error handling

So I open-sourced a small TypeScript wrapper I originally built for other projects to smooth over the rough edges:

github:

I extracted the safety filters from Apple Intelligence models

I managed to reverse engineer the encryption (refered to as “Obfuscation” in the framework) responsible for managing the safety filters of Apple Intelligence models. I have extracted them into a repository. I encourage you to take a look around.


Comments URL: https://news.ycombinator.com/item?id=44483485

Points: 122

# Comments: 38

https://github.com/BlueFalconHD/apple_generative_model_safety_decrypted


Search
Hacker news