Hey HN! We’ve just open-sourced model2vec-rs, a Rust crate for loading and running Model2Vec static embedding models with zero Python dependency. This allows you to embed text at (very) high throughput; for example, in a Rust-based microservice or CLI tool. This can be used for semantic search, retrieval, RAG, or any other text embedding usecase.
Main Features:
- Rust-native inference: Load any Model2Vec model from Hugging Face or your local path with StaticModel::from_pretrained(...).
- Tiny footprint: The crate itself is only ~1.7 mb, with embedding models between 7 and 30 mb.
Performance:
We benchmarked single-threaded on a CPU:
- Python: ~4650 embeddings/sec
- Rust: ~8000 embeddings/sec (~1.7× speedup)
First open-source project in Rust for us, so would be great to get some feedback!
Comments URL: https://news.ycombinator.com/item?id=44021883
Points: 13
# Comments: 0
Login to add comment
Other posts in this group
We’ve been working on Vaev, a minimal web browser engine built from scratch. It supports HTML/XHTML, the CSS cascade, @page rules for pagination, and print-to-PDF rendering. It even handles calc()
Stack Error reduces the up-front cost of designing an error handling solution for your project, so that you focus on writing great libraries and applications.
Stack Error has three goals:
1. P
Article URL: https://telcontar.net/Misc/GUI/RISCOS/
Comments URL: https://news.y
Article URL: https://fabiensanglard.net/2168/index.html
Comments URL: https:
Buckaroo is my open source project. It is a dataframe viewer that has the basic features we expect in a modern table - scroll, search, sort. In addition there are summary stats, and histograms ava
Article URL: https://muse.jhu.edu/article/2832
Comments URL: https://news.ycombinator
