As a grad student (and an ADHDer), I had trouble doing literature review systematically. To combat this, I made a website that finds similar papers using the meaning of the thing I am looking for.
I used MixedBread's [^1] embedding model to generate vectors from the abstracts. I store and search similar vectors using Milvus [^2] and finally use Gradio [^3] to serve the frontend. I update the vector database weekly by pulling the metadata dataset from Kaggle [^4].
To speed up the search process on my free oracle instance, I binarise the embeddings and use Hamming distance as a metric.
I would love your feedback on the site :) Happy Holidays!
[1]: https://www.mixedbread.ai/docs/embeddings/mxbai-embed-large-... [2]: https://milvus.io/ [3]: https://www.gradio.app/ [4]: https://www.kaggle.com/datasets/Cornell-University/arxiv
Comments URL: https://news.ycombinator.com/item?id=42507116
Points: 14
# Comments: 0
Login to add comment
Other posts in this group
Article URL: https://www.desktoponfire.com/haiku_inc/782
I built an interactive which recreates one of James Clerk Maxwell’s lesser-known color experiments that helped discover the trichromatic theory—remarkably accurate, even by today’s standards.
Pl
Article URL: https://github.com/sirius-db/sirius
Comments URL: https://news.ycombin
Article URL: https://scottaaronson.blog/?p=8972
Comments URL: https://news.ycombinat
