Hacker news

We’ve just open-sourced SemHash, a lightweight package for semantic text deduplication. It lets you effortlessly clean up your datasets and avoid pitfalls caused by duplicate samples in semantic search, RAG, and machine learning.

Main Features:

- Fast and hardware friendly: Deduplicate datasets with millions of records in minutes, on a CPU.

- Flexible: Works on single or multiple datasets (e.g., train/test deduplication), and multi-column data (e.g., Question-Answering datasets).

- L

Article URL: https://www.dezeen.com/2025/01/08/bergisel-ski-jump-zaha-hadid-21st-century-architecture/

Comments URL: https://news.ycombinator.com/item?id=42674801

Points: 16

# Comments: 2

https://www.dezeen.com/2025/01/08/bergisel-ski-jump-zaha-hadid-21st-century-architecture/

Article URL: http://reassembler.blogspot.com/

Comments URL: https://news.ycombinator.com/item?id=42674882

Points: 7

# Comments: 0

http://reassembler.blogspot.com/

Article URL: https://www.a1k0n.net/2025/01/10/tiny-tapeout-donut.html

Comments URL: https://news.ycombinator.com/item?id=42675208

Points: 3

# Comments: 0

https://www.a1k0n.net/2025/01/10/tiny-tapeout-donut.html

Article URL: https://ntietz.com/blog/great-things-about-rust-beyond-perf/

Comments URL: https://news.ycombinator.com/item?id=42675219

Points: 66

# Comments: 13

https://ntietz.com/blog/great-things-about-rust-beyond-perf/

Article URL: https://longreads.com/2018/12/04/the-case-for-letting-malibu-burn/

Comments URL: https://news.ycombinator.com/item?id=42675274

Points: 11

# Comments: 0

https://longreads.com/2018/12/04/the-case-for-letting-malibu-burn/

Article URL: https://www.wqow.com/health-watch/lead-and-cadmium-found-in-muscle-building-protein-powders-report-says/article_882063dc-8b86-5437-ac52-49530da83de0.html

Comments URL: https://news.ycombinator.com/item?id=42675538

Points: 5

# Comments

Article URL: https://english.elpais.com/lifestyle/2025-01-07/the-internet-hasnt-made-us-bad-we-were-already-like-that-the-mistake-of-yearning-for-the-friendly-online-world-of-20-years-ago.html

Comments URL: https://news.ycombinator.com/ite

Article URL: https://eieio.games/blog/bad-apple-with-regex-in-vim/

Comments URL: https://news.ycombinator.com/item?id=42674116

Points: 24

# Comments: 4

https://eieio.games/blog/bad-apple-with-regex-in-vim/

Article URL: https://www.therepository.email/mullenweg-shuts-down-wordpress-sustainability-team-igniting-backlash

Comments URL: https://news.ycombinator.com/item?id=42672675

Points: 45

# Comments: 24

https://www.therepository.email/mullenweg-shuts-down-wordpress-sustainability-team-igniting-bac