Show HN: Glowstick – type level tensor shapes in stable rust

Hi HN,

In the past few years I've become more interested in machine learning. Since I'm sure the same is true for many here, I wanted to share this project I've been working on: glowstick uses type-directed metaprogramming to keep track of tensor shapes in Rust's type system and determine which operations are permitted or not at compile time.

I find Rust has a lot of strengths when it comes to ML applications, but waiting until runtime to find shape related issues feels a bit strange since normally I don't run the code all that often while developing. Given Rust has fancy types available, I figured I'd try my hand at using them to address this.

I've added integration crates for the two ML frameworks I use most frequently, candle and burn, and included examples of implementing llama 3.2 in each using typed shapes for much of the model internals and inference loop. Mixtures of static and dynamic dimensions should be supported well enough for most applications at this point, though there are of course still improvements to be made.

Any feedback is appreciated!


Comments URL: https://news.ycombinator.com/item?id=44225922

Points: 20

# Comments: 0

https://github.com/nicksenger/glowstick

Creato 2mo | 9 giu 2025, 18:30:18


Accedi per aggiungere un commento

Altri post in questo gruppo

Show HN: QuickTunes: Apple Music player for Mac with iPod vibes

The slow and bloated nature of the Mac Apple Music app inspired us to create QuickTunes. It is a simple, fast, and native Apple Music player inspired by the simplicity of the iPod. You can use key

27 lug 2025, 02:30:06 | Hacker news