I was walking around New York last month during some light rain and noticed about half the people had umbrellas open. When the rain picked up a few minutes later, that number jumped closer to 80%.
It got me thinking it'd be cool to track this somehow, so I built a website! I am taking a sidewalk livestream, feeding it into a YOLO model for people tracking, then sending a frame of each detected person to Gemini 2.0 Flash, which returns structured JSON about each person's clothing and if they're holding an umbrella. I also had fun making the site look like a TV weather channel.
I showed some friends this project and someone mentioned how the legendary Tasks xkcd comic (https://xkcd.com/1425) is out of date now. If you want to check whether a photo has birds in it (or if someone is holding an umbrella), you can just ask an inexpensive vision model for JSON.
Comments URL: https://news.ycombinator.com/item?id=44357391
Points: 32
# Comments: 2
Connectez-vous pour ajouter un commentaire
Autres messages de ce groupe

Article URL: https://xbow.com/blog/top-1-how-xbow-did-it/
Comments URL: ht

Article URL: https://techcrunch.com/2025/06/24/a-f

Article URL: https://arxiv.org/abs/2506.18899
Comments URL: https://news.ycombinator.c

Hey HN, I’m Ayush from Autumn (https://useautumn.com/). Autumn is an open source layer over Stripe that decouples pricing and billing logic from your applicati