I was walking around New York last month during some light rain and noticed about half the people had umbrellas open. When the rain picked up a few minutes later, that number jumped closer to 80%.
It got me thinking it'd be cool to track this somehow, so I built a website! I am taking a sidewalk livestream, feeding it into a YOLO model for people tracking, then sending a frame of each detected person to Gemini 2.0 Flash, which returns structured JSON about each person's clothing and if they're holding an umbrella. I also had fun making the site look like a TV weather channel.
I showed some friends this project and someone mentioned how the legendary Tasks xkcd comic (https://xkcd.com/1425) is out of date now. If you want to check whether a photo has birds in it (or if someone is holding an umbrella), you can just ask an inexpensive vision model for JSON.
Comments URL: https://news.ycombinator.com/item?id=44357391
Points: 32
# Comments: 2
Ak chcete pridať komentár, prihláste sa
Ostatné príspevky v tejto skupine
Article URL: https://deno.com/blog/v2.4
Comments URL: https://news.ycombinator.com/item?id=4
Article URL: https://arstechnica.com/tech-policy/2025/07/xai-get
My washing machine broke down. I need a replacement. I must avoid getting a "smart" one though. Are there any lists of products that arent "smart" so I can know which models are viable options to
