I was walking around New York last month during some light rain and noticed about half the people had umbrellas open. When the rain picked up a few minutes later, that number jumped closer to 80%.
It got me thinking it'd be cool to track this somehow, so I built a website! I am taking a sidewalk livestream, feeding it into a YOLO model for people tracking, then sending a frame of each detected person to Gemini 2.0 Flash, which returns structured JSON about each person's clothing and if they're holding an umbrella. I also had fun making the site look like a TV weather channel.
I showed some friends this project and someone mentioned how the legendary Tasks xkcd comic (https://xkcd.com/1425) is out of date now. If you want to check whether a photo has birds in it (or if someone is holding an umbrella), you can just ask an inexpensive vision model for JSON.
Comments URL: https://news.ycombinator.com/item?id=44357391
Points: 32
# Comments: 2
Login to add comment
Other posts in this group
Article URL: https://xtool.sh/tutorials/xtool/first-app/
Comments URL: http
Did you know that VSCode extensions run with full access to your system—including file system, network, and credentials? Worse, dozens of malicious extensions have already made it into the marketp
Article URL: https://www.barchart.com/story/news/33003
Article URL: https://github.com/microsoft/edit
Comments URL: https://news.ycombinator
