Was starting to mess around with the latest LLM models and found that they're not great at counting lines in files.
I gave Gemini 2.5 flash a python script and asked it to tell me what was at line 27 and it consistently got it wrong. I tried repeatedly to prompt it the right way, but had no luck.
https://g.co/gemini/share/0276a6c7ef20
Is this something that LLM bots are still not good at? I thought they had gotten past the "strawberry" counting problems.
Here's the raw file: https://pastebin.com/FBxhZi6G
Comments URL: https://news.ycombinator.com/item?id=44176179
Points: 8
# Comments: 7
Login to add comment
Other posts in this group
We're launching SecureBuild: https://securebuild.com — a new way for open source projects and maintainers to earn revenue by partnering with an
Hi HN - we're Nithin and Nikhil, twin brothers and founders of nxtscape.ai (YC S24). We're building Nxtscape ("next-scape") - an open-source, agentic browser for the AI era.
-- Why bother buildi
Article URL: https://github.com/ebbejan/tux-racer-js
Comments URL: https://news
SnapQL is an open-source desktop app (built with Electron) that lets you query your Postgres database using natural language. It’s schema-aware, so you don’t need to copy-paste your schema or writ
