Was starting to mess around with the latest LLM models and found that they're not great at counting lines in files.
I gave Gemini 2.5 flash a python script and asked it to tell me what was at line 27 and it consistently got it wrong. I tried repeatedly to prompt it the right way, but had no luck.
https://g.co/gemini/share/0276a6c7ef20
Is this something that LLM bots are still not good at? I thought they had gotten past the "strawberry" counting problems.
Here's the raw file: https://pastebin.com/FBxhZi6G
Comments URL: https://news.ycombinator.com/item?id=44176179
Points: 8
# Comments: 7
Melden Sie sich an, um einen Kommentar hinzuzufügen
Andere Beiträge in dieser Gruppe
Article URL: https://codeberg.org/CipherNomad/Ariadne
Comments URL: https://ne
Article URL: https://leetsys.dev
Comments URL: https://news.ycombinator.com/item?id=44352430
Article URL: https://philarchive.org/archive/SCHAIM-14
Comments URL: https://
Article URL: https://isle.pizza
Comments URL: https://news.ycombinator.com/item?id=44351028
Article URL: https://arxiv.org/abs/2506.14364
Comments URL: https://news.ycombinator.c
Article URL: https://github.com/sdzx-1/polystate
Comments URL: https://news.ycombin
