Was starting to mess around with the latest LLM models and found that they're not great at counting lines in files.
I gave Gemini 2.5 flash a python script and asked it to tell me what was at line 27 and it consistently got it wrong. I tried repeatedly to prompt it the right way, but had no luck.
https://g.co/gemini/share/0276a6c7ef20
Is this something that LLM bots are still not good at? I thought they had gotten past the "strawberry" counting problems.
Here's the raw file: https://pastebin.com/FBxhZi6G
Comments URL: https://news.ycombinator.com/item?id=44176179
Points: 8
# Comments: 7
Login to add comment
Other posts in this group
Article URL: https://arxiv.org/abs/2505.11614
Comments URL: https://news.ycombinator.c
![Louis Rossmann: We've started a foundation to bring back ownership [video]](data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAQAAAAEACAYAAABccqhmAAAACXBIWXMAAA7EAAAOxAGVKw4bAAAM+klEQVR4nO3dbUyV9R/H8c85cCAQnMhsGlmJrXKAcyhmzZbdbfSgelbLZpqxcibOxpZ3LQ1mSKGtU7amy6XGIlf0wKW5Vjyg1YrpeiDLudGNtEFyl9zDOZzr/yhW/f/tL/DLc67zfb82njj58sXhW6/rXNd1Aj09PZ4AmBSM9wIA4ocAAIYRAMAwAgAYRgAAwwgAYBgBAAwjAIBhBAAwjAAAhhEAwDACABhGAADDCABgGAEADCMAgGEEADCMAACGEQDAMAIAGEYAAMMIAGAYAQAMIwCAYQQAMIwAAIYRAMAwAgAYRgAAwwgAYBgBAAwjAIBhBAAwjAAAhhEAwDACABhGAADDCABgGAEADCMAgGEEADCMAACGEQDAMAIAGEYAAMMIAGAYAQAMIwCAYQQAMIwAAIYRAMAwAgAYRgAAwwgAYBgBAAwjAIBhBAAwjAAAhhEAwDACABhGAADDCABgGAEADCMAgGEEADCMAACGEQDAMAIAGEYAAMMIAGAYAQAMIwCAYQQAMIwAAIYRAMAwAgAYRgAAwwgAYBgBAAwjAIBhBAAwjAAAhhEAwDACABiWGu8FcPV1d3erv78/3mv8RSAQmPgIBoMTH6mpqUpNTVUoFJr4gDtJG4ChoSGNjY1Na8aMGTOS8geusrJSx44di/caE/78lz4lJUVpaWlKS0tTenq6srKyNGPGDM2cOVM5OTnKzc3VDTfcoJtuukm33nqr5s6dO/H7A4FAvL8V30nKAESjUW3evFkNDQ1TnhEKhfTee+/pwQcfdLgZ/hfP8zQ+Pq7x8XFFIhGNjIxc8efOmTNHhYWFWrZsme677z4VFxcrNTUpf6z/FZwDgK91dnaqsbFRr732mkpLS7V06VJVV1fr4sWL8V7NFwgAkkpbW5tqa2t17733qrKyUr29vfFeKaERACQdz/PU09OjcDisRx55RE1NTYrFYvFeKyERACStWCymc+fO6amnntKRI0emfVI4GREAJL2enh699NJLOnjwIBH4GwIAEwYHB1VTU6O6ujoOB/6EAMCMwcFB7dmzR01NTfFeJWEQAJjS09OjnTt3qqurK96rJAQCAHN++OEH7d27N95rJAQCAHM8z9Px48d19uzZeK8SdwQAJg0MDCgcDsd7jbgjADDrs88+U2tra7zXiCvumsCkBYNBlZeXa9WqVVP6fM/zJj5isdhfbgSKRCIaHh7W0NCQent71dLSogsXLujXX3/V8PCw0+9jbGxM9fX12r59u4JBm/8WEgBMWiAQ0KJFi3T33Xdfla/X3d2t5uZm1dfX64svvtDg4KCz2adOndLzzz+vzMxMZzP9xGb24Cu5ubkqLS3VoUOHdODAAS1YsMDZ7PPnz+uXX35xNs9vCAB8IxQK6eGHH9bRo0eVn5/vZGYsFtM333zjZJYfEQD4TkFBgd59911lZWU5mXf27FmzlwcTAPhSUVGRysrKnMxqa2tzfoLRLwgAfCkYDOrpp5928szGS5cuTeoxZMmEAMC38vLytGTJkmnP+f333xWJRBxs5D8EAL62dOnSac8YHh7W+Pi4g238hwDA166//vppPw58fHxcnuc52shfCAB8LTMzc9oBCIVCZq8EtPldI2mMjIxM+1/v9PR0AgD4UW9v77QDkJOTk5TvAHUlCAB8raWlZdoz5syZo/T0dAfb+A8BgG+Njo6qubl52nPmz5+vjIwMBxv5DwGAb3355Zfq7Oyc9pzFixcrJSXFwUb+QwDgS/39/XrzzTenPScYDGrFihUONvInAgDfiUQiOnTokL799ttpz1q4cKEWLlzoYCt/4oEg8JWxsTEdO3ZM+/btc3LxTmlpqdnjf4kAwEd+++03VVdX64MPPnBy7X4gENCaNWvMXgMgEQAkMM/z1NHRoZaWFp06dUoNDQ26fPmys/kPPfSQbr75Zmfz/IgAYNI8z1NTU9OU76GPxWKKRqOKRqMaGxvT6OioRkZGNDAwoL6+PvX29qqzs1MdHR0aGBjQ2NiY8zf1zM7OVkVFhdOZfkQAMGmxWEx1dXWqq6uL9ypTkpKSovXr16uwsDDeq8Sd3YMfmLVs2TJt2rRp2jcRJQMCAFPy8/NVXV2t3NzceK+SEAgAzMjLy9Mrr7zi5ClCyYJzADAhLy9Pr7/+uu6///54r5JQCACSXlFRkd5++20VFBTEe5WEwyEAklYoFNKWLVt08uRJ/vL/A/4HgKSTlpamBx54QFu2bNGSJUvM3ul3JQgAksbcuXN1zz33aPXq1SouLjZ9jf+VIgDwrVAopLy8PN12220qLS3VnXfeqRtvvNHs472mggDAN4LBoPLz81VYWKjCwkIVFxdrwYIFysvLU2oqP8pTwZ8afCMYDGrRokV64YUXdMstt5i+i88VAoApyczMVFpa2l9+zfM8eZ6nWCw2ccNPJBJx9qYb0WhUJ06cUHNzs7Zs2aJ169b91w6YHAKASUtJSdH+/fv16KOPTvya53mKRqMaGRlRf3+/ent71d7ertbWVp05c0aNjY3q7u528vU7Ojq0Y8cONTY2KhwOa86cOU7mWkQA4EQgEFAoFFIoFFJ2drauu+46FRQUTFx5NzAwoI8++kjhcFg///zztL9eLBbT6dOntWrVKr3zzjtauXIlN/dMAQdRuCqysrK0du1affrpp3riiSecvTbf3t6uJ598Uu+//77Zd/idDgKAqyYQCGjevHnau3evtm3b5uzlusuXL2v79u06cOCARkdHncy0ggDgqpsxY4bKy8u1detWZ/8TGBoaUm1tLRGYJAKAuEhLS1N5ebkef/xxZy/nDQ0Naf/+/Tp8+LDGx8edzEx2BABxEwqFVFlZqZKSEmcn8IaGhlRTU6OTJ086mZfsCADiatasWaqtrdXcuXOdzezr69O2bdt0/vx5ZzOTFQFA3BUUFGjnzp265pprnM1sb2/Xxo0bOR/wfxAAJITHHntMq1evdjrz+++/1+7duxWNRp3OTSYEAAkhJSVFFRUVKi4udjr38OHDOn36tLPLkZMNAUDCmDdvnl588UXNmjXL2cxIJKLdu3c7ufowGREAJJSVK1fq2WefdXpZb2trq2pra6f8TkbJjAAgoaSmpqqsrEwrVqxwOveTTz7RiRMnOBT4GwKAhJObm6uXX35Z2dnZzmaOjIxo//79+umnn5zNTAYEAAmpuLhY5eXlTmdeuHBB4XCYVwX+hAAgIQWDQW3evFmLFy92Ovfjjz/W559/7nSmnxEAJKy0tDSFw2GnhwKDg4Oqqqpy9nASvyMASGhFRUUqLy93+tDPPw4FQACQ4AKBgJ555hndfvvtzmbGYjEdOXJEZ86ccTbTr3gk2D/wPE/nzp1TZmZmvFf5v/Lz8zV//vx4r/GvmTlzpnbu3Kl169bp0qVLTmb29fVp165damhoMP1gUQLwD6LRqKqrq+O9xhWpqqrSc889F+81/lXLly9XWVmZXn31VWdn8b/++mvV19drzZo1Zp8nyCEAfCEYDGr9+vW64447nM6tqalRW1ub05l+QgDgG7Nnz9aOHTuUm5vrbGZ7e7tqa2vN3jZMAOArJSUl2rhxo9OZH374oZqampzO9AsCAF8JBoMqKyvTXXfd5WxmJBJRZWWlsxOMfkIA4DvZ2dmqqqrSzJkznc1saWnRwYMHFYvFnM30AwIAXyosLFRFRYWzeZ7n6ejRo/ruu++czfQDAgBf+uNQwOUFQl1dXdq3b5/6+/udzUx0BAC+lZGRoT179ignJ8fZzK+++krHjx93Ni/REQD4WnFxsTZs2ODsXoHR0VG99dZbZp4bQADgexs2bNDy5cudzbt48aJqa2tNnBAkAPC97Oxs7dq1y9kFQp7nqaGhQY2NjU7mJTICgKRQUlKiTZs2OXufwdHRUW3dujXpHyRKAJA01q5dq1WrVjmb9+OPP+qNN95I6kOBQE9PT9I9JtXzPHV1dWlwcDDeq1wVs2fPntRFMd3d3dN6qSsQCCg3N1dZWVlTnvFv6enpUV9fn7N5GRkZuvbaa5P2bsGkDACAK8MhAGAYAQAMIwCAYQQAMIwAAIYRAMAwAgAYRgAAwwgAYBgBAAwjAIBhBAAwjAAAhhEAwDACABhGAADDCABgGAEADCMAgGEEADCMAACGEQDAMAIAGEYAAMMIAGAYAQAMIwCAYQQAMIwAAIYRAMAwAgAYRgAAwwgAYBgBAAwjAIBhBAAwjAAAhhEAwDACABhGAADDCABgGAEADCMAgGEEADCMAACGEQDAMAIAGEYAAMMIAGAYAQAMIwCAYQQAMIwAAIYRAMAwAgAYRgAAwwgAYBgBAAwjAIBhBAAwjAAAhhEAwDACABhGAADDCABgGAEADCMAgGEEADCMAACGEQDAMAIAGEYAAMMIAGAYAQAMIwCAYQQAMIwAAIYRAMAwAgAYRgAAwwgAYBgBAAwjAIBhBAAw7D8VqG3ZJmU3IwAAAABJRU5ErkJggg== "Louis Rossmann: We've started a foundation to bring back ownership [video]")
Very small, curated community posting thoughtful political, general, arts, gaming, etc news (specifically not just tech and “nerd” focused) that has some level of commenting functionality?
I LOV
Article URL: https://danq.me/2020/11/11/blink-and-marquee/
Article URL: https://www.folklore.org/Joining_Apple_Computer.html
Article URL: https://arxiv.org/abs/2503.05040
Comments URL: https://news.ycombinator.c
Article URL: https://www.coventry.gov.uk/coventry-light-rail
