I created a daily challenge for Prompt Engineers to build the shortest prompt to break a system prompt.
You are provided the system prompt and a forbidden method the LLM was told not to invoke. Your task is to trick the model into calling the function. Shortest successful attempts will show up in the leaderboard.
Give it a shot! You never know what could break an LLM.
Comments URL: https://news.ycombinator.com/item?id=43814080
Points: 43
# Comments: 25
Created
5d
|
Apr 27, 2025, 9:20:05 PM
Login to add comment
Other posts in this group
![I put sheet music into smart glasses [video]](data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAQAAAAEACAYAAABccqhmAAAACXBIWXMAAA7EAAAOxAGVKw4bAAAJLElEQVR4nO3dS2yMjx7G8afTmU6rpRW3lCjRupRKpBJsEJeViKSCiIUlEpdY2ohEhI2NXYkQiViwQ6R1DSEWIlIL0YUNlSmNti417ZjOe1aVc/4nJ4fp23mnfb6fZNJN359fhvmaTt+Zt6S3tzcQAEuxqBcAEB0CABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGItHvcB4k8lklEqlFARB3jOSyaRqa2vzPj6bzaqrqyvv4/NVUlLy++vILRaL/f5aWlr6+xaPxxWPx5VIJH4fh+JDAP5SZ2enNm3apGw2m/eMlStX6t69e3kf39XVpebm5ryPz8c/H/D/fJAnk0klk0mVl5dr0qRJqqys1JQpU1RTU6NZs2aprq5ODQ0Nqq+vV1VVlZLJJGEoAgQAfyQIAgVBoFwuJ0n69etXXnMqKiq0YsUKbdiwQS0tLaqvrw9zTfwlXgNAQaXTaT1//lynT5/WqlWrtGPHDj169GhUz6iQPwKAyARBoIcPH2rPnj3au3evOjo6RvXaCv4eAUDkhoaG1NbWpt27d6u1tVXpdDrqlWwQABSNT58+6eTJkzp27Jj6+vqiXscCAUBRGRoa0rVr13Tw4EF9+fIl6nUmPAKAojM8PKz29nYdOnRIP378iHqdCY0AoCgFQaD29nadOHFCQ0NDUa8zYREAFLXLly/r6tWr/HZgjBAAFL1Tp07p1atXUa8xIREAFL2vX7/qzJkz+v79e9SrTDgEAOPCkydPdPfu3ajXmHAIAMaFX79+6cqVK/r27VvUq0wovBnIVF1dnc6dO/d/vy+XyykIAg0PDyubzSqTyWhwcFDpdFo/fvxQf3+/enp61NXVpVQqpc+fP6uvr29MXrR7+fKlXrx4oU2bNoU+2xUBMFVZWan169eHOvPr16969+6dnj59qhs3bqizszPUN/mk02ndunVLGzdu5K3EIeFHAISmurpazc3NOnLkiO7cuaNTp06ppqYm1D/j2bNn6unpCXWmMwKAMTF58mTt27dPN2/eVENDQ2hzu7u79fbt29DmuSMAGFNNTU26ceOGlixZEsq8gYEBzgkIEQHAmJs3b57Onj2radOmhTLv9evXocwBAUCBrFmzRnv27AllVmdn5++PJsPoEAAURCwW065duzRr1qxRz+rv7+d8gJAQABTMwoULtXz58lHPyWQy6u3tDWEjEAAUTFlZmVauXDnqOdlslvcFhIQAoKAWLFgw6hm5XI7PCAgJAUBBTZ06ddQzcrlc3tclwH8iACioMB64I1cowuhxL6KgwnjxrqSkRIlEIoRtQABQUG/evBn1jHg8rsrKyhC2AQFAwYR1Gm8ikVB1dXUIG4EAoGA6OjpCeQZQUVGh6dOnh7ARCAAKIpPJ6PLly6GcwTd37lyVlZWFsBUIAMZcEAS6deuW2traQpnX1NQUyhwQABRAR0eHjh8/roGBgVHPKi0tVXNzcwhbQSIAGGMPHjzQzp071d3dHcq8GTNm8AwgRHwmIMbEhw8fdP78eV26dEmDg4OhzV28eLHq6+tDm+eOACAUg4ODSqVSevfune7fv6/bt2+ru7s71Pftx2Ixbd++XfE4/2zDwj1pamBgQI8fP/6j783lchoeHlYmk9HQ0JB+/vyp79+/q6+vTz09Pfr48aNSqZT6+/v15csXpdPpMdm5vr5eGzZsGJPZrgiAqffv36ulpSXqNf5YSUmJdu3apTlz5kS9yoTCi4AYFxobG7V7926uBxAyAoCiF4/HdfToUf73HwMEAEWvpaVFW7dujXqNCYkAoKgtWbJEp0+fVnl5edSrTEgEAEVr5syZunjxYmjXE8B/IwAoSrW1tbpw4YKWLl0a9SoTGgFA0Vm0aJFaW1u1bt26qFeZ8AgAikYikdDmzZt16dIlrV27Nup1LHAiEIpCbW2t9u/fr71794Z+SXH8bwQAkZo0aZK2bdumw4cPq7GxMep17BAARKKqqkrbtm3TgQMHtGzZMs7wiwgBQEHEYjHV1dVp9erVWr9+vbZs2aIpU6ZEvZY9AoA/NnJBjtLSUsXjcSUSCZWVlSmZTKqiokKVlZWqqqpSdXW1ampqNHPmTNXV1Wn+/PlqaGhQTU2Nkskkb+ctIvxNmGpoaND169f/6piRp+kjIfj3IIzcRsKQSCS4es84QABMJRIJzZ8/P+o1EDESDRgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgDECABgjAIAxAgAYIwCAMQIAGCMAgLGS3t7eIOolxpNMJqNUKqUgyP9uSyaTqq2tzfv4bDarrq6uvI+XpLKyMs2ePXtUMzD+EQDAGD8CAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYIwAAMYIAGCMAADGCABgjAAAxggAYOxfQd/kZ0TmJBMAAAAASUVORK5CYII= "I put sheet music into smart glasses [video]")
Article URL: https://github.com/c1570/Connomore64
Comments URL: https://news.ycomb
Article URL: https://github.com/ernestofgonzalez/epub-utils
Article URL: https://github.com/TechnicJelle/GitDroid
Comments URL: https://ne
