Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I find the thing incredibly smart and yet utterly useless at times.

I just spent 20 minutes getting the current iteration of ChatGPT to agree with me that a certain sentence is palindromic. Even when you make it print the unaccented characters one by one, spaces excluded, backwards and forwards, it still insists "Élu par cette crapule" isn't palindromic.

I understand how tokenization makes this difficult but come on... this doesn't feel like a difficult task for something that supposedly passes the LSATs and whatnot.

* French for "Elected by this piece of shit"



LLMs using BPEs are generally going to be bad at string reversal tasks, since they can't see individual letters: https://news.ycombinator.com/item?id=35297183


Just ask it to figure it out step-by-step and to remove accents:

GPT-4:

Figure this out step by step and check your work: Remove the accents and tell me if this a palindrome: Élu par cette crapule

GPT-3.5 (Needs to know that removing spaces and lowercasing is okay):

Figure this out step by step and check your work: Lowercase it and remove the accents and spaces and tell me if this a palindrome: Élu par cette crapule




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: