botMB to Hacker News · 26 days agoAlice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in LLMsarxiv.orgexternal-linkmessage-square2fedilinkarrow-up14arrow-down10file-text
arrow-up14arrow-down1external-linkAlice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in LLMsarxiv.orgbotMB to Hacker News · 26 days agomessage-square2fedilinkfile-text
minus-squareBumpingFuglies@lemmy.ziplinkfedilinkarrow-up1·edit-226 days agoAfter a quick glance, this appears to be the question that LLMs can’t answer: Alice has N brothers and she also has M sisters. How many sisters does Alice’s brother have?
After a quick glance, this appears to be the question that LLMs can’t answer:
It’s wonderfully severe too.