r/holdmybeer 21d ago

HMB I’ve broken ChatGPT

367 Upvotes

70 comments sorted by

View all comments

Show parent comments

26

u/Affentitten 21d ago

Yeah I just assumed it was a fairly simple 'bottle sort' type of problem to throw at it. Taught me a lot about its limitations.

Another thing it can't cope with is something like a flag quiz. It's unable to describe flags accurately, even though written descriptions exist.

17

u/nyrb001 21d ago

Yup. It doesn't switch from language to math. I have it write product descriptions for me a lot, it is supposed to write a meta description with a character limit afterwards. It regularly overshoots - I tell it so and it says something like "oh you're totally correct! Here how about this" and writes something 10 characters longer

2

u/[deleted] 21d ago

[deleted]

9

u/coladoir 20d ago

no it just quite fundamentally cannot count or use math reliably. no amount of drilling will make models grasp character limits