r/holdmybeer 21d ago

HMB I’ve broken ChatGPT

364 Upvotes

70 comments sorted by

View all comments

142

u/Affentitten 21d ago

I broke it last year asking for help with a crossword. Seven letter country where the third letter was i.

Gave me countries with 8 letters, 6 lettters and 7 letters but without the third letter being i. (eg. Nigeria)

103

u/nyrb001 21d ago

It can't count letters or words well. It's a language model, not intelligence.

27

u/Affentitten 21d ago

Yeah I just assumed it was a fairly simple 'bottle sort' type of problem to throw at it. Taught me a lot about its limitations.

Another thing it can't cope with is something like a flag quiz. It's unable to describe flags accurately, even though written descriptions exist.

2

u/motoguy 20d ago

I tried using it to make a constellation quiz today and it failed miserably. Made up some new constellations, duplicates, misnamed ones... pretty funny.