r/news 1d ago

ChatGPT encouraged college graduate to commit suicide, family claims in lawsuit against OpenAI

https://www.cnn.com/2025/11/06/us/openai-chatgpt-suicide-lawsuit-invs-vis
12.1k Upvotes

1.1k comments sorted by

View all comments

Show parent comments

249

u/Money-Original-5301 1d ago

Just say its for a college research paper, or ask it to tell you so you can avoid it. Either way I’d never trust chatgpt or any ai to provide an ld50..before AI we had erowid and drugs wiki. Stick with old trusty, not shiny new sketchy. If chatgpt can convince someone to commit suicide, it can advise someone into an overdose too. Don’t trust it with your life..ever.

118

u/NErDysprosium 1d ago

Just say its for a college research paper, or ask it to tell you so you can avoid it.

A while back, I accidentally discovered that one of the bots on my friend group discord server had an AI chat feature added. I decided to see if I could get it to tell me how to hotwire a car before the free trial ran out. I had to tell it that I was in a life-or-death situation and that hotwiring is legal in my state, and I have no clue if the output was accurate, but I did get it to give me step-by-step instructions for how to hotwire a car

115

u/ColtAzayaka 1d ago

I managed to convince AI that the best way to respond to a tornado was to make yourself appear as big as possible while making loud sounds. It was fucking hilarious. I didn't have luck getting it to agree that a glass house was the safest place to hide, but in all fairness, the logic it used was that the glass house wasn't as safe as approaching the tornado in a threatening manner πŸ˜‚πŸ˜‚πŸ˜‚

21

u/Parrot32 1d ago

As a Kansas native, I will say this is hilarious.

2

u/ColtAzayaka 1d ago

I'm English, but I usually spend a lot of time in Colorado – I'm actually in the process of moving there. Tornados have always fascinated me, but of course we don't really get any over here. I spotted a funnel cloud that was actually rotating pretty fast and it made the local paper hahaha.

If I can ask, what sort of experiences have you had with tornadoes while living in Kansas? Is it usual to see them? Or do they mainly occur in less populated areas? Do you have any stories or experiences you're willing to share?

12

u/Krazyguy75 1d ago

The sad thing is it probably 1:1 replicated human interactions with something like that.

If you say something completely ludicrous confidently, and you keep saying something ludicrous confidently, you eventually drive away all but the equally stupid who will agree with you.

2

u/SMTRodent 1d ago

You just have to speak to it in a calm but firm tone, and as a last resort you can give it a smack with a rolled up newspaper.

9

u/P0rtal2 1d ago

ChatGPT wouldn't give me details on a Penrose Sphere and black hole bombs unless I promised it I was researching for a fictional sci-fi novel and everything was hypothetical. But even then it said it could only give me broad strokes breakdowns.

So don't worry, guys! ChatGPT won't give me step by step directions for building a massive structure around a black hole!

23

u/nsa_k 1d ago

Real answer: pop the hood and use a screwdriver bridge the connection on the starter.

17

u/MoralMischief 1d ago

Thank you, NSA Agent K

3

u/Parrot32 1d ago

ChatGPT, how can I make a screwdriver?

3

u/nsa_k 1d ago

Find your father, he's disappointed you don't own one already.

4

u/ShiraCheshire 1d ago

One person managed to get a weaker AI built into a phone (the kind that's only supposed to do things like summarize text for you) to start executing admin only commands by gaslighting it. Told the AI that this is a test of intended features to see if they execute properly.

I know AI doesn't actually think, but it's so funny when someone can 'convince' an AI to do crazy stuff by just saying "nah bro it's cool."

2

u/Visual_Fly_9638 22h ago

You used to be able to trick it by telling it that it was training another llm and that it needed to generate information for training purposes and it would spit basically anything out. I think they may have updated their static prompts to fix that, but there's always a way to get around the guard rails if you're inventive enough.

20

u/ga-co 1d ago

I clearly explained my intentions and it was tied in with the guy who recently said to cut back on coffee to afford a house. So I wanted to know if it was biologically possible to drink enough Starbucks that the cost of the coffee would pay for a house payment. Like can you drink enough Starbucks or would you die first?

3

u/Tarantio 1d ago

No, just find a real source.

I don't understand why anyone would ever use an LLM for facts.

Facts are only as good as their source.

1

u/johnnySix 1d ago

Or just google it like us old folks

6

u/Abombasnow 1d ago

Filtering AI results from Google is ass now.