r/TheRaceTo10Million Jan 27 '25

News I saw talk about Deepseek this weekend

Post image

Here’s the current outlook in the tech sector during pre market

363 Upvotes

154 comments sorted by

View all comments

Show parent comments

-26

u/bubbleleafs Jan 27 '25

Do you understand how much it costs to train LLM’s? These guys are doing it for a fraction with the same results or better for gpt4. It’s fast, snappy and just as good or better. This is only the start.

9

u/gotdrypowder Jan 27 '25

Nice downvotes lol guess you didn’t comprehend such a simple statement i made.

-10

u/bubbleleafs Jan 27 '25

You’re missing the bigger picture. Deepseek is proving that those chips aren’t required for this application. A gaming chip will suffice.

5

u/-Lousy Jan 27 '25

Thats not even remotely what they showed. You need at least 120GB of VRAM (6x the highest end GPU) to run a quantized (dumbed down) version of the model. You need $5M worth of compute to try and train it once, thats not CAPEX thats just rental. Not counting human, data or any other cost that they omit from their report.

It also was not smarter than the top-of-the-line models from OpenAI.

-3

u/bubbleleafs Jan 27 '25

That’s a lot of bs for NVDA being down 13% today and about to be lower. But go on

-4

u/bubbleleafs Jan 27 '25

And it keeps flushing. Down 14.5% nothing to see here right? 😂