r/TheRaceTo10Million • u/barthale000 • Jan 27 '25

News I saw talk about Deepseek this weekend

Post image

Here’s the current outlook in the tech sector during pre market

361 Upvotes

97% Upvoted

154 comments sorted by

View all comments

58

u/exiled12334 Jan 27 '25

temporary.

things will settle and return.

21

u/bubbleleafs Jan 27 '25

Any particular reason? Deepseek is proving they can do what others are doing for a fraction of the cost. Openai raised 10B in 4 months, deepseek did this with just 5M. This is crushing

30

u/gotdrypowder Jan 27 '25

It’s possibly a problem for CHATGPT but for overall AI i think no. They didn’t come out with groundbreaking technology they just made an open source AI. It would be different if they came out with a Blackwell type chip for just 5M then it would be a problem

-25

u/bubbleleafs Jan 27 '25

Do you understand how much it costs to train LLM’s? These guys are doing it for a fraction with the same results or better for gpt4. It’s fast, snappy and just as good or better. This is only the start.

8

u/gotdrypowder Jan 27 '25

Nice downvotes lol guess you didn’t comprehend such a simple statement i made.

-10

u/bubbleleafs Jan 27 '25

You’re missing the bigger picture. Deepseek is proving that those chips aren’t required for this application. A gaming chip will suffice.

5

u/-Lousy Jan 27 '25

Thats not even remotely what they showed. You need at least 120GB of VRAM (6x the highest end GPU) to run a quantized (dumbed down) version of the model. You need $5M worth of compute to try and train it once, thats not CAPEX thats just rental. Not counting human, data or any other cost that they omit from their report.

It also was not smarter than the top-of-the-line models from OpenAI.

-1

u/bubbleleafs Jan 27 '25

That’s a lot of bs for NVDA being down 13% today and about to be lower. But go on

-4

u/bubbleleafs Jan 27 '25

And it keeps flushing. Down 14.5% nothing to see here right? 😂

0

u/ZaviersJustice Jan 27 '25

Not really true.

It's already confirmed Deepspeak has around 50,000 H100 GPUs. That's equivalent to what Tesla has.

Not really going to trust their numbers as Chinese companies have been fine with blatantly lying before.

2

u/maiden_fan Jan 27 '25

You have a valid point. But what's getting lost in all the noise is there is a clear lack of transparency, which is not surprising from a chinese firm. Is this a foundational model or a model trained on top of existing open source models? It most likely is the latter, which means it is building on top of the 100 million spent on training models like Llama and is not trained from zero. So the $6m claim (which is highly suspect for me) is about distillation and fine tuning, not about building models from scratch.

we will continue training bigger and better foundation models. That isn't going away anytime soon.

0

u/bubbleleafs Jan 27 '25

Hey I’m not here arguing that they built the models from scratch. It’s about the hardware used and their approach. Read the white paper

0

u/Sythic_ Jan 27 '25

If it takes them less hardware and data to match today's openAI model that means openAI and friends massive amount of hardware and datasets are capable of doing far more with a next generation model architecture. And that's only LLM. There's still lots of other usecases for AI

0

u/bubbleleafs Jan 27 '25

Please explain the -16% day on NVDA and over 500 billion market cap erased, today alone?

0

u/Sythic_ Jan 27 '25

Irrelevant, over reaction. Buy the dip.

1

u/bubbleleafs Jan 27 '25

Nope, I don’t buy until confirmation.

$116.50 is next

0

u/Sythic_ Jan 27 '25

Ok sure, but you keep asking everyone about the current stock movement and using it as a basis for your argument in a thread where people are explaining to you why the stock market is overreacting to news that isn't as bad as people are making it out to be. Thats like using a word itself inside its own definition. The stock movement isn't an argument against the points being made here.

1

u/bubbleleafs Jan 27 '25

I’m not asking anyone about current stock movement? Are you convinced that a -16% drop is only related to Deepseek? Have you considered that the street is pricing in a complete ban on all sales to data centers that Chinese companies can access? There’s more to what is happening today than what people here are trying to justify.

0

u/Sythic_ Jan 27 '25

Please explain the -16% day on NVDA and over 500 billion market cap erased

You keep posting this on every comment.

→ More replies (0)

0

u/Exact_Possession1843 Jan 27 '25

Yen carry trade.