18 points rbanffy 1 hour ago 20 comments

Retr0id 48 minutes ago | parent

How many arms and legs does one of these cost?

shmoil 38 minutes ago | parent

3.14 kidneys.

theplumber 48 minutes ago | parent

>> 252GB of HBM3e at 7.1TB/s,

So it has only 256GB of actual ”AI” memory making it “useless”/toy for actual real world AI workloads(I.e it can’t replace something like opus 5)

kees99 24 minutes ago | parent

Should work just fine for MoE models where active set fits into 252GB.

theplumber 8 minutes ago | parent

Can’t you do that already more or less with a Mac Studio with 256 or better 512fb of ram?

fc417fc802 23 minutes ago | parent

I don't know about "useless" (it seems quite useful to me) but I do feel mislead. It's unified memory in the same way that my current dGPU has unified memory. I guess nvlink-c2c probably (?) doesn't introduce a bottleneck but it's still two distinct arenas with very different performance characteristics.

theplumber 4 minutes ago | parent

I find it just misleading by advertising 700GB RAM as AI headline. I could plug a 32GB GPU to my 1.5TB ram server and call it “AI station with 1.5TB+ RAM” just so that you find it actually useless compared to the headlone

varispeed 42 minutes ago | parent

Furious

What is it with those stupid names?

No price, so of course this is not for the smelly working class.

Egg-Man 41 minutes ago | parent

Imagine a beowolf cluster of these!

self_awareness 36 minutes ago | parent

I guess I'm too poor to even know the price

wolttam 33 minutes ago | parent

MSI’s DGX Station (what this is) was listed for $99K

chedabob 31 minutes ago | parent

Dell's equivalent starts at £180k.

dsrtslnd23 30 minutes ago | parent

252GB of HBM3e at 100k vs. a multi A6000 96GB setup. GB300 seem expensive in comparison at ~$100k. Am I missing something?

_diyar 17 minutes ago | parent

Without looking it up and doing the math, I bet GB300 has higher Tflops and memory bandwidth, especially when used with e.g. NVFP4.

dyzone 28 minutes ago | parent

But can it run crysis?

jareklupinski 20 minutes ago | parent

einpoklum 23 minutes ago | parent

Can I get 32 GB of RAM for a sane price instead?

fc417fc802 20 minutes ago | parent

> a Kensington slot

I think you might need a bit more than that at this price point ...