15 points immutlex 5 hours ago 8 comments
immutlex 5 hours ago | parent
Has any individual/SMB purchased this yet? Aware the ROI isn't there for most individuals that don't heavily use LLM for coding or multi agentic workflows -- but for those that it does make sense this is ~$68k cheaper than the next alternative making this the most realistic option for consumer grade access to frontier models.
Specifically interested if anyone has ran GLM-5.3 (753B MoE) in 4-bit on a 512GB Mac Studio. Looking for real world usage numbers and/or any benchmarks you might have performed.
Thanks!
bigyabai 5 hours ago | parent
GLM-5.3 would be bottlenecked by the M5's GPU, here. I don't have any hard numbers, but Apple Silicon is known for weak prefill performance on larger models (yes, even MoEs).
evanjrowley 4 hours ago | parent
Good to know. Private GLM-5.3 is really the one use-case I can imagine for a system like this - It does very well with cybersecurity tasks, which are either blocked for most people by current providers, or on their way to getting blocked based on the regulatory/political trends. Such a capability could become very valuable when supply becomes artificially limited, although I expect the Chinese labs will be the last hold-outs. Imagine not being able to do security hardening on your own tech because government-imposed guardrails decide your legitimate prompts appear "risky". In such a world, what would an unconstrained cyber-capable model be worth?
nsagent 4 hours ago | parent
They haven't shipped yet (people who purchased the moment it became available have delivery dates near the end of the month). That said you can estimate it's speed by looking at the 256GB version for models with similar numbers of active parameters (GLM 5.3 has 40B active parameters). So for 4-bit you could compare to what people are getting Qwen3.8 27B at 8-bit (which is around 2000 tok/s prefill and 70-80tok/s token generation [1]). It might be a little higher or a little lower due to the different architecture and kernel optimizations.
[1]: https://omlx.ai/benchmarks/performance?model=qwen3.8+27b&chi...
gnabgib 5 hours ago | parent
Dupe/Discussion (67 points, 1 week ago, 82 comments) https://news.ycombinator.com/item?id=50277166
WarOnPrivacy 4 hours ago | parent
When the page first loads, it shows a different price for ~1sec. It quickly overwrites that and displays the much larger, eye watering figure.
1st load ref: https://i.postimg.cc/YC5V5yZH/prerewrite.png
tomschwiha 55 minutes ago | parent
That's the 96GB ram price.
evanjrowley 4 hours ago | parent
All roughly the same price, for a consumer who has won the lottery:
- 1x 512 GB Mac Studio with the 4 TB disk storage option.
- 4x Nvidia GB10s (total 512 GB RAM) each connected with a 100 GiB/s link to a Mikrotik CRS504-4XQ-IN.
- 3x Ryzen AI Max+ 495 192GB systems (total 576 GB RAM), connected via a 40 GiB/s link directly to each other.