97 points notfried 2 hours ago 74 comments
cyberpunk 1 hour ago | parent
newsclues 1 hour ago | parent
ComputerGuru 1 hour ago | parent
close04 25 minutes ago | parent
The ECC in DDR5 is on-die ECC and that's not "real" ECC, it's what DDR5 needs to not fail. Side-band ECC is the standard method, employing extra memory chips and 72bit memory. OEMs mix these in the marketing materials to fool the users into thinking they buy the better option.
ComputerGuru 12 minutes ago | parent
bel8 1 hour ago | parent
Mashimo 56 minutes ago | parent
aeyes 40 minutes ago | parent
snowram 25 minutes ago | parent
cosmic_cheese 22 minutes ago | parent
It’s nice for games but I don’t really care for productivity use. In fact in that situation I’d take integer-scaled HiDPI density over refresh rate in that scenario.
cbg0 17 minutes ago | parent
dopa42365 17 minutes ago | parent
Xeoncross 1 hour ago | parent
The generation doesn't mater as much to me as the memory bandwidth. When that day comes, I'd rather have a M1 Max 64GB over a M5 Pro 64GB.
apples_oranges 1 hour ago | parent
wslh 1 hour ago | parent
I am one of those: bought the M1 Max with 64gb thinking in running VMs, afterward bought a lighter Air with less memory and ended up using the M1 Max as a kind of luxury for LLMs and multicore computing.
mikae1 1 hour ago | parent
The only hope we have is the AI bubble bursting, but that will undoubtedly come with its own set of macroeconomic surprises.
colechristensen 57 minutes ago | parent
bilbo0s 1 hour ago | parent
I don't know man?
The generation kind of does matter. I'm not gonna lie, matrix multiplication units speed things up considerably. That hardware confers a material change in capability.
Maybe from M5 up, it doesn't matter? But you're definitely going to notice the difference between M1 and M5 for instance.
bitexploder 55 minutes ago | parent
And now if you stretch you can run DeepSeek Flash 4.1.
And if you were willing to roll up your sleeves you could build your own AI lab at home and run this model and models like GLM Flash 5.3 and DeepSeek Flash V4.1 at lower quants. The budget GPUs (like V100) are kind of not budget now, but still <5K to acquire 128GB of fast VRAM that can compete with a 5090 and actually has a lot more interesting options available IMO.
jonatron 49 minutes ago | parent
jmkni 40 minutes ago | parent
bitexploder 34 minutes ago | parent
bitexploder 36 minutes ago | parent
Dense models also don't like quantization as much and are less tolerant of it. There are some very interesting smaller models like https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4... Dory that I would check out. You need system RAM or to stream a larger MoE model from disk and it won't be fast. You need to specialize the models some to get quality results if you have very limited system resources.
origini 34 minutes ago | parent
It will show you on the model selection IF a model fits and if you use a "Qwen 3.8-35B-A3B" type of model, it should just work out of the box. A3B stands for Active which means you need a lot less fast ram.
You will run into issues fast though: If you have big tasks for it to do, your pc/mac will get warm very fast and noisy and you will cosume relevant more energy.
And as you mention: yeah small context!
Its still not that practical in my opinion.
Grombobulous 27 minutes ago | parent
https://github.com/Niko1221/Strata/
My setup is a Ryzen 3600, 90GB DDR4 allocated to a VM (don’t even really need that much, just had it available, special thanks to the year 2024), and an RX 9060XT 16GB ($500 GPU).
I get around 40-60 tok/s depending on the quantization level I choose.
As you can see, the CPU is nothing special, don’t even need DDR5.
brandall10 51 minutes ago | parent
So it depends on what you're doing. Using it for a fun oracle without feeding it too much context per turn? Sure, an older Max chip is great.
As a coding agent doing meaningful work on a sizable project? Compared to a cheap as chips cloud option, it will take an order of magnitude more time to complete.
johng 44 minutes ago | parent
It feels just as fast as day 1 and I've never had any speed issues. Say what you want about Apple and their pricing and ecosystem but I've been using their hardware for over 20 years now and it's always been top notch.
If you buy their support/AppleCare, your support and warranty is excellent too. They don't skimp. I've seen them go so far past the extra mile it's unreal.
dirtbag__dad 35 minutes ago | parent
kilroy123 34 minutes ago | parent
alasano 20 minutes ago | parent
Definitely grabbing 128 GB + for the next machine.
origini 39 minutes ago | parent
Isn't it also rumored that the M7 is reworked for AI?
And Xiaomi announced their AI Cube with 1.2t of bandwidth. Just because Nvidia is protecting its business by giving consumers either compute or bandwidth and Apple being something in between, doesn't mean we can't get both a lot better balanced.
vadansky 34 minutes ago | parent
alasano 22 minutes ago | parent
I'm gonna max out most of the specs on the next one I get, would feel insanely wasteful to do that now.
HelloUsername 1 hour ago | parent
ex1fm3ta 1 hour ago | parent
Aurornis 51 minutes ago | parent
Though I have had good results buying 1-2 generation old refurbished Macs as my secondary machines or for family members who don’t need cutting edge everything.
It’s even more valuable now that Apple silicon of every generation is more than enough to run every non-power user use case short of newer video games.
declan_roberts 50 minutes ago | parent
random__duck 8 minutes ago | parent
ex1fm3ta 1 hour ago | parent
phgn 1 hour ago | parent
ale 1 hour ago | parent
mdasen 1 hour ago | parent
eddieroger 47 minutes ago | parent
saysjonathan 44 minutes ago | parent
0: https://www.ifixit.com/Teardown/iMac+Intel+27-Inch+EMC+2309+...
1: https://www.ifixit.com/Teardown/iMac+M3+24-Inch+Teardown:+Ap...
synchrone 1 hour ago | parent
https://www.apple.com/shop/product/mxk53am/a/magic-mouse-usb...
jtbaker 57 minutes ago | parent
everdrive 1 hour ago | parent
anentropic 55 minutes ago | parent
spider-mario 47 minutes ago | parent
sscarduzio 43 minutes ago | parent
stirlo 1 hour ago | parent
cosmic_cheese 27 minutes ago | parent
It’s too bad. A high end iMac still holds a lot of appeal, especially for those seeking clean desk setups. I’m using an MBP hooked up to dual monitors through a dock right now and it’s fine, but I do miss how clean my desk was back when it was a VESA mounted iMac Pro and companion monitor.
booty 21 minutes ago | parent
the iMac returned to its roots as the “family computer” or “grandma email box” kind of machine.
And receptionists! Don't forget receptionists. :)cosmic_cheese 16 minutes ago | parent
booty 5 minutes ago | parent
What's the appeal there? Doing big-RAM-requirement stuff that just won't run on a laptop?
booty 24 minutes ago | parent
24" is a good size for casual users which is the main market. You can have two roomy-ish GUI apps (two web pages, etc) side by side.
hyperbovine 19 minutes ago | parent
bitexploder 1 hour ago | parent
zf00002 36 minutes ago | parent
geff82 56 minutes ago | parent
Aurornis 53 minutes ago | parent
This has been reported for many months. Sorry if you missed the news, but if you need a much higher memory variant the M5 Pro/Max are what’s available this cycle.
iAMkenough 47 minutes ago | parent
verdverm 38 minutes ago | parent
jmull 41 minutes ago | parent
sharts 14 minutes ago | parent
tempodox 13 minutes ago | parent
wiether 12 minutes ago | parent
I would love to have a pink one for my MBP!