75 points Retell15 1 hour ago 18 comments
bashhq_r 42 minutes ago | parent
Retell15 38 minutes ago | parent
steeleduncan 38 minutes ago | parent
yread 11 minutes ago | parent
IsTom 39 minutes ago | parent
poulpy123 28 minutes ago | parent
angry_octet 24 minutes ago | parent
geraneum 16 minutes ago | parent
amelius 21 minutes ago | parent
Do you reuse Claude's plugins/skill files?
Do you use a special harness or system prompts?
comprev 18 minutes ago | parent
segmondy 18 minutes ago | parent
junga 15 minutes ago | parent
snappr021 10 minutes ago | parent
When entire operating systems and software stacks to run end to end business processes, including engineering is a reality, Bill’s word “optimise” is close to the ultimate fulfillment.
There is too much compute in data centres, when multiple machines can be replaced with a functionally intelligent pi.
thangalin 5 minutes ago | parent
https://www.youtube.com/watch?v=Q9PKT6bdKnc
All weights are either permissively licensed or free until fantasy-level monthly recurring revenue sets in. The system runs entirely on the following hardware:
CPU: AMD Ryzen 5 7600 (Zen 4), 6 cores / 12 threads, AVX-512
GPU: NVIDIA T1000, 8 GB GDDR6 (Turing, 896 CUDA cores, 50 W, no BF16)
RAM: 96 GB DDR5
Text analysis uses Qwen3.6-35B-A3B MTP (Q4_K_XL GGUF) for speaker attribution, voice descriptions (not voice audio), emotive directions, and grammar. Both Muse Glimmer and GRMR cannot compete with Qwen3.6 for grammar checking. I haven't tried Gemma4, but I suspect Qwen3.6 remains the champ. My hope is that Inkling is more accurate for grammar than Qwen3.6, which is being tested at time of writing.Voice design and cloning uses FireRedTTS3, OmniVoice, Qwen3-TTS, VoxCPM2, and Ming-3.0-tts-tiny. Most are approximately equivalent. For narration, nothing comes close to Drama 3 Expressive Medium fine-tune in terms of quality, consistency, or pacing.
Unsloth's GGUFs have been absolutely instrumental in making the system a reality. Highly recommend using them.
_pdp_ 2 minutes ago | parent
Early, heavy and priced premium. I estimate it will take ~5 years for most practical AI to run on our own machines, with a few super brains left in the cloud.
I have been putting some effort into making local AI as consumer friendly as possible on macOS with this project https://github.com/pdparchitect/noodle/ but I will be the first to admit that the hardware you need is beyond most people's budgets. Hell, perhaps beyond most enterprises comfort levels too.
For now, subscriptions are the most practical way in.