29 points Aldus551 2 days ago 13 comments

garrickvanburen 51 minutes ago | parent

A fantastic articulation of one of my concerns in the space: yes, there are times we want the average of the internet. But those times are scarce.

jakeinspace 38 minutes ago | parent

It's a viable hypothesis but I'd like to see some more examples

verisimi 37 minutes ago | parent

Surely the initial ai responses are a reasonably fair first pass, and would be acceptable to most users.

However, it is then on the person asking the query to refine the query and push for more specifics.

I don't see the problem. Ai doesn't need to get it all right, first time.

darepublic 23 minutes ago | parent

Maybe you aren't trying to solve unique problems? Ie at my job putting together a client side JavaScript async call to db backed endpoint is , for most common cases, solved. It's extremely reliable and can plug in the particulars. But for tasks where it's not rocket science but are unique and not just application of the tired template it's very hard to wrangle it and it's performance varies.It will often.. ignore the particulars and genericize to a more common similar type of problem. Can this be overcome? Sure but it's a tremendous effort almost akin to hand coding everything yourself in the first place.

Forgeties79 21 minutes ago | parent

> I don't see the problem. Ai doesn't need to get it all right, first time.

Yes it kind of does or it’s not what we were promised/sold. A tool has to work reliably. I don’t want a calculator that’s correct most of the time.

foobar10000 8 minutes ago | parent

So we can add a harness around it? We have decades of experience how to work with faulty sensors, etc… multi-voting, sampling, etc. This will become a part of the harness soon enough . I mean - we can want it to be perfect - sure - but we can deal with imperfect.

sdenton4 36 minutes ago | parent

Arguably, this is one area where people can build value in the age of LLMs: Developing the exceptions to the statistical baseline.

asr 30 minutes ago | parent

What alternative answer was the author looking for? The idea that these AI answers are objectively wrong, is itself wrong. They seem pretty good. The piece just asserts they are bad.

slfnflctd 27 minutes ago | parent

I'm not convinced. The solution to this problem in most cases seems to me to still boil down to just more detailed prompting.

As I see it, there are far greater concerns about guardrails being baked in - possibly at the request of poorly informed government officials - cordoning off multiple broad categories of knowledge needlessly. Which is what I thought this post was going to be about.

deadlast2 20 minutes ago | parent

Need completely open models to effectively build reliable anything on. Think about an open vs closed API. This is at a different level because AI has the capability of driving thought so think of a future of people who are only allowed to argue think construct ideas in a box defined by a left or right or religious or secular group of cleps.

snvzz 12 minutes ago | parent

When I read the title, SafeGuards(tm) came to mind.

Handcuffs, for your external brain.

Tade0 10 minutes ago | parent

> The models did not simply propose poorly chosen promotion tools. They in effect replaced the original task with another, one more familiar to them from the statistical regularities of the training data.

This used to happen a lot in LLMs as recent as Q1 2026 in programming tasks: if something was too far off the beaten path, the model would misinterpret the intention.

Nowadays I'm noticing that while the solution is what I asked for, it's fairly roundabout and verbose. Being more specific in prompts doesn't help.

YetAnotherNick 10 minutes ago | parent

I gave both ChatGPT and Claude exact same prompt and none did anything close to what author was claiming. The blogpost could just be poor AI writing.