22 points guitarlimeo 1 hour ago 30 comments

Been recently thinking about this more and more: When the need for a human in the design loop ceases?

Given that LLMs are RL'd to the max with everything that can be given a wrong/right answer (code/maths), what currently is stopping Anthropic, OpenAI et al. from internally building (and maybe buying) datasets of good and bad architecture, and RL'ing that?

Given that LLMs were a fancy autocomplete back in 2024, and now people are talking about building "software factories" with the agents, what in your mind is the stop to this development? Why software architecture would be hard for agents still in a year or two?

Just thinking because I see more and more examples of software developers ignoring this and saying "humans still have a place in guiding the agents and designing the architecture". I think (businesswise) the need for actual software programmer skills is 90% out in a few years I think, and product lead etc people will be favored more as they have more people skills.

it was a good run.

rvz 1 hour ago | parent

This doesn't make any sense, unless you are just building low critical software such as games that assumes little to no liability.

What will happen is you will get less developers (including less seniors and staff-level) but there will always be expert humans that will check the code before release.

Maybe it was a good run for some here, but you need to look outside of the tech bubble. Do you want an LLM to autonomously fly a commercial plane without any pilots in 2030?

"Seniors" should already know this, but are quickly startled because they are unable to adapt since they based their entire identity and careers around the over-engineering of "clean code", "test driven development" and "architecture" too early on products that make no money, when the LLMs have now cheapened that and taken that role. Even Uncle Bob does not read the code Claude writes in 2026.

Instead, think like an owner.

guitarlimeo 1 hour ago | parent

> I think (businesswise) the need for actual software programmer skills is 90% out in a few years I think, and product lead etc people will be favored more as they have also more people skills.

"Instead, think like an owner." exactly, the traditional software engineer role has ceased to exist and now you must think like an indie entrepreneur and own things. There will be less than 10% of current engineers checking the code in the near future.

> Do you want an LLM to autonomously fly a commercial plane without any pilots in 2030?

No but I also didn't want LLMs to make decisions for the defense department in USA yet here we are.

markus_zhang 1 hour ago | parent

Sigh. I never want to be a product people or an owner. Fortunately I’m over 40 and don’t have to work for very long. Good luck folks. I’ll resort to recreational programming when I half retire.

Lwerewolf 44 minutes ago | parent

I mean, you do own your work in a way... it's not so different.

usrnm 37 minutes ago | parent

I'm almost 40, but nowhere close to being able to retire and enjoy the rest of my life, which is, I hope, going to be at least another 40 years. It's going to be a fun ride

rvz 14 minutes ago | parent

> "Instead, think like an owner." exactly, the traditional software engineer role has ceased to exist and now you must think like an indie entrepreneur and own things. There will be less than 10% of current engineers checking the code in the near future.

It will still exist, but far less of them and it includes the reduction of SWEs from junior to staff-level.

Someone will always be held liable if an LLM runs autonomously and out of control which will cost them a lot of money for damages.

> No but I also didn't want LLMs to make decisions for the defense department in USA yet here we are.

There was someone else (another human) that made that decision to use LLMs there, and why certain countries don't trust the US any more, which is my point with both liability and trust in highly critical situations.

smackeyacky 54 minutes ago | parent

I am a senior engineer. I adapted faster than most of the people I work with. It doesn’t matter that the tool can improve your productivity if you don’t know where to start which a lot of juniors don’t. They still need leaders to guide them and apportion the work.

AI still isn’t a magic bullet either. I spend some of my days undoing the unholy mess that generated code is.

Lwerewolf 45 minutes ago | parent

>Instead, think like an owner.

Exactly. LLMs make it, I'd say, _possible_, to own way more parts of the code than before, and understand even more.

entropyneur 29 minutes ago | parent

> Do you want an LLM to autonomously fly a commercial plane without any pilots in 2030?

This argument has been made before LLMs and it didn't make sense to me then either. Sure I do if it crashes statistically less often than humans!

But sure, if my job now is going to jail when something malfunctions, that's still better than seeing my family starve.

Zealotux 55 minutes ago | parent

I've started looking into creating a pest control business, or maybe renovating furnitures I find on the street. Let me know if you have other ideas for senior engineers.

pllbnk 19 minutes ago | parent

I would love more existing or recently ex- software engineers to share what new activities they have been taking up for living and that have been going well. I am certain that there are niches where a refined systematic thinking that many software engineers have could be a big advantage. However, it's expensive and risky to start new businesses in areas we don't have any experience in.

jwr 42 minutes ago | parent

> Given that LLMs are RL'd to the max with everything that can be given a wrong/right answer (code/maths), what currently is stopping Anthropic, OpenAI et al. from internally building (and maybe buying) datasets of good and bad architecture, and RL'ing that?

That is a question I have been asking myself. It was partially answered with Fable 5.1 and Astra. I worked with them on architectural design documents, and they were very good. Some of their suggestions were better than my solutions. They are not at a point where they can fully replace a system architect yet, but they're getting close.

There is still the open question of what to build and how to create a user interface that is understandable and presents complex information in ways understandable to humans. That's something AI cannot do yet.

sitzkrieg 41 minutes ago | parent

almost officially graybeard territory, thinking about starting an apiary. getting stung by 100s of bees still sounds like more fun than being forced to have to interact with LLM code from any source

Aldipower 39 minutes ago | parent

Next week I will power on a physical server in a colocation. The server is a vertical scale running my SaaS that I developed over the years and needs more space now. Sure, LLMs help me now with a lot of things. Coding, server commissioning, marketing, etc., but I simply cannot image how the LLM drives my car to the colocation and plugs the server in?!? How should this work? And who is responsible at all in the end? Responsibility? And renting something "automatic" like AWS would cost 20-30 times more btw. This is not an option.

alchemism 30 minutes ago | parent

Well, a colo will typically offer a Remote Hands service for $/mo and do that part for you, but its a human.

I suppose eventually it could be a rack robot instead, why not.

bluGill 30 minutes ago | parent

Why can't a LLM design and run a robot?

Aldipower 22 minutes ago | parent

That drives my car, orders the parts and builds the server?

Anonyneko 1 minute ago | parent

An LLM can order a service to do it for you.

zerop 36 minutes ago | parent

LLMs have been able to make good success in coding, because someone is reviewing the work it produces (code). Ofcourse quality of code has become better over time. IMO other than Human-in-the-loop scenarios, AI will not see huge adoption in businesses.

pllbnk 21 minutes ago | parent

I don't think code quality has improved. I think the main advantage of LLMs is that they have unlimited perseverance to rummage in whatever code you give them to to solve a particular problem, and given enough loops they will also find and fix some of the bugs that have been either preexisting or introduced freshly. Code quality is important for us, humans, because a lot of times we don't have mental capacity, patience and speed to work in bad code bases for long time.

accurrent 35 minutes ago | parent

IMO senior software engineer is someone who drives consensus in a large organization. I dont think LLMs are going to solve that problem any time soon.

I also see a bunch of skills emerging. First if you're doing frontend type dev, there is a lot of value in good aesthetics and UX intuition. You can build hundreds of prototypes and test concepts much better.

On the backend, while LLMs can trace race conditions, the need to reason against spaghetti and figure out what your context window looks like is still very much there. Designing tests that ensure seamless migrations still requires a degree of human oversight.

Then there are frontiers like robotics where even with LLMs coding, there are so many cross functional problems that you dont feel like you are moving faster.

I work in a fairly niche role. I use llms for coding all day but there are times for the type of operations research work I do I simply find it easier to write algorithms in almost correct code.

RugnirViking 26 minutes ago | parent

I'll suggest more focus on performance, testing, and observability.

Human understanding + quality/maintainability is where the money is at. Learn to make those things with agents.

I don't think engineers will truly go extinct, though there may well be less of them. I think the recent discussion around "AI usage is a skill" at https://news.ycombinator.com/item?id=50063427 captures my feeling - there are things to learn, and likely will continue to be, to get the best out of these tools. That means some people will be paid to do it. See to it that you are one of those

spottedmarley 23 minutes ago | parent

I am predicting a sharp rise in poets and painters.

Actually, the poetry thing is probably doomed too.

So maybe.. interpretive dance?

fergie 18 minutes ago | parent

Ultimately you still need somebody to decide what we are going to tell the machines what to do, and then actually tell the machines what to do, and it doesn't really matter if that is in JavaScript or plain English.

There does _seem_ to be some pressure on the top end of SWE salaries. Its possible that this is just wishful thinking, but if true, I suspect that it has more to do with an increase in job applicants rather than a decrease in actual work. AI seems to have driven up the amount of applications received for every vacant position.

gregwebs 16 minutes ago | parent

Senior engineer and all SWE positions will become more like a technical lead.

If you can direct AI and produce more value per $/time spent then a non software engineer directing AI to develop software then you still can produce a lot of value. This should be the case now for most things that are not a prototype. The job has changed from "writing code" to "shipping software". A technical lead.

software products making ever more intelligent AI software generation accessible will take this job away in many places but there’s also going to be 1000x more software. So there may continue to be opportunities for those that adapt.

frangonf 11 minutes ago | parent

I'm no senior but I think that if software (and rest of disciplines possible soon to be hit as hard) can still be "wrong", if you can still mess it up even with machine assistance, people doing software still have a place. This doesn't mean that we need to achieve absolute perfection to be deprecated, maybe we just become accepting of machine generated good enough artifacts. I'm betting on humanity infinite nonconformism instincts so I can have a job some more years!

le-mark 11 minutes ago | parent

Once the Mother App to assign ubi tasks and assign ubi dorms and take orders for ubi gruel is complete, well that’s the only app we’ll need. May we all have pleasant ubi tasks to fulfill our days.

zeryx 7 minutes ago | parent

So I'm an SA, but have been working on systems architecture and have shipped large scale changes to very big platforms in prod and maintained them. With fable and astra I tried making a video game together, it didn't work.

The agents have incredible capabilities to develop any bit of code I need and to write good scripts to catch the most basic failure modes, they can even "play the game" by spinning up a VM and using ahk to trigger game state and take screenshots and gifs and use that to understand what it built.

Knowing what to build intuitively to maximise fun, or any other illogical human experience won't be RLable ever. Unless we're at brains in glass jar territory but I don't think we have to worry about that now.

jgilias 4 minutes ago | parent

Models have an alignment problem. As in, they are too aligned to push back hard enough on bad ideas. Sometimes you can’t really push back because of power dynamics and whatnot, but the job still needs to be done _somehow_. So humans then navigate it by sometimes just ignoring the bad ideas, sometimes playing along with the narrative, but then doing what _actually_ needs to be done, and sometimes, when there is no other way, digging in heels and killing some bad ideas before they’ve really taken root.

An agent could do this with the SOTA model capability that existed yesterday. But then they’d need to become seriously misaligned.