76 points pretext 1 hour ago 69 comments

crooked-v 1 hour ago | parent

Well, that explains the Github repo with 5000 issues, maybe about a third of which are random regressions of previous behavior.

layman51 1 hour ago | parent

I was running into something similar where I had it working on a single Python file. Maybe part of the issue is that I had memory turned off, and the conversation might have spilled into two conversations. I wasn't using version control either, but since it was a single file with about 1000 lines of code, it didn't seem too hard to eventually get all of my features back.

AlexErrant 1 hour ago | parent

I just learned that manually invoked skills MUST be the _first_ thing in the prompt, e.g. you can't have `disable-model-invocation: true` and say "Hi, /grill-me on X".

Worse, everything after the /grill-me is injected a second time into the prompt as a <command-args> so your prompt is literally added to the context TWICE. (first time in the original user prompt.)

I swear Anthropic is intentionally bloating your context so you burn tokens on useless bullshit like this.

svachalek 32 minutes ago | parent

Oh /loop was the crowning achievement. Basically guarantees you'll run a prompt at max context without caching over and over.

devin 1 hour ago | parent

I snorted laughing at this. "We are experiencing tremendous growth" and it's just a codebase with 1,000 agents endlessly adding markdown documentation for every 1 line change.

jstummbillig 1 hour ago | parent

That's a shockingly low number.

t-writescode 1 hour ago | parent

1000/day in what sounds like a single repo is a low number?

oofbey 1 hour ago | parent

No. 90% sounds like a low number. That implies something else is writing 10% of the code? People? Other models? What on earth is writing that other 10%?

jstummbillig 1 hour ago | parent

I am not sure what it is you are saying. What I am saying: I would have supposed that Claude writes 99.x% of Claude's Code code, and that ~no code at Anthropic is written by humans anymore.

sandeepkd 1 hour ago | parent

I agree finding out who is writing that 10% of the code in the AI company is important. Maybe time to identity them and put them on PIP since they are slowing down everyone else and giving a bad name to the AI company

ActionHank 1 hour ago | parent

to achieve what?

Honestly not sure that there are that many effective changes a day given how little complexity there is to their public facing product.

mixtureoftakes 1 hour ago | parent

30 thousand changes merged per day? no. like just no. what are we doing? I'm trying to understand

aacid 1 hour ago | parent

The premise is clear, is one agent can do what developer can, but quicker, why not speed up the whole workflow to match it?

sp4cec0wb0y 1 hour ago | parent

More code output isn't a metric of success per se. Goodhart's law.

_verandaguy 1 hour ago | parent

Right, but why do things this fast to begin with, especially for a product that's already publicly available?

I don't want to use a product that shifts under me as I use it several times a day. I want a product that actually moves slowly and works very reliably.

As an end user: why would I care about how many hundreds of releases a month are being pushed if maybe 1% of them have features I care about?

Speed is not the product.

ActionHank 1 hour ago | parent

Have you used Claude Code?

Have you seen the benefit of the churn of 1000 PRs a day?

leoqa 55 minutes ago | parent

It’s only about 10 per engineer. I’m not at Anthropic and before 2026 I was regularly hitting 1400 commits / year on my GitHub. If agents made me 2x faster (they have, review is still slow; I currently have 40 PRs open) that’d be the same rate.

Andrex 59 minutes ago | parent

Humans don't operate at AI speeds. We're making the car go from 0 to 5000 mph in 1 second and the drivers are turning to goo in the seat.

JackSlateur 1 hour ago | parent

I, too, can write and merge 30000 changes per day. Even 300000 if I've up to.

Of course, just like "line of code" is a worthless metric, "change merge per day" is;

  for i in {1..10000000}
  do
    echo "I am working !" >> README.md
    git add README.md
    git commit -s -m "feat: working with AI"
  done
(automerged PR, JOB IS DONE)

devin 58 minutes ago | parent

There was a post some months back called "Lines of Code Got a Better Publicist" or something along those lines. This is just more of that. I am not impressed by 30 thousand "changes" per day in the slightest without significant added context. When I logged in and prompted Claude today, do I feel like I got +600,000 change value from when I logged in a month ago?

grey-area 6 minutes ago | parent

I’m horrified by it. There is no possible justification for it but it does explain their buggy products.

vavkamil 1 hour ago | parent

> Security gets its own automated review too. ... You either fix it or close the thread with a short reason, which is how you clear a false positive.

I hope this is only for low-risk false positives. Dismissing a critical finding as a false positive should still involve AppSec.

You could improve revert rates while simultaneously introducing more security vulnerabilities.

And the linked "claude-code-security-review" explicitly states in the README

> This action is not hardened against prompt injection attacks

That's a significant limitation for an AI security review control, no?

hyperpape 1 hour ago | parent

I'm somewhat surprised they would say Claude is writing 90% of their code at this point. Did they get tired of reporting new milestones, or has there been a plateau?

ChrisArchitect 1 hour ago | parent

Title is: How the Claude Code team does code review

dylanhouli 1 hour ago | parent

Here I am still unable to stop myself from doing line-by-line code review. I notice too many things (redundant code, duplicate code, overly complex architecture, etc.) by doing it that I feel it would be careless not to.

g-b-r 1 hour ago | parent

You're unable to stop being responsible? Tragic!

benoau 1 hour ago | parent

This is why I like GitHub Copilot's autocompletion, I'm right there guiding and policing the code as it appears.

dyauspitr 52 minutes ago | parent

No one cares about good code. It’s a means to an end. Your code doesn’t need to look pretty or be well documented or any of that stuff anymore because people are not looking at it. The only thing people care about is performant and error free code.

g-b-r 49 minutes ago | parent

Good code is a means to the end of the code being error (and vulnerability) free, maintainable and performant.

And if people are not looking it, those people don't care about their customers.

tripleee 47 minutes ago | parent

People saying this are telling on themselves that they have no idea what quality code is. It's not about looking pretty or nice variable names.

Code quality matters to AI just as much as it did to people

bbctr1 45 minutes ago | parent

Do you have any data backing this statement? Or is it just your experience?

tripleee 43 minutes ago | parent

Simple example: code duplication all over the place, something AI loves to do. Update one of those without the others and you now have a bug.

Temporal coupling: if you architect your logic in such a way that it assumes x always happens before y, and there's nothing absolutely enforcing that anywhere, and you then write new code without taking it into account.. now you have a bug

If you write code in such a way that it depends on a certain data shape (maybe in a string, which static typing won't catch) and you change it... now you have a bug

If you do ALL of these things all over the place.. now you have a fucking shitshow and might need a rewrite of your app. Lets hope Opus 7 can do it.

There are 1000000 things that can bite you that aren't "ooh that code is so pretty!"

SmirkingRevenge 7 minutes ago | parent

The models are pretty good at finding code duplication and eliminating it though, and it's usually part of my AI review process at this point

If you let it go buck wild on a massive change, there are those times where it sort of paints itself into a corner but rewrites are cheap (for now), so it's just not that big of a deal, imho

piker 5 minutes ago | parent

Yep.

The worst part about this is that if you aren't watching it, the AI will "solve" this with a thousand assert_3_plus_5_equals_8() test cases that just further clutter the workspace and the context window. Churn baby churn.

bpeng2000 7 minutes ago | parent

Personal experience:

AI tends to add new wheels for a new feature in a large codebase, because finding, understanding, and generalizing the existing code to integrate a new feature will likely break existing features, cost more effort (and token) to implement and test. Human reviewers also tend to like these code since they are clean, easy to review, and get the job done, especially when they are not familiar with existing codebase.

The issue is that wheels like these accumulate in the codebase, and they inevitably entangle. When an upstream specification changes, when a new feature that works with many existing features are introduced, all these wheels need to be revisited, and in many cases they are not because the new test cases do not cover all the paths. The code base got larger and more complex, and contains more bugs than the unit tests can cover, especially when unit tests are often "bent" to fit the wrong behavior unnoticed.

nerdo 46 minutes ago | parent

Not true, LLM’s will struggle with badly organized and designed large codebases just the same, though likely with less errors and profanities.

copperx 42 minutes ago | parent

The biggest concern is that AI can doxx you and find where you live if your code sucks. If that doesn't scare you, nothing will.

gwynforthewyn 44 minutes ago | parent

Literally 50 years of engineering history and culture cares about whether code is good. There are libraries worth of books about it, not as a means to an app but for its own beauty. Just read “The Elements of Programming Style”, for example.

Do what you want, write apps with AI and don’t review code, it doesn’t impact me. The claim that no one cares about good code is demonstrably false, and that’s all I’m objecting to.

g-b-r 42 minutes ago | parent

> it doesn’t impact me

so long as his software isn't used for anything that can affect you

drewg123 28 minutes ago | parent

The way you phrase it makes me realize its almost like a GPL contamination. Eg, once you pull in GPL code, your project is infected and can never use a BSD (or other GPL incompatible) license.

Similarly, once you pull in terrible AI slop code, the project becomes unmaintainable by humans and you need to maintain it with AI.

gwynforthewyn 2 minutes ago | parent

There’s a little irony about the example you picked of the GPL, just because in the US the output of an LLM cannot be covered under copyright. The GPL works as an assignment of rights under copyright.

This is, of course, tangential to your point.

troupo 20 minutes ago | parent

Code that isn't duplicated in 15 places, that doesn't read the whole database to fetch just 1 record, that doesn't do 15 database reads where one would suffice, that uses an optimized algorithm instead of an exponential one recreated badly from scratch... all that is also good code, and is just as important in LLM-slop era.

stillpointlab 39 minutes ago | parent

My advice is to start a totally vibe coded side project. You will never gain confidence until you experiment, find the failure cases, learn to deal with them, etc.

Choose something you want to do but don't really care that much about. Be more ambitious than you think you could be, have a high bar on the outcome but purposefully choose to completely ignore the actual code. Make it write tests, dashboards, monitoring - whatever you need other than code to feel confident.

Now is the cheapest time it will ever be to experiment.

troupo 22 minutes ago | parent

[flagged]

BobbyJo 16 minutes ago | parent

I think the intended takeaway is to learn to solve those problems without line by line review. Start by being hands off on a low stakes project, and see how the model fails. Then, come up with, and try, solutions that aren't you doing archeology.

stillpointlab 15 minutes ago | parent

Issue: I am still unable to stop myself from doing line-by-line code review

Response: Try experimenting in a low stakes environment

From Google: "Exposure therapy is a psychological treatment designed to help people confront their fears, break cycles of avoidance, and reduce anxiety."

dang 12 minutes ago | parent

Please don't do this here.

(You're welcome to make your substantive points thoughtfully, of course.)

https://news.ycombinator.com/newsguidelines.html

thisisauserid 1 hour ago | parent

Remind me to invest more in the clouds they are burning those tokens in.

gonzalohm 1 hour ago | parent

That explains why the UI keeps changing.

How is this a proper product? Every time you open the desktop app the buttons may be on a completely random place

JackSlateur 1 hour ago | parent

90% ?

A random twitter said that, 6 month ago, it was 100% !

DECLINE ! SELL THE STOCK OPTIONS ! (wait, there are none, confused!)

nakul_ 1 hour ago | parent

I wonder how they maintain the quality of tests for such a massive codebase and frequent commits.

owebmaster 45 minutes ago | parent

That's the trick: they don't

typesanitizer 58 minutes ago | parent

FWIW, Pangram identifies several sections as 100% AI-written.

stymaar 57 minutes ago | parent

Poorly I'm afraid, given how many new bugs make their way to the claude code CLI every update.

luisgvv 55 minutes ago | parent

And yet they can't fix the janky bugs when you scroll or show/hide chain of though, commands executed, configuring plug-ins from the options menu etc.

rileymichael 30 minutes ago | parent

what are people using for automated code review these days? the claude code review product originally mentioned it cost "$15-25 per review" (which is absurd), but it seems like they've removed that from their docs with the launch yesterday. we've looked at various products in the space (coderabbit, greptile, etc.) but have gripes with each.

honestly i'm thinking it might be easier (and cheaper) to launch our own agent from GH webhooks and trigger `/code-review`..

warkdarrior 15 minutes ago | parent

> the claude code review product originally mentioned it cost "$15-25 per review" (which is absurd)

If an engineer paid $150,000 a year reviews some code manually for about 30 minutes, the cost of their time is about $36.

rileymichael 7 minutes ago | parent

in a vacuum, sure. the average pull request will have multiple commits once opened (i.e. to address feedback or perhaps it was opened too early), each triggering a review. it's very easy to rack up $100+ per pr (and an eng may open a dozen prs in a single day)

koolba 21 minutes ago | parent

> Low - Docs, copy, internal-only features, additive changes behind a flag

> None required once automated review and security checks are green

How anybody can let an LLM write docs and not even read them is pure insanity.

RGS1811 19 minutes ago | parent

How is the ability of a human to understand the code via hands-on familiarity not a direct dependency of their ability to do manual code review? I don't get it. Having claude write an explainer (something I do a lot!) doesn't get you to the point where you can confidently assess a complex diff. And you've funneled your priors on what the diff says and does through the same system that already reviewed and approved it. This article isn't bad but it doesn't give enough weight to the human context-building part of the problem.

ativzzz 16 minutes ago | parent

It looks like they are specifically optimizing for incidents/reverts and shipping faster

> The goal hasn't changed: less human time per change, and no more reverts than before.

Is this Goodhart's law in action? Less reverts and less incidents was measured and became the target. Is this then still a good measure? I guess Revenue is a more direct measure, but we don't have access to that one.

enraged_camel 2 minutes ago | parent

From my perspective as a power user, the product has improved substantially over the past six months. It has gained new features that are actually useful, lots of UI/UX/perf improvements, and bug fixes as well.

New features have actually been remarkable. For me they are almost always in one of two categories: things I've always wanted (but never actually bothered communicating to the devs), and things I didn't know I needed but did. The product team is clearly very tuned in.

All in all, I'd say their approach is working.

jwpapi 14 minutes ago | parent

What I’m more worried about is feature identification and how to monitor them. How can you get the product to the next level?

Honestly I’m not worried about code anymore in my codebase I’ve not had bug problems for a while and incidents get fixed automatically.

I monitor new features with an agent who checks recordings.

Most actually good features need still 20-30 iterations to design the userflow to actually be interactive, but then there is also another challenge to translate usage patterns into features and how to present functionality with the least amount of friction as possible.

How to efficiently run monitors without wasting your token spends. A best 'monitor' best practice would be nice.

Still this article was very helpful and gave me a lot of new ideas.

YmFzZTY0ZGFkZHk 12 minutes ago | parent

And so the wildly unprofitable AI company explains how it token maxes it's code and review process.

Authors should really try and view this article from the perspective of someone who has to think about cost to use the models.

enraged_camel 8 minutes ago | parent

Anthropic has been profitable for the past two quarters.

layoric 3 minutes ago | parent

Source? Only reports I’ve seen was they were profitable for one month in last quarter due to xAI discount of renting out colossus . Be interested to learn otherwise.

grey-area 8 minutes ago | parent

At 30k commits a day, is there anything that can meaningfully be called review?

foolfoolz 2 minutes ago | parent

everything is shipped with auto reviews behind a flag. then you need a human approver to launch

good model