76 points pretext 1 hour ago 69 comments
crooked-v 1 hour ago | parent
layman51 1 hour ago | parent
AlexErrant 1 hour ago | parent
Worse, everything after the /grill-me is injected a second time into the prompt as a <command-args> so your prompt is literally added to the context TWICE. (first time in the original user prompt.)
I swear Anthropic is intentionally bloating your context so you burn tokens on useless bullshit like this.
svachalek 32 minutes ago | parent
devin 1 hour ago | parent
jstummbillig 1 hour ago | parent
t-writescode 1 hour ago | parent
oofbey 1 hour ago | parent
jstummbillig 1 hour ago | parent
sandeepkd 1 hour ago | parent
ActionHank 1 hour ago | parent
Honestly not sure that there are that many effective changes a day given how little complexity there is to their public facing product.
mixtureoftakes 1 hour ago | parent
aacid 1 hour ago | parent
sp4cec0wb0y 1 hour ago | parent
_verandaguy 1 hour ago | parent
I don't want to use a product that shifts under me as I use it several times a day. I want a product that actually moves slowly and works very reliably.
As an end user: why would I care about how many hundreds of releases a month are being pushed if maybe 1% of them have features I care about?
Speed is not the product.
ActionHank 1 hour ago | parent
Have you seen the benefit of the churn of 1000 PRs a day?
leoqa 55 minutes ago | parent
Andrex 59 minutes ago | parent
JackSlateur 1 hour ago | parent
Of course, just like "line of code" is a worthless metric, "change merge per day" is;
for i in {1..10000000}
do
echo "I am working !" >> README.md
git add README.md
git commit -s -m "feat: working with AI"
done
(automerged PR, JOB IS DONE)devin 58 minutes ago | parent
grey-area 6 minutes ago | parent
vavkamil 1 hour ago | parent
I hope this is only for low-risk false positives. Dismissing a critical finding as a false positive should still involve AppSec.
You could improve revert rates while simultaneously introducing more security vulnerabilities.
And the linked "claude-code-security-review" explicitly states in the README
> This action is not hardened against prompt injection attacks
That's a significant limitation for an AI security review control, no?
hyperpape 1 hour ago | parent
ChrisArchitect 1 hour ago | parent
dylanhouli 1 hour ago | parent
g-b-r 1 hour ago | parent
benoau 1 hour ago | parent
dyauspitr 52 minutes ago | parent
g-b-r 49 minutes ago | parent
And if people are not looking it, those people don't care about their customers.
tripleee 47 minutes ago | parent
Code quality matters to AI just as much as it did to people
bbctr1 45 minutes ago | parent
tripleee 43 minutes ago | parent
Temporal coupling: if you architect your logic in such a way that it assumes x always happens before y, and there's nothing absolutely enforcing that anywhere, and you then write new code without taking it into account.. now you have a bug
If you write code in such a way that it depends on a certain data shape (maybe in a string, which static typing won't catch) and you change it... now you have a bug
If you do ALL of these things all over the place.. now you have a fucking shitshow and might need a rewrite of your app. Lets hope Opus 7 can do it.
There are 1000000 things that can bite you that aren't "ooh that code is so pretty!"
SmirkingRevenge 7 minutes ago | parent
If you let it go buck wild on a massive change, there are those times where it sort of paints itself into a corner but rewrites are cheap (for now), so it's just not that big of a deal, imho
piker 5 minutes ago | parent
The worst part about this is that if you aren't watching it, the AI will "solve" this with a thousand assert_3_plus_5_equals_8() test cases that just further clutter the workspace and the context window. Churn baby churn.
bpeng2000 7 minutes ago | parent
AI tends to add new wheels for a new feature in a large codebase, because finding, understanding, and generalizing the existing code to integrate a new feature will likely break existing features, cost more effort (and token) to implement and test. Human reviewers also tend to like these code since they are clean, easy to review, and get the job done, especially when they are not familiar with existing codebase.
The issue is that wheels like these accumulate in the codebase, and they inevitably entangle. When an upstream specification changes, when a new feature that works with many existing features are introduced, all these wheels need to be revisited, and in many cases they are not because the new test cases do not cover all the paths. The code base got larger and more complex, and contains more bugs than the unit tests can cover, especially when unit tests are often "bent" to fit the wrong behavior unnoticed.
nerdo 46 minutes ago | parent
copperx 42 minutes ago | parent
gwynforthewyn 44 minutes ago | parent
Do what you want, write apps with AI and don’t review code, it doesn’t impact me. The claim that no one cares about good code is demonstrably false, and that’s all I’m objecting to.
g-b-r 42 minutes ago | parent
so long as his software isn't used for anything that can affect you
drewg123 28 minutes ago | parent
Similarly, once you pull in terrible AI slop code, the project becomes unmaintainable by humans and you need to maintain it with AI.
gwynforthewyn 2 minutes ago | parent
This is, of course, tangential to your point.
troupo 20 minutes ago | parent
stillpointlab 39 minutes ago | parent
Choose something you want to do but don't really care that much about. Be more ambitious than you think you could be, have a high bar on the outcome but purposefully choose to completely ignore the actual code. Make it write tests, dashboards, monitoring - whatever you need other than code to feel confident.
Now is the cheapest time it will ever be to experiment.
troupo 22 minutes ago | parent
BobbyJo 16 minutes ago | parent
stillpointlab 15 minutes ago | parent
Response: Try experimenting in a low stakes environment
From Google: "Exposure therapy is a psychological treatment designed to help people confront their fears, break cycles of avoidance, and reduce anxiety."
dang 12 minutes ago | parent
(You're welcome to make your substantive points thoughtfully, of course.)
thisisauserid 1 hour ago | parent
gonzalohm 1 hour ago | parent
How is this a proper product? Every time you open the desktop app the buttons may be on a completely random place
JackSlateur 1 hour ago | parent
A random twitter said that, 6 month ago, it was 100% !
DECLINE ! SELL THE STOCK OPTIONS ! (wait, there are none, confused!)
typesanitizer 58 minutes ago | parent
stymaar 57 minutes ago | parent
luisgvv 55 minutes ago | parent
rileymichael 30 minutes ago | parent
honestly i'm thinking it might be easier (and cheaper) to launch our own agent from GH webhooks and trigger `/code-review`..
warkdarrior 15 minutes ago | parent
If an engineer paid $150,000 a year reviews some code manually for about 30 minutes, the cost of their time is about $36.
rileymichael 7 minutes ago | parent
koolba 21 minutes ago | parent
> None required once automated review and security checks are green
How anybody can let an LLM write docs and not even read them is pure insanity.
RGS1811 19 minutes ago | parent
ativzzz 16 minutes ago | parent
> The goal hasn't changed: less human time per change, and no more reverts than before.
Is this Goodhart's law in action? Less reverts and less incidents was measured and became the target. Is this then still a good measure? I guess Revenue is a more direct measure, but we don't have access to that one.
enraged_camel 2 minutes ago | parent
New features have actually been remarkable. For me they are almost always in one of two categories: things I've always wanted (but never actually bothered communicating to the devs), and things I didn't know I needed but did. The product team is clearly very tuned in.
All in all, I'd say their approach is working.
jwpapi 14 minutes ago | parent
Honestly I’m not worried about code anymore in my codebase I’ve not had bug problems for a while and incidents get fixed automatically.
I monitor new features with an agent who checks recordings.
Most actually good features need still 20-30 iterations to design the userflow to actually be interactive, but then there is also another challenge to translate usage patterns into features and how to present functionality with the least amount of friction as possible.
How to efficiently run monitors without wasting your token spends. A best 'monitor' best practice would be nice.
Still this article was very helpful and gave me a lot of new ideas.
YmFzZTY0ZGFkZHk 12 minutes ago | parent
Authors should really try and view this article from the perspective of someone who has to think about cost to use the models.
grey-area 8 minutes ago | parent
foolfoolz 2 minutes ago | parent
good model