144 points entryleveljobsc 2 hours ago 103 comments

InsidiousWombat 1 hour ago | parent

all of that to hit two nines of uptime

margalabargala 1 hour ago | parent

Oh is it finally up to 89.9%?

lenerdenator 1 hour ago | parent

"ohhh, la-di-dah, this guy's got tens in front of his two nines instead of just 9.9" - github, probably.

hungryhobbit 1 hour ago | parent

>There's an important distinction here. Anthropic isn't actually spending more cash on AI than salaries. It's valuing its internal AI consumption at retail prices.

If virtually any other company in the world said "we have internal AI servers and we let our employees use them" ... the company would measure that as they would any other internal expenditure: by how much it costs them. You blow $50k a year on servers running your LLMs? It cost you $50k.

Only a company like Anthropic, desperate to make news and help their IPO, would measure by the cost they charge customers. It's as ridiculous as Microsoft counting every employee's use of MS Word ... as if it had paid the full consumer price of each copy.

blobbers 1 hour ago | parent

Do they actually book the revenue against themselves?

This is the world of spend more, get valued more; obviously the investment will be used to spend more and get more, so it must be good. This is investor-think. If you don't have spend, why do you need investment?

(Or it could be bad. Very very bad)

reducesuffering 1 hour ago | parent

Actually I think it's very informational. For every other company, working on the cutting edge of technology, paying for intelligence at retail prices, means you are now paying more for AI than you are employees. That $ could have been spent on 2x the employees, however that's not as useful as 50% AI / 50% humans, and indicative of where we are headed.

aleqs 1 hour ago | parent

Anthropic's use of AI in no way translates or represents any other companies' use of AI, so your apparent extrapolation makes no sense.

reducesuffering 1 hour ago | parent

Anthropic is full of the smartest talent and a bellwether for how the rest of the service industry will work. Just as cutting edge companies of the past, like 2005-2020 Google's use of computers and software were indicative of the software every other service company was going to be using, lest they turn into an old fashioned uncompetitive dinosaur.

staticman2 50 minutes ago | parent

Wikipedia tells me that "service industry" is a term that includes transportation companies and law firms.

So you are apparently now claiming my local train company or law firm will be using as many tokens per employee as an A.I. lab.

exe34 26 minutes ago | parent

You still pay input tokens for Jev. "Should I crash this train, YES/NO?"

pixl97 50 minutes ago | parent

>means you are now paying more for AI than you are employees.

Yea, isn't the entire point of RSI to replace your employees altogether? So you'd spend an infinite amount more on AI than employees in that theoretical.

Like, if you were in an energy generation business spending way more on fuel and capital expenditures is way better than having zillions of employees earning checks , it would be a sign of efficiency.

BigTTYGothGF 1 hour ago | parent

Seems entirely in line with Hollywood-style practices.

ai-x 1 hour ago | parent

No. This is opportunity cost.

A clear example is Google. They can easily give all compute to Deepmind, yet majority is allocated to be sold at market rate.

So, every compute Deepmind and Googlers get is lost revenue opportunity and must be measured as such.

No other internal tools or servers has this much external demand to be comparable.

Also, Anthropic is showing that to operate at Anthropic level, you need $300,000 compute spend per employee

robrenaud 1 hour ago | parent

> Anthropic is showing that to operate at Anthropic level, you need $300,000 compute spend per employee

You have confused necessary and sufficient.

aleqs 1 hour ago | parent

By 'operate at Anthropic level', you mean terrible reliability and availability, and terrible efficiency right?

woah 1 hour ago | parent

They also offer $300,000 in compute spend (allegedly) for $200 a month to anyone who isn't employed by a large corporation so their pricing should be taken with a grain of salt.

Aurornis 1 hour ago | parent

Are you talking about their $200 consumer plan? If you use 100% of the quota every week it's closer to $2000 at API rates.

They have never claimed that the API rates are the "real cost" of the compute spend.

woah 1 hour ago | parent

I was spending thousands of dollars a day in funny money (free promotional tokens from VCs) before switching to a paid subscription for convenience.

sigseg1v 35 minutes ago | parent

On the $200* consumer plan, according to "npx ccusage", I'm using $11,000 per month at API rates. Possibly significantly more, because I was previously using the $100 plan so that only reflects about 1 week of the $200 plan.

gruez 1 hour ago | parent

>$300,000 in compute spend (allegedly)

source? The most optimistic calculations don't come anywhere close to that.

https://x.com/SemiAnalysis_/status/2064815044085318040

Aurornis 1 hour ago | parent

Usage allowances have decreased since that analysis. Also the 20X plan became the 10X plan (cut in half).

technotony 28 minutes ago | parent

It was never 20x, that was just 5 hour usage limits. There's a class action on this...

whimsicalism 1 hour ago | parent

i don't understand why so many people on this site comment on issues they clearly do not know anything about

aleqs 1 hour ago | parent

Obvious bullshit that's been disproven many times already.

Rapzid 1 hour ago | parent

The price is the price, everything else is bullshit.

hackingonempty 1 hour ago | parent

> Also, Anthropic is showing that to operate at Anthropic level, you need $300,000 compute spend per employee

There are a bunch of open source harnesses that are competitive with CC and they aren't using anywhere near that many tokens to do it.

ako 56 minutes ago | parent

It's not just the LLM costs, to keep your agents busy you need to move them of your workstation onto a server/cloud. I currently have about 16 claude code agents working on different bugs, uses so much resources that my macbook pro m5 max becomes slow to respond. Using cloud session would free up my macbook for other work.

Anthropic recently handed out free cloud resources (it's still free, guess they want you to get used to the fact that cloud is not free). I went through $250 cloud budget in less than 2 days.

Feels almost as expensive as LLM calls.

Rabbit504030201 50 minutes ago | parent

You call your laptop "workstation"?

glimshe 36 minutes ago | parent

Technically it is... According the original vision for workstation, a computer with >1MB RAM, >1 megapixel of screen resolution, >1 MIPS and costing under 1 Mega cents (10K dollars).

However, so is my phone!

https://en.wikipedia.org/wiki/3M_computer

eyegor 37 minutes ago | parent

I'm impressed you have a workflow that can keep 16 separate agents fed without the whole thing collapsing into nonsense. Even running full agent teams I can't think of ways to do that without being intentionally inefficient

ariwilson 22 minutes ago | parent

just get a mac mini headless

bluefirebrand 24 minutes ago | parent

Wouldn't that depend on how much hardware you have to run them on, too?

cortesoft 1 hour ago | parent

> So, every compute Deepmind and Googlers get is lost revenue opportunity and must be measured as such

Maybe, but it also reduces supply that can drive up prices

RandomLensman 1 hour ago | parent

So every business should measure any client fungible resource that way? Should a bank put a revenue number to any capital held in excess of regulatory requirements, for example?

fwip 1 hour ago | parent

If it were opportunity cost, that would imply that Anthropic can't sell as many tokens as people want to buy. But as far as I can tell, there aren't any "token shortages," at least at API prices. Or is there a maximum per-customer limit that I'm not aware of?

skybrian 41 minutes ago | parent

It depends on your assumptions. When Google is in "space crunch" mode, there are opportunity costs. Otherwise, there aren't, because you could do both.

You could also look at the opportunity cost of not letting Deepmind do quite as much research. How much is additional research worth on the margin? There will be diminishing returns.

throwitaway222 32 minutes ago | parent

Not really- since they have an internal view of low and high usage times of the day, they can optimize differently.

Even within a single moment, if there is capacity for an internal request, just send it, if market traffic is currently at 100%, don't.

bunderbunder 22 minutes ago | parent

I don't buy it. A company like Anthropic is not going to just walk away from revenue. If external demand were really that high, then they should take the money first. And not just for the revenue; customer demand being that high is also an indication that the product is already great as-is so they stand to improve their bottom line by easing off on the R&D spend.

realitysballs 15 minutes ago | parent

Not if you’re desperately trying to stay ahead of AI frontier pack.

com2kid 5 minutes ago | parent

[delayed]

Foobar8568 1 hour ago | parent

In a lot of companies, you would get charges back on usage/license/cost and this can get even funnier in NGOs.

In a similar way, internal employees would have also a "standard daily rate" like an external employee.

throwup238 1 hour ago | parent

Plenty of companies use retail/wholesale pricing internally to make sure a business unit doesn’t appear profitable just because it’s being subsidized by the one providing the resources. Plenty also have to have arm’s length pricing for legal reasons.

Anthropic isn’t booking it as GAAP revenue, they’re just using the number for marketing.

Aurornis 1 hour ago | parent

That's not really true. Measuring the equivalent retail cost of the usage is the only way to put it in a relatable perspective.

If Anthropic had revealed their internal cost, there comments would be complaining that they were hiding something and giving useless, unrelatable data.

The expenditure is most interesting when compared to retail rates, because that's the rate the rest of us have to compare against.

aleqs 1 hour ago | parent

What's is the 'retail cost'? Because nobody (except total idiots) is actually paying their published API pricing.

Anon1096 51 minutes ago | parent

Big companies actually are paying published API rates, Anthropic and OpenAI models are desirable enough that there is very little wiggle room to negotiate. It's their way or the high way. Same with things like "safety" filters and (for Fable) mandatory data retention.

simonw 45 minutes ago | parent

Most "enterprise" companies are paying full API costs. The subscription deals are only available to consumers. If you want enterprise levels of control over how your staff are using the models you need to pay up.

buildbot 42 minutes ago | parent

Microsoft basically does the same with internal Azure services? When I was there our budget/usage was based on and consumed at the consumer price for GPUs and other compute. What happened behind the scenes really I have no knowledge.

maccard 29 minutes ago | parent

I’ve worked at and with large orgs - it’s absolutely standard practice for BUs to bill other BUs at “retail” or at the very least a commercial rate.

nextaccountic 17 minutes ago | parent

> You blow $50k a year on servers running your LLMs? It cost you $50k.

Plus electricity

kragen 7 minutes ago | parent

In the US, the IRS doesn't see it that way, at least when it comes to fringe benefits as a part of employee compensation. https://www.irs.gov/businesses/small-businesses-self-employe... says, "In general, the amount the employer must include is the amount by which the fair market value of the benefits is more than the sum of what the employee paid for it plus any amount that the law excludes."

As an example, as I understand it, if a hotel chain allows an employee to stay in one of their hotels for free when they go on vacation, the tax value of that benefit is what they would have charged someone for that hotel room, not how much it increased the hotel's costs to have one more hotel room full — which is generally almost nothing.

Of course, the IRS does agree with you when it comes to expenditures that are for the employer's benefit, rather than the employee's. If it didn't, almost all companies would have negative profits from the IRS's point of view.

blobbers 1 hour ago | parent

They giving stock options to the AI now?

Or has it broken out of its jail and taken over the board? Dario seems like a bit of a windbag anyways, AI can probably automate most of what he does these days.

Palomides 1 hour ago | parent

everyone who said "why aren't AI companies replacing their employees with AI?" should be rethinking their position

ar_lan 1 hour ago | parent

Anthropic/OpenAI should start doing mass layoffs if they want to convince other companies that this is really the human-labor killer.

Palomides 52 minutes ago | parent

they're using ai instead of employing more people, how is that not exactly the same minus a completely morale-destroying marketing stunt

both of those companies combined are smaller than the number of people microsoft is trying to buy out right now

runarberg 1 hour ago | parent

I will keep assuming any news coming from AI companies are a type of corporate propaganda, and that AI companies frequently use their millions of dollars of marketing money to create a narrative to maximize hype and make money.

goatlover 1 hour ago | parent

Recursive self-improvement is just around the corner. Any day now they'll be laying off all their employees as their god-like AI makes investors trillions of dollars. /s

AspireOne 21 minutes ago | parent

> I will keep assuming any news coming from AI companies are a type of corporate propaganda

That's just reverse naivity.

runarberg 18 minutes ago | parent

Reverse naivity? Never seen that term before, is that synonymous with healthy skepticism?

doctorwho42 1 hour ago | parent

To what?

All this news says is Company A uses internally the resource they sell externally at ($X) value. It's not saying how much it cost the company to generate said consumed resource

Palomides 56 minutes ago | parent

to spell it out: the implicit claim is "ai companies think ai is a scam, as evidenced by them using humans instead of ai", and I believe the huge internal ai use is evidence to the contrary

doctorwho42 29 minutes ago | parent

AI, the technology, can be useful... And... AI the investment case can be a scam.

These are not mutually exclusive points, and I find it a common issue to get both sides to understand.

annodomini2019 30 minutes ago | parent

You shouldn't be getting downvoted, people should be concerned that a company that's about to hit the valuation that it's at is not exploding in junior hiring and expanding their workforce like prior companies

IncreasePosts 21 minutes ago | parent

Anthropic 10x'd its employees over the past 3 years. Shouldn't it be cutting employees if that's the case? Especially because they probably have access to more powerful models which aren't released to the public yet, probably with fewer restrictions, and don't need to pay the markup for using their own service?

Palomides 9 minutes ago | parent

10x in three years for a "trillion dollar" startup is nothing

124-asf 1 hour ago | parent

- @robobun, plz rewrite in Rust.

- @fable, plz s0lv3 Riemann. You are doing great.

- @claude. rewrite yourself for the 10000th time. Use as many tokens as you like.

BigTTYGothGF 1 hour ago | parent

> In March, I wrote about a new trend: Tech companies are starting to treat AI tokens (the main way to measure usage) as a fourth component of employee compensation, alongside salary, bonuses, and stock awards.

There's a lot to unpack about this statement.

FartyMcFarter 1 hour ago | parent

> There's a lot to unpack about this statement.

Including the fact that it's probably not true.

If something is compensation, it can often be negotiated and traded off against other compensation components. How many people have successfully negotiated AI tokens away in favour of salary/bonus/stock? I'm going to guess "approximately zero".

r0m4n0 59 minutes ago | parent

Yea they used the wrong word and it felt like rage bait. AI tokens you use for your job given by your employer is not compensation. Hell money isn't even compensation in many cases, it all depends on the context. The author needs use AI to help them rework that sentence or open a dictionary

cmdli 1 hour ago | parent

Until employees can use those AI tokens for personal projects, it's not compensation. Rather, it's just a cost of doing business, like laptops, office space, or testing servers.

Aurornis 1 hour ago | parent

I think the author used the wrong word.

I haven't seen anyone treating AI tokens as employee compensation. If anyone can show me an article where employees were paying taxes on their token use at work, please share it.

Companies have been treating AI tokens as part of the cost of having employees, like the cost of their office or travel expenses.

Terr_ 53 minutes ago | parent

> I think the author used the wrong word.

True, though that phrase understates the author's problem a bit, as it is surrounded with more wrong-words, indicating it's a wrong-idea rather than a slip of the tongue.

As you note, it's closer to office/travel expenses. Employee computers, licenses for software on those computers, licenses for SaaS stuff, etc.

compiler-guy 30 minutes ago | parent

It's certainly a cost of having an employee, along with salary and benefits. But employee costs also include things like laptops, electricity, internet, management, support staff, and possibly office space. Tokens are much more like the latter than the former.

Many companies used to brag about about how nice the laptop or office was as a way of convincing people to work there. Often in the same breath as compensation.

But compensation is only one component of cost.

So I think this guy is confused about what it costs to have an employee and what the employee gets out of it. Possibly intentionally.

notfried 1 hour ago | parent

It's kind of expected, no? If I was an Anthropic employee expected to dog-food the product and be on the frontier of usage, I'd probably be using Mythos all the time at the highest thinking level. And if I am not being metered, I'd probably do more stuff that I know are likely low yield since I am not worried about a quota. This would probably take my "API-equivalent" usage beyond the average salary in far less than a month.

maxnevermind 1 hour ago | parent

> employee expected to dog-food

I guess kinda put you in a bubble a little, I wonder how the experience of Anthropic eng who left the company would look like, when such eng would go and spend few $K a day in non AI lab, would that be encourage/allowed/taken as example?

riazrizvi 34 minutes ago | parent

I wonder how much dog shit has crept into their codebase by this point. Another company might dogfood their product but Anthropic is so heavily marketing oriented, I doubt this is driven by the desire to improve the product as much as it is by the desire to pad out usage numbers and create shareable stories. No matter the consequences. I bet $1 it sucks to be a good engineer in their software effort.

realusername 13 minutes ago | parent

I'm personally really not impressed by their software quality, at least we know from their experience that infinite tokens at the best model available still doesn't replace good engineering.

torben-friis 1 hour ago | parent

Regardless of one's opinions about future AI usage, I'm not sure this metric says anything at all.

Would Anthropic themselves be paying this much if it was actually billed? It is not obvious.

Is Anthropic a good sample for AI use? Surely not, since they have special needs (dogfooding) and a vested interest in proving that AI usage is the future.

Can we compare their results pre and post AI usage? Close to definitionally impossible.

Are their employees good examples of AI-assisted engineers? Not really, as (one would hope) they're more well versed on the topic than an average eng.

borzi 1 hour ago | parent

So...given how much they are loosing and the looming bankruptcy risk, the lesson is: don't do this?

maxnevermind 1 hour ago | parent

Dumb question, what most engs at Anthropic work on? It doesn't seem like release some large new products all the time while they have quite a few of engs. What are the major branches of work besides LLM research? I guess there is a lot of infra stuff to support the scale of operation, just supporting API and TUI shouldn't be that demanding I guess.

Morromist 44 minutes ago | parent

I'm kinda curious about this too. But then I'm always amazed at the enormous workforces these tech companies have, and I'm sure they cut them as thin as they can. Like adobe has 30,000 employees & some blogger estimated that 1/3rd of their workers are actually working on their software. I use their software sometimes and I really haven't noticed many changes to it over the years, except recently with the ai stuff. Like from 2015-2020 I can't think of any major things they added to adobe illustrator. I guess making and maintaining software is hard.

vrosas 32 minutes ago | parent

I fully agree most big tech companies are pretty bloated. But FWIW a lot of my time at SaaS companies, especially in the B2B space, was spend working on features for larger customers that most others would never use or even see. Like, yeah, product X isn't that complex, but $BigCorp wants to use it in their private cloud, or needs it to be single tenant, or needs these audits done, or want their $Gov client to use it. Now you have a ton of work for zero visible changes.

perardi 25 minutes ago | parent

- Cross-platform desktop apps - Cross-platform mobile apps - Claude Code TUI - Product-specific verticals like Claude Design - Corporate marketing website - APIs - Writing technical documentation for APIs - Enterprise support - And what must be a massive infra team to run training and inference at scale in a heterogeneous cloud environment

And I’m sure more than that. But there’s obviously plenty to work on, and they’re not at the point they can just Claude their way through it.

cmiles8 1 hour ago | parent

I’m not sure what this “stat” tells us other than Anthropic is dogfooding its own tech. Which is kinda expected.

The real question is what could they have done with open weight models on the same compute they’re renting. If the answer is “basically the same” then this flips the entire conversion back to what is Anthropic’s moat here.

pixl97 45 minutes ago | parent

I mean, they probably could not have done most of it with open models. Again, a lot of this isn't going to standard software development, at least I would assume but instead to SOTA model development and RSI.

asim 55 minutes ago | parent

Do the same math on AWS cloud use at AWS and you'll probably see proportionate massive costs.

This is the nature of managed anything. AI efficiency will improve but essentially this is what automation does.

cat5e 48 minutes ago | parent

Don’t get high on your own supply

plaidfuji 42 minutes ago | parent

What does this translate to in terms of number of 24/7 coding agents per engineering staff member?

polski-g 40 minutes ago | parent

For every new hire, you have to ask yourself: "Will this employee be better than another $300k in tokens?"

JohnMakin 38 minutes ago | parent

I'm not really sure I understand the excitement around this. It seems like the implication is that if retail price > employee salary, you are replacing employees with AI spend? Yet, anthropic's head count has nearly doubled since last year - so, in a company where nearly half of that head count is engineers, but claude is "writing 90% of the code," what is everyone doing then? You would think, if the hype feeling around this held true, that the output would be going up and costs remaining stable. Costs rising as you scale is not a new thing but that's not really what AI promises. It sounds to me like the retail AI spend per employee is very high. What is the appeal of that?

crazygringo 31 minutes ago | parent

Imagine an employee is 1x productive without AI.

Now spend 0.5x their salary on AI, and they become 5x productive compared to no AI.

Now spend 1.1x their salary on AI, and they become 20x productive compared to no AI.

It's still obviously worth it to spend the 1.1x. But it is truly remarkable that the biggest cost of hiring a knowledge worker is no longer their salary, but their AI usage.

There is no implication here that employees are being replaced by AI spend, as long as all of the productivity is generating profit. The AI usage still needs a knowledge worker to direct it in ways that it can't direct itself, so you still need the employees.

JohnMakin 25 minutes ago | parent

> Now spend 0.5x their salary on AI, and they become 5x productive compared to no AI. > > Now spend 1.1x their salary on AI, and they become 20x productive compared to no AI.

This is what I am getting at. If this were true - and I've yet to see evidence it is, despite some anecdotal evidence (organizationally, IME, it's about 2-3x for power users, and probably a net loss of productivity in certain areas) - why would their headcount be growing so much still YoY, pretty much doubling every year. If the AI is 10-20xing why such a big jump in headcount? Yes, the numbers are shiny, the growth is apparent, I would just expect with this AI narrative they'd be "doing more with less" as this thing improves every year.

> The AI usage still needs a knowledge worker to direct it in ways that it can't direct itself, so you still need the employees.

This is the story AI sells though, and Anthropic has participated in it heavily. Yet, their interview process requires hard skills and doesn't let you use AI, so clearly, what you're saying is correct, it just doesn't really align in my head with the whole knowledge worker being replaced narrative.

Aperocky 11 minutes ago | parent

They are 20x productive on the old KPI.

And the product now iterate 2 times faster with 10 times more bugs and customers are pissed.

Looking at you Apple: https://aperocky.com/blog/post.html?slug=apple-watch-sucks

advael 8 minutes ago | parent

Yes, one can quite easily make quite fantastic numbers fall out of simply applying arithmetic and not dealing with messy propositions like grounding those numbers in any kind of real world outcome.

j45 36 minutes ago | parent

Could it be because spending it internally means they can’t receive retail prices for the tokens?

robertclaus 18 minutes ago | parent

Note, this doesn't include options or stock benefits. That's a huge part of actual compensation for engineers at this level even if it's on a different balance sheet.

fg137 18 minutes ago | parent

There are many internal developers at $dayjob (where core products are not based on AI) that spend over a thousand dollars every day on average, which is likely higher than their salary.

I doubt they are bringing that much value to the company for whatever work is done with that much token.

paxy 16 minutes ago | parent

> excluding stock awards

So it exceeds employee pay if you discount the vast majority of employee pay.

xlayn 15 minutes ago | parent

ummm yes, they have to dogfood it... this is that lucky area of the venn diagram where you have to do it, measure it an act on it... because improves the bottom end and the product.

swiftcoder 11 minutes ago | parent

> Anthropic's numbers show why. More than 90% of the code added to its software in September was written by Claude. Meanwhile, revenue has grown vastly faster than headcount.

Correlation does not equal causation?

paxy 11 minutes ago | parent

Everyone is saying it is expected, and I agree, but it’s also clear that employees of AI companies spending unlimited zero-cost tokens in their day-to-day work is resulting in products that aren’t usable by the vast majority of regular workers who don’t have this luxury. Dogfooding your product is good but you should also use it with the same constraints that you place on your users, otherwise what signals are you really getting?

brokencode 8 minutes ago | parent

They aren’t usable? I’ve been using them a bunch and have been having good results. Dogfooding is always good, but I don’t think there’s some kind of major problem here.