Secondly that much API spend would require dozens of engineers using it full time, like you'd be doing the work of an entire, quite large engineering team not a single intern

[–] SleeplessCityLights@programming.dev 20 points 2 weeks ago (2 children)

They are changing the pricing plans to move away from the subscription model to a metered model. Beause operating at a loss is not a long term goal. People have no idea what July is going to be like, when MS changes Copilot to metered in June it's going to be bad. I checked the usage for my companies plan yesterday and we are going to be paying more. At least 2x. Good luck to the companies that are burning tokens as part of their business plan. Either they get massive bills and go broke, or lose access to Ai after 5 days.

[–] Dkiscoo@lemmy.world 1 points 2 weeks ago* (last edited 2 weeks ago)

Copilot premium license is switching to metered next month? Oh wait are you talking about GitHub copilot?

[–] shuffle3765@sh.itjust.works 1 points 1 week ago

Yeah on the one hand I agree with you, for example Claude Enterprise plans are going to lose the subscription option next time they annually renew, which for us isn't for a while yet. On the other hand, the rate that new models are coming out is crazy and prices aren't going up, the result being that every month we're paying less and less per unit of work done. Sonnet 4.6 is as good as Opus 4.5 was but 1/3 cheaper. More and more companies outside the big 3 are becoming realistic contenders. I think if Anthropic start making pay their obviously over inflated API prices they'll just lose a ton of customers to cheaper inference providers. Currently I use Claude Code purely because it's the only harness you're allowed to use on the cheap subscription plan, as soon as that plan goes away I'd jump to a different company's plan, and if they all go away then I'd at least use a better harness (e.g. Pi) and a cheaper inference provider (e.g. DeepSeek). Meanwhile open source models are getting better and better and running our own inference farm is quite viable too

[–] zalgotext@sh.itjust.works 13 points 2 weeks ago

There's layers to the meme. It's also about how junior engineers are often overworked and underpaid.

[–] RamenJunkie@midwest.social 13 points 2 weeks ago (1 children)

Aren't some of the LLMs moving away from the unlimited token subscriptions since they are losing a ton of money?

I don't really follow that, I would neverpay for an LLM.

[–] itslilith@lemmy.blahaj.zone 6 points 2 weeks ago (1 children)

Or it's "Unlimited" (rate limited)

[–] RagingRobot@lemmy.world 4 points 2 weeks ago

I wouldn't care about the rate limit if it didn't make so many mistakes. It's in their best interest to make mistakes too so you use more tokens

[–] Jiral@lemmy.org 4 points 2 weeks ago (1 children)

Currently, yes. However, if you build your business on highly subsidised temporary prices , you are probably like the CEOs that can't think further than their shareholders. If you believe there will be flat rates in the end I have a bridge to sell to you.

[–] shuffle3765@sh.itjust.works 1 points 1 week ago

I currently use what would be around half my salary at the currently listed full API prices (which I doubt we'd ever have to pay but lets assume we did), and a decent portion of that is experimentation, learning, wastage etc. I could cut it down to a third of my salary if I was more conservative. And I'm building 3x more features than I was without it. That's a good deal even at full price, it's just even better now with the subscription which is why the smart thing for any engineer to do right now is to take advantage of those temporary heavily subsidised prices to get as good as they can at agent accelerated coding