this post was submitted on 03 Dec 2025
809 points (99.0% liked)
Programmer Humor
27635 readers
983 users here now
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
Rules
- Keep content in english
- No advertisements
- Posts must be related to programming or programmer topics
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't know what your products are. I'm speaking specifically about LLMs and LLMs only.
Seriously research the cost of LLM services and how companies like Anthropic and OpenAI are burning VC cash at an insane clip.
That's a straw man.
You don't know how often we use LLM calls in our workflow automation, what models we are using, what our margins are or what a high cost is to my organization.
That aside, business processes solve for problems like this, and the business does a cost benefit analysis.
We monitor costs via LiteLLM, Langfuse and have budgets on our providers.
Similar architecture to the Open Source LLMOps Stack https://oss-llmops-stack.com/
Also, your last note is hilarious to me. "I don't want all the free stuff because the company might charge me more for it in the future."
Our design is decoupled, we do comparisons across models, and the costs are currently laughable anyway. The most expensive process is data loading, but good data lifecycles help with containing costs.
Inference is cheap and LiteLLM supports caching.
Also for many tasks you can run local models.