I might be wrong but this sounds like a quick way to make the web worse by putting a huge computational load on your machine for the purpose of privacy inside customer service chat bots that nobody wants. Please correct me if I’m wrong

WebLLM is a high-performance in-browser LLM inference engine that brings language model inference directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and is accelerated with WebGPU.

WebLLM is fully compatible with OpenAI API. That is, you can use the same OpenAI API on any open source models locally, with functionalities including streaming, JSON-mode, function-calling (WIP), etc.

We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration.

https://github.com/mlc-ai/web-llm

Maybe not the right place, not really a sneer but anyways. The Smile (aka Yorke & Greenwood from Radiohead) made a music video with StableDiffusion and I’m pretty bummed out. 😔

New post from Ed Zitron just dropped which goes into a lotta detail on OpenAI's finances around the time the deal was closing.

I've already cracked one Kendrick reference, so fuck it:

psst I see dead people

In the endless genAI shit that the bird site pushes on me, this caught my eye because it seems like a dream tool for a non-tech suit to generate blame examples for engineers https://xcancel.com/rohanpaul_ai/status/1840941643223945561