self

Running llama-2-7b-chat at 8 bit quantization, and completions are essentially at GPT-3.5 levels on a single 4090 using 15gb VRAM. I don't think most people realize just how small and efficient these models are going to become.

[cut out many, many paragraphs of LLM-generated output which prove… something?]

my chatbot is so small and efficient it only fully utilizes one $2000 graphics card per user! that’s only 450W for as long as it takes the thing to generate whatever bullshit it’s outputting, drawn by a graphics card that’s priced so high not even gamers are buying them!

you’d think my industry would have learned anything at all from being tricked into running loud, hot, incredibly power-hungry crypto mining rigs under their desks for no profit at all, but nah

not a single thought spared for how this can’t possibly be any more cost-effective for OpenAI either; just the assumption that their APIs will somehow always be cheaper than the hardware and energy required to run the model

the r/SneerClub archives are finally online! this is an early v1 which contains 1,940 posts grabbed from the Reddit UI using Bulk Downloader for Reddit. this encompasses both the 1000 most recent posts on r/SneerClub as well as a set of popular historical posts

as a v1, you'll notice a lot of jank. known issues are:

• this won't work at all on mobile because my css is garbage. it might not even work on anyone else's screen; good luck!
• as mentioned above, only 1,940 posts are in this release. there's a full historical archive of r/SneerClub sourced from pushshift at the archive data git repo (or clone git://these.awful.systems/sneer-archive-data.git); the remaining work here is to merge the BDFR and pushshift data into the same JSON format so the archives can pull in everything
• markdown is only rendered for posts and first-level comments; everything else just gets the raw markdown. I couldn't figure out how to make miller recursively parse JSON, so I might have to write some javascript for this
• likewise, comments display a unix epoch instead of a rendered time
• searching happens locally in your browser, but only post titles and authors are indexed to keep download sizes small
• speaking of, there's a much larger r/SneerClub archive that includes the media files BDFR grabbed while archiving. it's a bit unmanageable to actually use directly, but is available for archival purposes (and could be included as part of the hosted archive if there's demand for it)

if you'd like the source code for the r/SneerClub archive static site, it lives here (or clone git://these.awful.systems/sneer-archive-site.git)

RationalWiki is a highly biased cancel community which has attacked people like Scott Aaronson and Scott Alexander before.

Background on the authors according to a far-left website.

Let's at least be honest.

That is profiling work. (Not just "Ad hominem".)

The clash with the name "rational-wiki" is too strong not to be noted.

as the infrastructure admin of a highly biased far-left cancel community that attacks people like Scott Aaronson and Scott Alexander: mmm delicious

for bonus sneers, see the entire rest of the thread for the orange site’s ideas on why they don’t need therapy:

I was about to start psychotherapy last month, I ask my family's friend therapist If he could recommend me where to go. So he interviewed me for about 30 mins and ask me about all my problems.

A week later he send me the number of the therapist. I didnt write her yet, I think I dont need it as badly as before.

Those 30 mins were key. I am highly introspective and logical, I only needed to orderly speak my problems.

to quote Key & Peele: motherfucker, that’s called a job

hey let’s see what the people who killed and buried hacker culture think should go in the jargon file!

If the spirit of the original Jargon file was to be a living document, alas, it failed to keep with the times.

Hackers at large have moved away from Lisp despite Paul Graham and other evangelists […]

Hackers also have moved away from academia at large, and 9-5 jobs at tech behemoths are more natural habitats for them, which also shaped the lingo. I mean, there’s a whole layer of slang usually pertinent to outsourcing agencies and to cubicle farms.

I can’t wait for the corporate-approved jargon file, with any hint of anti-capitalism replaced with fun words and quotes from billionaires to share as the soul leaves my body

So in order for the document to evolve, we need a system to determine consensus. Everyone who cares runs a program on their computer that joins the network and registers their intent. With each proposed change, a query goes out to the network, and it's up to everyone on the network to say yea or nay to the proposal. With enough "yea"s, the document is updated.

...this is starting to sound like a blockchain, isn't it.

for the absolute sake of fuck. coming soon: HackerDAO! collect 10xer tokens and finally prove to the junior devs why corporate gives you so many points to crunch on! vote on fun new jargon, but only if it’s crypto-related! surely you’re hacker enough to be on the pump side of this pump and dump!

reposting here for better visibility (let me know if there’s a better way to do this now that we’re federated): the owners of hachyderm.io just started a generative AI for gaming project, and it looks like donations to them will likely end up going to that

It's because there is a vast concerted effort by the political left to destroy Musk now that he is no longer regarded as being strictly on their side. It's at Trumpian scale these days, in terms of the venom being directed at him.

Reddit is overflowing with non-stop Musk hatred. They spout lie after lie about him in every single thread where he's a topic. The most popular lie being that his business efforts - ie his success - were funded by an emerald mine that his father owned (neither thing is true).

I say this as an emotionally independent, objective observer of the craziness, I have no stake in it, and don't feel one way or another about it. The seeming mental illness the topic of Musk seems to draw out of people is astounding however, the herd promptly acts like deranged lunatics when he comes up as a topic.

Until Trump I had never seen anything like it before, in person or online. There must be a name for such a massive scale of crowd insanity, to describe the frothing-at-the-mouth irrationality.

my deranged lunatic hivemind venomous mentally ill frothing-at-the-mouth leftist brain can’t handle how rational this fucking asshole’s take on musk and trump is

there’s also this at the top of the thread:

I've been mostly ambivalent about the Musk-era at Twitter—mostly because I just don't care enough to have an opinion.

This, though. This one makes me angry and disappointed.

Twitter has had such a solid brand for so long. It's accomplished things most marketers only dream of: getting a verb like "Tweet" into the standard lexicon is like the pinnacle of branding.

turning one of the most popular sites on the internet into a cesspit of transphobia and nazis: ambivalent

musk fails to appreciate the Twitter brand: angry and disappointed

remember, hacker news is a bastion of high-quality discussion. fucking shitheads

Bevy is a fun, cozy game engine to play with if you’re looking for something very flexible that implements some surprisingly advanced features. things I like:

• it’s all rust, which is an advantage for me and the chemical burns I have from handling the dialect of C++ a lot of older game engines used to be written in
• it implements a flexible entity component system, which I found pretty great for specifying game and rendering logic for things like roguelikes and simulations, where multiple game systems might interact in dynamic ways
• the API is very cozy and feels like querying an extremely fast database at times
• it’s a lot lower level than something like Unity or Godot, but you get some pretty advanced rendering features included
• the main developer seems to have a lot of industry experience and a solid roadmap

Nix is one of the few pieces of software I trust. I use it on just about every computer I work on — awful.systems is managed and deployed by just nixos-rebuild and a deployment flake, as are almost all the computers in my house (including a few embedded into the house itself). in general it makes both software development and configuring Linux a lot more fun compared with the traditional way of doing things

I often call Nix fucking incomprehensible, but it doesn’t need to be. Zero to Nix is one of the documentation projects that’s intended to be a more gentle goal-oriented introduction to Nix concepts, and it’s definitely worth following along if you’re curious about Nix and want to be able to do something useful with it right away

if you end up liking Nix and want more of it, NixOS is an entire Linux distro configured and managed by Nix, and it’s incredibly powerful and stable. I run it on a full-fat gaming PC as my primary OS and the experience of running it is surprisingly very good; feel free to ask and I’ll summarize how I run stuff like games on NixOS

the API is called Web Environment Integrity, and it’s a way to kill ad blockers first and a Google ecosystem lock-in mechanism second, with no other practical use case I can find

Winter is coming and Collapse OS aims to soften the blow. It is a Forth (why Forth?) operating system and a collection of tools and documentation with a single purpose: preserve the ability to program microcontrollers through civilizational collapse.

imagine noticing that civilization is collapsing around you and not immediately opening an emacs lisp buffer so you can painstakingly recreate the entire compiler toolchain and runtime environment for the microcontrollers around you as janky code running in your editor. fucking amateurs

Wolfram’s post is fucking interminable and consists of about 20% semi-interesting math and 80% goofy shit like deciding that the creepy (to Wolfram) images in the AI model’s probability space must represent how aliens perceive the world. to my memory, this is about par for the course for Wolfram

the orange site decides that the reason why the output isn’t very interesting is because the AI isn’t a robot:

What we see from AI is what you get when you remove the "muscle module", and directly apply the representations onto the paper. There's no considering of how to fill in a pixel; there's just a filling of the pixel directly from the latent space.

It's intriguing. Also makes me wonder if we need to add a module in between the representational output and the pixel output. Something that mimics how we actually use a brush.

this lack of muscle memory is, of course, why we have never done digital art once in the history of humanity. all claims to the contrary are paid conspirators in the pocket of Big Dick Blick

Of course, the AIs can't wake up if we use that analogy. They are not capable of anything more than this state right now.

But to me, lucid dreaming is already a step above the total unconsciousness of just dreaming, or just nothing at all. And wakefulness always follows shortly after I lucid dream.

only 10x lucid dreamers wake up after falling asleep

we can progressively increase the numerical values of the weights—eventually in some sense “blowing the mind” of the network (and going a bit “psychedelic” in the process)

I wonder if there's a more exact analog of the action of psychedelics on the brain that could be performed on generative models?

I always find it interesting how a hero dose of LSD gives similar visuals to what these image AI's do to achieve a coherent image.

[more nonsense]

I feel like the more we get AI to act like humans, and the more those engineers and others use LSD, the more convergence we are going to have with curiosity and breakthroughs about how we function.

the next time you’re in an altered state, I want you to close your eyes and just imagine how annoyed you’d be if one of these shitheads was there with you, trying to get you to “form a BCI” or whatever by typing free association words into ChatGPT