Technology
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
view the rest of the comments
TIL a $7000 laptop is "reasonably specced"
You can run it on smaller hardware too, people managed to get 3.6 to run with 16 gb ram with stuff like quants and MTP. But the fact that you can run a model that performs as well as a frontier model from half a year ago on any laptop is frankly mind blowing.
I've got it running on 12gb at lowest quant at a decent speed, like 30toks
How's the output quality on the lowest quant?