166
submitted 1 year ago by floofloof@lemmy.ca to c/technology@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments
[-] j4k3@lemmy.world 16 points 1 year ago

Feels like a minds war waged by billionaires in this space when you're actually playing with this stuff. All this hype is a joke as are the proprietary junk. Get a decent comp and try offline AI yourself and see what it can do. Try Llama2 70B Q4 GGML. You need a machine with more than 10-12+ cores and at least 64GB of system memory. It really helps to have a Nvidia GPU with 16GB+ but you don't have to have that here. This model can write python snippets like you're searching stack overflow but an order of magnitude faster. If you know basic code elements, branching, and looping, this model can code, and resolve its errors when it gets something wrong by prompting it with the error message. A 30B like WizardLM or Vicuna are almost technically useful, but the 70B is a beast.

That doesn't sound simple by any measure.

[-] Zrybew@lemmy.world 13 points 1 year ago* (last edited 1 year ago)

What they're trying to say is: very soon these models will run on your smartphone without internet connection and OpenAi will be no more.

[-] 520@kbin.social 3 points 1 year ago

The hardware is massively high end for sure. Question is, is it worth it?

[-] INeedMana@lemmy.world 4 points 1 year ago

In 5-10 years time these will be "recommended system requirements"

this post was submitted on 22 Aug 2023
166 points (94.1% liked)

Technology

34789 readers
416 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS