242
submitted 8 months ago by ardi60@reddthat.com to c/technology@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments
[-] pixxelkick@lemmy.world 49 points 8 months ago* (last edited 8 months ago)

I 100% can see it easily selling for that much.

You want to know why it's worth that much?

Petabytes of raw training Data for LLMs. Arguably atm reddit us one of the better gold mines of LLM training data on the internet, bazillion of posts already formatted as post-response chains, which is the exact type if format an LLM wants to train on.

Can you imagine how valuable those servers loaded with posts are to a company like OpenAI, Google, or Microsoft?

5 billion is quite reasonable to harvest every reddit post that has ever been made ever and cut it off from your competitors.

[-] LittleBorat2@lemmy.ml 37 points 8 months ago

This data was out in the open for a decade and still is. People could train their llm without problems.

[-] null@slrpnk.net 4 points 8 months ago

Exactly. Why is this being upvoted?

[-] Admetus@sopuli.xyz 3 points 8 months ago

They just started charging for API usage so isn't it already not open?

[-] Corkyskog@sh.itjust.works 14 points 8 months ago

And then everyone started deleting accounts, comments and even rewriting and poisoning their comments. The data was way better before the API change.

[-] pixxelkick@lemmy.world 3 points 8 months ago

Do you actually think this has any impact? That's silly.

Reddit's servers have the original copy of every single post made, undoubtedly, and everytime you edit your post, they store that copy too.

So not only has everyone "poisoned" their data ineffectively, they literally have created training data of "before" vs "after" poisoning to compare the two for training the LLM against poisoned data.

Whoever buys the right to that is going to have a pretty huge goldmine, and perhaps they will rent it out, or perhaps they'll use it themselves.

[-] pixxelkick@lemmy.world 2 points 8 months ago

Not legally / free.

And yes, that very very much matters if you intend to actually sell the service to companies that they themselves dont want to get hit in the crossfire of potential lawsuits for building their products on top of stolen info.

So if you can own the data itself (via buying reddit), you now have an ENORMOUS quantity of prime training data that you're investors and potential customers know is legally clean, because you literally own it.

load more comments (18 replies)
this post was submitted on 29 Jan 2024
242 points (90.6% liked)

Technology

34505 readers
605 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS