224
AI models fed AI-generated data quickly spew nonsense
(www.nature.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 26 Jul 2024
224 points (96.7% liked)
science
14597 readers
123 users here now
just science related topics. please contribute
note: clickbait sources/headlines aren't liked generally. I've posted crap sources and later deleted or edit to improve after complaints. whoops, sry
Rule 1) Be kind.
lemmy.world rules: https://mastodon.world/about
I don't screen everything, lrn2scroll
founded 1 year ago
MODERATORS
I find it surprising that anyone is surprised by it. This was my initial reaction when I learned about it.
I thought that since they know the subject better than myself they must have figured this one out, and I simply don't understand it, but if you have a model that can create something, because it needs to be trained, you can't just use itself to train it. It is similar to not being able to generate truly random numbers algorithmically without some external input.
Sounds reasonable, but a lot of recent advances come from being able to let the machine train against itself, or a twin / opponent without human involvement.
As an example of just running the thing itself, consider a neural network given the objective of re-creating its input with a narrow layer in the middle. This forces a narrower description (eg age/sex/race/facing left or right/whatever) of the feature space.
Another is GAN, where you run fake vs spot-the-fake until it gets good.