394

Anyone who has been surfing the web for a while is probably used to clicking through a CAPTCHA grid of street images, identifying everyday objects to prove that they're a human and not an automated bot. Now, though, new research claims that locally run bots using specially trained image-recognition models can match human-level performance in this style of CAPTCHA, achieving a 100 percent success rate despite being decidedly not human.

ETH Zurich PhD student Andreas Plesner and his colleagues' new research, available as a pre-print paper, focuses on Google's ReCAPTCHA v2, which challenges users to identify which street images in a grid contain items like bicycles, crosswalks, mountains, stairs, or traffic lights. Google began phasing that system out years ago in favor of an "invisible" reCAPTCHA v3 that analyzes user interactions rather than offering an explicit challenge.

Despite this, the older reCAPTCHA v2 is still used by millions of websites. And even sites that use the updated reCAPTCHA v3 will sometimes use reCAPTCHA v2 as a fallback when the updated system gives a user a low "human" confidence rating.

top 37 comments
sorted by: hot top controversial new old
[-] mynamesnotrick@lemmy.zip 96 points 1 month ago

Need these bots as a browser addon now. When your using a VPN these things are the bane of your Internet browsing experience.

[-] PennyRoyal@sh.itjust.works 14 points 1 month ago

And I’ll be fucked if I can get them right first time round half the time!

[-] Ketchup@reddthat.com 1 points 1 month ago

Hmmm… do you float if we throw you in the water?

I don't use a VPN and they are still highly problematic. I get stuck in a cycle, like with cloudflare.

[-] noodlejetski@lemm.ee 7 points 1 month ago

https://addons.mozilla.org/en-GB/firefox/addon/buster-captcha-solver

it switches to the accessibility version of CAPTCHA and uses speech recognition to solve it.

[-] MangoPenguin@lemmy.blahaj.zone 2 points 1 month ago

I've never been able to get this one to work, it will say it can't detect speech even though I can hear it being played.

[-] noodlejetski@lemm.ee 2 points 1 month ago

for me it works most of the time, and I don't hear the speech being played at all while it's being solved. and it the rare cases when it doesn't detect speech, requesting another puzzle usually fixes it.

[-] Fester@lemm.ee 52 points 1 month ago

So the robots are now more successful at proving they’re human than I am.

[-] OpenStars@discuss.online 10 points 1 month ago

The inverted Turing test, it would seem.

Beep boop I am smarter than you... 🎵

Bleep bloop you seem to me dumb as rock... 🎼

img

[-] zephorah@lemm.ee 30 points 1 month ago

I need a bot then. I click through 7-8 of those and still don’t pass.

[-] merc@sh.itjust.works 29 points 1 month ago

What's ironic is that the main purpose of reCAPTCHA v2 is to train ML models. That's why they show you blurry images of things you might see in traffic.

AFAIK the way it works is that of the 9 images, something like 6 are images the system knows are True or False, and another 3 are ones it is being trained on. So, it shows you 9 images and says "tell me which images contain a motorcycle". It uses the 6 it knows to determine whether or not to let you pass, and then uses your choices on the other 3 to train an ML model.

Because of this, it takes me forever to get past reCAPTCHA v2, because I think it's my duty to mistrain it as much as possible.

[-] Kuvwert@lemm.ee 15 points 1 month ago

You're wasting your time. Your fingerprint is graded and discarded if you're not reliable

[-] merc@sh.itjust.works 2 points 1 month ago

At least it adds noise to the system. It's better than the people who are happily training the AI.

[-] conciselyverbose@sh.itjust.works 4 points 1 month ago

I'm sure they use the reliability of your inputs for known images to determine whether to use your input to train unknown images.

[-] dan1101@lemm.ee 20 points 1 month ago

That's good, hopefully we will quit seeing them. Because I've gotten to the point if I see a captcha I just go to another site unless it's something I've got to do.

[-] cybersandwich@lemmy.world 6 points 1 month ago

I literally couldn't pass one for something I needed to access.

I had to switch to the audio thing eventually and it took me multiple tries with that. I should just write a script that uses a fucking bot next time.

[-] linux2647@lemmy.sdf.org 4 points 1 month ago

Apparently someone already did with this extension: https://github.com/dessant/buster

[-] _sideffect@lemmy.world 19 points 1 month ago

Ok, so can we get rid of them then? They're fucking annoying and waste time

[-] TachyonTele@lemm.ee 16 points 1 month ago

"bots trained on tests for years now able to pass them"

[-] Godric@lemmy.world 14 points 1 month ago

Mfw AI is better at proving they're a human than I am

[-] Cyberjin@lemmy.world 14 points 1 month ago

I need a bot because I get stuck in a loop of captchas

[-] echodot@feddit.uk 9 points 1 month ago

It's the age old question, does the pole count as part of a traffic light?

[-] AngryCommieKender@lemmy.world 1 points 1 month ago

Happy Cakeday! 🍰🎂

[-] ikidd@lemmy.world 13 points 1 month ago

Then give me a FF addon that does these for me because I'm nowhere near that successful.

[-] psycho_driver@lemmy.world 11 points 1 month ago

. . . that's because we've been using these images to train AI for years?

[-] ChaoticNeutralCzech@feddit.org 5 points 1 month ago

Google has. The Zürich university fella needed his own data classification monkeys.

[-] werefreeatlast@lemmy.world 7 points 1 month ago

Recaptcha 4.0.... what do you think about this image....an image of a kid riding their bike without any protective gear on a freeway.

AI: a bike with a kid on it on a road. Perfectly fine.

[-] Zoot@reddthat.com 4 points 1 month ago

Emotion provoking images sounds like an ingenious solution honestly

[-] Prox@lemmy.world 10 points 1 month ago
[-] daddy32@lemmy.world 2 points 1 month ago

"Let me tell you about my mother..."

[-] T156@lemmy.world 3 points 1 month ago

It'd be a bit unreliable, though. Not everyone has the same reaction to the same thing, nor do they express it in a similar way.

Someone might think a snake or a spider is cute, whereas another would want to incinerate it on the spot. A third might be concerned because they seem to be injured, etc.

Not to mention that image recognition/emotional analysis has been an ongoing field of research for some time. Making the link is not overly difficult.

[-] futatorius@lemm.ee 7 points 1 month ago

From a UX perspective, those things are cancer.

[-] Maggoty@lemmy.world 6 points 1 month ago

Oh good we finally trained them enough. Can we please ~~get rid of captcha now~~ have the next portion?

[-] makingStuffForFun@lemmy.ml 5 points 1 month ago

So the bots can now train the bots. About time. Now f off Google with your nasty privacy destroying captcha

[-] tarius@lemmy.ml 3 points 1 month ago

Buster is awesome to get past recaptcha. I use it with my own Speech to Text API key since its free from Google. Using Google to beat Google.

https://github.com/dessant/buster

[-] KingJalopy@lemm.ee -3 points 1 month ago

At recognizing fire hydrants...

What a dumb headline. Not sure why I'm surprised.

this post was submitted on 27 Sep 2024
394 points (99.0% liked)

Technology

59385 readers
932 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS