this post was submitted on 13 Jan 2024
580 points (95.7% liked)

People Twitter

5230 readers
329 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

  1. Mark NSFW content.
  2. No doxxing people.
  3. Must be a tweet or similar
  4. No bullying or international politcs
  5. Be excellent to each other.

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] jet@hackertalks.com 43 points 10 months ago (1 children)

Where did they get their voice?

[–] Szymon@lemmy.ca 64 points 10 months ago (3 children)

You can train AI with just a single voice clip. You can do this on your desktop. Microsoft doesn't need to sell shit, you put that clip on tiktok yourself.

[–] brrt@sh.itjust.works 12 points 10 months ago (2 children)

You don’t even need to upload anything. They can call you, have a short convo and then just say “oh sorry wrong number” or something. You’d never know.

[–] SomeGuy69@lemmy.world 2 points 10 months ago* (last edited 10 months ago)

Yup. You need like 5 to 15 seconds of talking, that's it. I've done this myself to confirm it works actually quite well with.

[–] zarkanian@sh.itjust.works 2 points 10 months ago

Yet another reason to screen your calls. I never pick up unless I know the number.

[–] thanks_shakey_snake@lemmy.ca 8 points 10 months ago (2 children)
[–] tiramichu@lemm.ee 52 points 10 months ago (2 children)

The 'old' way of faking someone's voice like you saw in 90s spy movies was to get enough sample data to capture each possible speech sound someone could make, such that those sounds can be combined to form all possible words.

With AI training you only need enough data to know what someone sounds like 'in general' to extrapolate a reasonable model.

One possible source of voice data is spam-calls.

You get a call, say "Hello?" And then someone launches into trying to sell you insurance or some rubbish, you say "Sorry I'm not interested, take me off your list please. Okay, bye" and hang up.

And that is already enough data to replicate your voice.

When scammers make the call using your fake voice, they usually use a crappy quality line, or background noise, or other techniques to cover up any imperfections in the voice replica. And of course they make it really emotional, urgent and high-stakes to override your family member's logical thinking.

Educating your family to be prepared for this stuff is really important.

[–] minibyte@sh.itjust.works 14 points 10 months ago

Clutch explanation. I just sent a screenshot of your comment to my folks.

[–] Hildegarde@lemmy.world 7 points 10 months ago (2 children)

Soo.... use a funny voice when answering the phone? Poison the data

[–] HerbalGamer@sh.itjust.works 11 points 10 months ago

Keep a helium balloon on you at all times, just in case.

[–] mindbleach@sh.itjust.works 2 points 10 months ago

Suddenly your parents get a desperate plea for money from that Simpsons waiter who had a stroke.

[–] Szymon@lemmy.ca -1 points 10 months ago (2 children)

Yeah I'm gonna go ahead and not give that knowledge out.

[–] thanks_shakey_snake@lemmy.ca 1 points 10 months ago

Okay well thanks for letting me know lol

[–] AVincentInSpace@pawb.social 1 points 10 months ago (1 children)

It's okay to say you don't know

[–] Szymon@lemmy.ca -1 points 10 months ago* (last edited 10 months ago) (1 children)

Oh gee, someone on the Internet thinks I'll say it if they tell me they think I'm bluffing. My ego is so hurt! I'd better spill the beans on these unregulated technologies!

[–] AVincentInSpace@pawb.social 1 points 10 months ago* (last edited 10 months ago) (1 children)

Do you think you're protecting some too-powerful technology that should stay secret? Am I seriously the only person in this thread who knows how to use a search engine?

[–] Szymon@lemmy.ca 1 points 10 months ago* (last edited 10 months ago) (1 children)

If they're too stupid to figure it out, they're too stupid to consider its implications and consequences when using it. I'm not going to give a weapon to a toddler for the same reason.

[–] thanks_shakey_snake@lemmy.ca 1 points 10 months ago (1 children)

I wouldn't describe myself as "too stupid to figure it out," more like "interested in hearing more about your contribution to the conversation."

Bit rude to call me stupid for that, IMO.

[–] Szymon@lemmy.ca 1 points 10 months ago (1 children)

Again, not interested in teaching people how to fake shit, I'm already sick of fake shit and it's just started.

[–] thanks_shakey_snake@lemmy.ca 1 points 10 months ago (1 children)

Which, again, is fine, but doesn't make me stupid for asking. That's a rude thing to say, and completely unwarranted here.

(And it's not like I was asking you to draft me a tutorial anyway, lol)

[–] Szymon@lemmy.ca 0 points 10 months ago

Bless your heart

[–] unexposedhazard@discuss.tchncs.de 8 points 10 months ago (1 children)

Well they said they dont share their voice anywhere, if thats true it would be concerning. I for one just dont use any centralized unencrypted services that could scrape my voice but i would assume most people think that if they dont publish anything, they are safe...

[–] overzeetop@lemmy.world 5 points 10 months ago (1 children)

You don’t talk to anyone on the phone through a pbx? Never call your bank? Your doctor? Your credit card company? Any of your insurance company? Even on private systems all of those calls are recorded for legal reasons. And all of them will eventually be compromised.

[–] unexposedhazard@discuss.tchncs.de 1 points 10 months ago

I make regular phone calls maybe twice a year, everything can be done by email or web forms in germany. But generally the people who have access to all the phone lines are the feds of whichever country you are in. And they, unlike big tech arent super interested in selling that data.