this post was submitted on 05 Feb 2026
336 points (99.7% liked)

Technology

80635 readers
3140 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] trolololol@lemmy.world 1 points 4 hours ago (1 children)

Curious here, this is base 64? And what's behind it is more often than not an image or text? And you need to do ocr to get the characters?

Maybe for the text it could use a dictionary to rubber stamp whether that zero is actually a letter oh, etc etc?

I'm curious to know what the challenge is and what your approach is.

[–] kescusay@lemmy.world 4 points 4 hours ago (1 children)

Yes, it's base64. And what's behind it could be anything that can be attached to an email.

In this case, it's a PDF. If the base64 text can be extracted accurately, then the PDF that was attached to the email can be recreated.

The challenge is basically twofold:

  1. There's a lot of text, and it needs to be extracted perfectly. Even one character being wrong corrupts it and makes it impossible to decode.
  2. As the article points out, there are lots of visual problems with the encoded text, including the shitty font it's displayed with, which makes automating the extraction damn near impossible. OCR is very good these days, but this is kind of a perfect example of text that it has trouble with.

As for my approach, I'm basically just slowly and painstakingly running several OCR tools on small bits at a time, merging the resulting outputs, and doing my best to correct mistakes manually.

[–] trolololol@lemmy.world 1 points 2 hours ago

Ah yes pdf is a clusterfuck where anything is valid I think, so minimal redundancy.

Text and image formats are way more lenient and are full of redundancies.