338
Parsing HTML with regex (lemmy.sdf.org)
submitted 7 months ago by pmjv@lemmy.sdf.org to c/linuxmemes@lemmy.world
40 comments fedilink hide all child comments

cross-posted from: https://lemmy.sdf.org/post/12950329

you are viewing a single comment's thread
view the rest of the comments
[-] hperrin@lemmy.world 11 points 7 months ago* (last edited 7 months ago)

Technically, regex can’t pull out every link in an HTML document without potentially pulling fake links.

Take this example (using curly braces instead of angle brackets, because html is valid markdown):

{template id="link-template"}
    {a href="javascript:void(0);"}link{/a}
{/template}

That’s perfectly valid HTML, but you wouldn’t want to pull that link out, and POSIX regex can’t really avoid it. At least not with just a single regex. Imagine a link nested within like 3 template tags.

[-] Breve@pawb.social 3 points 7 months ago

Yes, I said in my original comment that it can't universally parse and validate every HTML document. If they're older pages that don't do lots of crazy formatting then it's not too hard to use regex as a first pass then take a second pass through the results to weed out the odd stuff.

[-] hperrin@lemmy.world 8 points 7 months ago* (last edited 7 months ago)

I would argue that that is not parsing. That’s just pattern matching. For something to be parsing a document, it would have to have some “understanding” of the structure of the document. Since regex is not powerful enough to correctly “understand” the document, it’s not parsing.

this post was submitted on 29 Feb 2024
338 points (96.2% liked)

linuxmemes

20887 readers
378 users here now

I use Arch btw

Sister communities:

Community rules

  1. Follow the site-wide rules and code of conduct
  2. Be civil
  3. Post Linux-related content
  4. No recent reposts

Please report posts and comments that break these rules!

founded 1 year ago
MODERATORS
poopsmith@lemmy.world
zephyr@lemmy.world
rtxn@lemmy.world