Yeah, they usually contain gelatin, which is extracted from animal skins and bones.

Vegan gelling agents are available (and in fact, marshmallows originally used marshmallow roots), but I guess, gelatin is just so cheap, because it's a waste product from animal slaughter.