but everyone including the DM needs to agree to it beforehand.

Exactly, it can be a lot of fun if everyone is on board. So many great ttrpg memories have come from that kind of chaos, but they're only good memories because everyone at the table consented to join the chaos.