Many albums, especially comedy albums, relied on you flipping over the record. They would have jokes that talked about things on the other side. There's a Firesign Theater album where one of the characters says, "wait a minute, didn't I say that on the other side of the record?" There's a Monty Python album with a locked groove that says, "oh sorry, squire. I scratched the record." Which is brilliant.

Edit: There's another Monty Python album that has two sets of grooves and what you hear depends on which groove the needle hits first. Again, absolutely brilliant.

More famously, the end of the Beatles' peak album Sgt. Pepper's Lonely Heart's Club Band contains a locked groove which was snippets of recordings mashed-up in a bit of short multi-track recording experimentation. The CD only repeats it 2 or 3 times. The record was designed to play indefinitely.

So yeah, CDs took that away from recordings, but on the other hand, it's a lot harder to damage a CD and get an unintentional looping segment.