I've got my instance of matrix working with voice calls. It's not built in, but it's just another service in my compose file alongside the bridges I use to have my unified chat app.

I'm using coturn and it just works when doing voice and video calls with federated users.

I think I've seen people using jitsi as well, so it seems there are many options available