Spectating cross-network games on Xbox Series S does not work

I enabled cross-network gaming on my Xbox Series S. I can see all the available cross-network multiplayer games in AOE4, but it consistently fails to connect to the lobby/game. The loading indicator spins for about a minute before showing a generic error message about network problems.

However, spectating games within the Xbox network works fine.