I enabled cross-network gaming on my Xbox Series S. I can see all the available cross-network multiplayer games in AOE4, but it consistently fails to connect to the lobby/game. The loading indicator spins for about a minute before showing a generic error message about network problems.
However, spectating games within the Xbox network works fine.