If i’m not wrong, this happened in AoE 4 some years ago:
If you pause a game or replay, and then click on some “info menu” that opens any kind of “window”, it unpauses the game.
The opposite also happens: if the game or replay is playing normally and you open infos, it pauses.