Custom Match Mongol Phantom Buildings

I’ve played a few games with my friend who played the Mongols. We noticed the glitch a few times now where during the very end of the game while I’m destroying the Mongols base. What happens is the Mongols will start building a few different structures(towers specifically) and will get stopped from building. Either because I attack the peasants, or they will run away. This leaves a tower that is at around 100HP. The problem is he can see the toward he built, but it doesn’t even exist on my game. I spent around 45 minutes trying to attack the ground and move military units exactly on top of the phantom building. We were on the phone while we played. Its impossible to win the game like that. We turned off the additional win options, so only destroying the others base would win the game.