Problem with cohesion with all the new DLCs and mechanics

Castles are insanely expensive and take a long time to build. If sokeones dropping it right in the middle of your town and you cant stop it the game wws already over