His units are also relatively short ranged in the early game (longbows require wood which is expensive early on), so if you mess up his sim city, he will be unable to defend properly against long range attackers.
Similarly, manors (as with any houses) can be used to help defend if properly placed.