As a work-around until the bug is fixed, build your walls in a similar position shown in the Ornlu video below and do not destroy any bridges. Particularly destroying the long bridge in the southwest of the map appears to create issues with the waves of units that spawn and attack your defenses.
