Progression
Scouts → Find a passage → Army appears → go behind the mountain → Destroy the first Keep → Now the wall is yours
Villagers and Town Center appears on the edge of the map, but the gate of the wall is “close” even though the icon appears “Auto”…Villagers and Packed Town Center start to go all the way around the mountain as you previously did, instead on going right through the wall you own now…
Player Solution, change the gate to “Close” and back to “Auto” now they can pass through the gate