Let me see if I can explain:
- Return a scout to your base that carries at least one sheep.
- Make sure the scout pathes its way just besides the vill constructing a stone wall.
- See how the sheep stop following the scout.
This may also be happening with other constructions, such as palisade walls. I did notice it while building stone walls.