I’d say it’s mostly about knowing what you have to do and also get used to constantly make villagers.
Once you start the game (assuming you’re starting at dark age) you want your first 8-10 villagers to collect food, after that you start adding the next one to collect wood. You want to have this amount of food collectors so you can constantly make more villagers and then advance to feudal, and having a good amount of wood collectors after that is important so once you run out of animals and berries you can sustain farms for all those food collectors.
At dark age you really don’t want any vills collecting stone or gold, since u won’t be doing anything with them unless u’re going for a specific strategy. When you get to feudal age you can start adding villagers to collect gold, so you can start making your military (like archers and swordmans).
Adding a few amount to collect stones is ok if you already have a good amount collecting gold, so you’ll be able to make a castle earlier once you get to castle age.
Pro players usually go for around 100 villagers on a 200 population limit match, but at lower levels you might still be safe with a smaller amount of them.
And most important: you want to keep your town center always working. If you end up hitting a supply block (aka need more houses) make the town center reseach something while the house is being done, and then get back to make more vills.