Cav will always be good specially in the team games where you need to move long distance.There are ways to balance it.
Option 1:Adding towers ability to call spear militia.They will have hp of the villager but attack of the spearman.It will cost 100 food to summon them and they will have death timer also cant able to leave the area of tower and will cost no population.They will spawn if you purchased an upgrade in the tower for arrow upgrade 2 militia,for springald 3,for bombard 4 militia.
Option 2:Lowerin cavs siege attack so they cant burn down defences immediatly.
Option 3:Adding towers a good anti cav attack.
Option 4:Making all spearman Abbasid spearman so they can attack with longer reach.
Option 5:Adding crossbows a special tech that incerase damage against knights so they can snipe them down but this one also broke the game.
Like the comments says this is mostly a team game issue and if you dont go cav and raid you usually lose.