As the title says, I think that giving horsemen a unique ability to move and attack at the same time would make them more viable and actually serve a purpose that light cavalry was made for - chasing enemies down/raiding.
Something like the Mongol Khan but in melee.