Infantry are not riding them. Infantry are pushing them from behind.
The change“Speed up when infantry are nearby (and no unit is in them)”may be good. They also get extra attack but not do extra speed when Infantry are riding.
(My thoughts when I watch siege tower micro with fire lancer)