Stuck with 300ms?

Was playing a 3v3 today, all of a sudden near the tail end of the match I began noticing huge input delay. After the game was over I see that my ping as shown on the bottom left next to my portrait and level is showing 300ms to the closest server, and up to 1000 for others.

Other games are stable, my 6000 bit rate stream is perfectly fine. Are AoE servers having issues, because my teammates are not having the same issues as me.