Issue downloading the game

I am trying to download AOE IV from Xbox app on my PC. After about 15GB of download, the download speed drops to less than 1 MB/S. I tried contacting Microsoft support and didn’t get any useful help from them.
My internet is working just fine, in fact, all other apps/games downloads on the Microsoft Store and the Xbox app happen at much high speed (20 MB/S - 40 MB/S). Even AOE IV download starts off fine, but after downloading half of it, it just drops to a few KB/S.
My windows is up to date, and all apps from the Microsoft store are also updated. I am not sure what else I can try to speed up the download. at 500 KB/S, it’s going to take days to download the game, assuming it doesn’t break somewhere along the way.
Any help is appreciated, thanks!