Do we need to try to restore games that haven't started yet?

I really like the feature to restore games that have gone out of sync, but more times than not this happens before the game has even started. Do we really need to wait to try and restore a game that hasn’t even started yet? Maybe anything less than 2 minutes we can just immediately scrap?