Your only as fast as the slowest computer from those on the server you are playing with. So until all players have loaded the game you will have to wait.
If all players have the "
GWX no land unit mod" which was provided to us by the Great Jimbuna
, than load times would be under a minute as it does not load the entire world.
It will just load the area of the world that the map was made in.
The next trick is getting all players to have and enable this superb mod.