Speed is not decided by the server
The channel to the server is roughly the same for everyone. The difference begins where the network starts losing packets.
Ordinary protocols read a loss as a traffic jam and drop the speed. On a wire at home that is right. On mobile, on someone else’s Wi-Fi and on a crowded international link there is always loss — and the speed falls where the channel is in fact free.