It might be the router going back , or more then likely your isp throttling you down after the initially speed surge. Could be other things too though.
It might be because its a free server, they generally don't provide high speed for free. I have never taken notice what my download speeds are from that server, as I just let it run automatically using the app they provide.