Hi RobN,
It would help if you provided information on your ISP, tariff and modem stats.
Assuming that your modem is synchronising correctly at all times and without excessive error counts, some contention seems the most likely cause.
If so it could be anywhere en route through your ISP's network.
Another possibility is that a FUP trigger level has been exceeded which causes throttling during busy periods.
Kind regards,
Walter