The thing that immediately springs to mind with the symptoms as described is bit-swap not working correctly. But I think that if same happens on both the Huawei and Draytek modems, then that rules that out. On reflection re0 raises a valid point, as if it also happens using the Openreach supplied Huawei without any stats, then it could be throughput as opposed to sync.
G.Fast is supposed to use SRA. So will lower sync speed on the fly, but tends to need a full resync to get any increase in speed.