Hi
I've been using pfSense 2.4.5 on metal with 4 cores enabled and not needed any workarounds, so I guess lucky in that respect, but if affected then p1 release is due soon and fixes it. I've no packet loss or latency issues on the BQM graph or gateway drops, but then I'm also not with Virgin media, which on the charts I've seen for them, always look poor and jagged.
As your troubling shooting shows sometimes these things are hard to pin down.
If it is only spikes on pfSense and the dropping of the gateway is resolved are those spikes causing a problem? Remember that the monitoring is only testing pings, which could just be getting a lower priority on pfSense internally in its code than maybe OPNSense. You could try turning on QoS and putting pings into real-time traffic queue to see if that results in a better chart. Also if pfSense is only running on 1 core for the work around, that might be enough to affect the ping responses as well.
Regards
Phil