Section (9) here suggests some performance gains with IPv6 from several companies:
https://www.akamai.com/blog/trends/10-years-since-world-ipv6-launch
Could it be the the IPv6 hardware infrastructure in these companies is newer and/or less utilized hardware vs IPv4 infrastructure?
If you read further that seems to be down to sub-optimal IPv4 usage rather than IPv6 being inherently better:
The reasons for better performance with IPv6 vary widely but may include:
ISPs that network address translate (NAT) IPv4 traffic but natively route IPv6 traffic, especially in cases where the NATs experience congestion or runs out of IPs/ports
IPv6-centric ISPs that deploy IPv4aaS over IPv6, especially when IPv4 traffic is routed through more central egress services while IPv6 can break out at the edge
Emerging cases where limited availability of IPv4 addresses mean that IPv6 services can be deployed with a broader global footprint
So CG-NAT is bad, yeah kinda to be expected but does not apply to anyone using pure IPv4.
IPv6 centric ISPs seems like it would be a pretty niche case, though perhaps relevant for alt-nets.
The latter seems kinda niche too given the big CDNs will use a few IPv4 addresses that are router different depending on your region, hitting local cache servers.
I'd imagine also bad ISP routers struggling to do NAT effectively could also be a reason, their job is much easier on IPv6, though quite where these mystical routers with good IPv6 support are I do not know.

Plus like you said, if the IPv6 network is less loaded then things like Happy Eyeballs on Chrome, trying both and preferring the first protocol to respond, will likely load quicker over IPv6.