May come down to vendor differences between ASRock & Gigabyte, maybe BIOS, maybe hardware choices.
I didn't run this server on beta, however I suspect it would be the same if my suspicions around it being related to the USB4 implementation in the kernel.
Not really anything connected other than unraid flash and keyboard/mouse, I think I need to try swapping the connected ports see if this makes a difference.