Solutions
-
MrLJ's post in 2nd GPU doesn't show up in IOMMU Groups was marked as the answerAfter talking to a bunch of friends and troubleshooting I have found the issue.
The BIOS didn't have the switch enabled to enumerate all IOMMU in IVRS.
After setting this to enabled it now shows both GPUs in the System Devices.