Thanks for the help. This is my output from the same command (also running headless, I had previously just booted in GUI mode with a display for testing purposes).
root@Marvin:~# ls -lR /dev/dri
/bin/ls: cannot access '/dev/dri': No such file or directory
root@Marvin:~# modprobe amdgpu
root@Marvin:~# ls -lR /dev/dri
/bin/ls: cannot access '/dev/dri': No such file or directory
root@Marvin:~# lsmod | grep amdgpu
amdgpu 4308992 0
gpu_sched 20480 1 amdgpu
i2c_algo_bit 16384 1 amdgpu
drm_kms_helper 163840 1 amdgpu
ttm 73728 1 amdgpu
drm 356352 4 gpu_sched,drm_kms_helper,amdgpu,ttm
backlight 16384 3 video,amdgpu,drm
i2c_core 45056 5 drm_kms_helper,i2c_algo_bit,amdgpu,i2c_piix4,drm
root@Marvin:~#
EDIT: Closing this report as it was my own mistake, not an unraid bug. I previously had my IOMMU group containing the APU bound to VFIO at boot, and had forgotten to disable this.