I have a Supermicro H12SSL-I-O and I have my GPUs in the physical slots that make sense airflow wise. But the causes the less power GPU to be seen as as the primary which is more annoying than I thought it was going to be. 

What I have is:
 

Nvidia Driver Version: 575.51.02

Open Source Kernel Module: No

Installed GPU(s):
0:
NVIDIA GeForce RTX 2070
C1:00.0
GPU-255a4e4c-c942-9e62-96c7-86f8bd570a48

1:
NVIDIA GeForce RTX 4060 Ti
C2:00.0
GPU-c3d8840d-95dd-a5f7-e875-0626902776df

All I need is for the 4060Ti to be `GPU 0`, and the 2070 to be `GPU 1`. 

If the Supermicro H12SSL-I-O has a BIOS setting for this, I'm not sure where it would be, but I'd be willing to change it if I can find it.

I just really don't want to physically swap the cards because then 4060Ti will exhaust directly into the 2070's intake. 

52 minutes ago, relink said:

If the Supermicro H12SSL-I-O has a BIOS setting for this

Don't know about Supermicro but my ASRock Rack server motherboard BIOS has a setting called Primary Graphics Adapter which lets me chose which graphics adapter to use as Primary (GPU 0)  if there is more than one, including iGPU.

I'll have to check for that. I've seen that setting on multiple boards but it never crossed my mind that it might allow more than two options. I've just always seen, "igpu" or "peg".

I haven't found any other way to change the priority of GPUs and watching Ollama use my 2070 for a majority of the workload, while the 4060Ti barely does anything is heart breaking lol.