I have weird issues with the USB Coral TPU as well. I have Frigate in a Home Assistant VM. It never detects the Coral if I have to restart Unraid. The Coral eventually shows up, but I then have to restart Frigate in HA to use it. I plan to try a Docker setup, but haven't gotten around to it yet.