Hey is GPU support working? Has anyone been able to pass a GPU through to the container? If so what configurations did you add to the app?
On a separate note, when I run the large models I don't actually see my RAM usage go up to the supposed 20GB+, has anyone else experienced this? Would be good to know your experiences
Anyway, really cool project, much appreciated!