Virt-Manager, Intel-GPU-Tools and more Dockers

[karldonteljames]

32 minutes ago, dee31797 said:

yes you can run that in a command window, but the downside is it won't show up in Unraid's docker tab the way you're use too.  '

 

You can add this from the apps tab as well.  Here's a blog post on how: https://synaptiklabs.com/posts/setup-unraid-to-pull-from-docker-hub/

 

It's not straightforward, you will have to do a lot of google'ing to get it going.  

Thanks i think I've got most of the settings down:

 

just not sure what this should be:

 

I seem to be getting this error when i click apply:

/usr/bin/docker: Error response from daemon: invalid volume specification: '/mnt/user/appdata/frigate:config:ro': invalid mount config for type "bind": invalid mount path: 'config' mount path must be absolute.
See '/usr/bin/docker run --help'.

The command failed.

 

[dee31797]

2 minutes ago, karldonteljames said:

Thanks i think I've got most of the settings down:

 

 

just not sure what this should be:
 

 

I seem to be getting this error when i click apply:

/usr/bin/docker: Error response from daemon: invalid volume specification: '/mnt/user/appdata/frigate:config:ro': invalid mount config for type "bind": invalid mount path: 'config' mount path must be absolute.
See '/usr/bin/docker run --help'.

The command failed.

 

/config

[karldonteljames]

5 minutes ago, dee31797 said:

/config

Thanks that got it started, I con't have the option for webui, but i can type that in manually i suppose. Now i have the following issue in the log.

File "/opt/frigate/frigate/video.py", line 131, in __init__
self.regions = self.config['regions']
KeyError: 'regions'

 

Thank you for your help. I really appreciate it.

[dee31797]

Just now, karldonteljames said:

Thanks that got it started, I con't have the option for webui, but i can type that in manually i suppose. Now i have the following issue in the log.

File "/opt/frigate/frigate/video.py", line 131, in __init__
self.regions = self.config['regions']
KeyError: 'regions'

 

Thank you for your help. I really appreciate it.

no problem!

 

for that error, you'll have to work with the docker container's creator.

[karldonteljames]

Thanks again.

 

[xilo]

I'm having an issue getting the dhcpd / isc-dhcp-server service to start in the dhcp docker.  I have created a dhcpd.conf file and put it in the appropriate directory.  Any help is appreciated.

[dee31797]

18 minutes ago, xilo said:

I'm having an issue getting the dhcpd / isc-dhcp-server service to start in the dhcp docker.  I have created a dhcpd.conf file and put it in the appropriate directory.  Any help is appreciated.

I'd like to help but I need information to do so.  Can you post your settings for the dhcp docker?

[itimpi]

On 4/19/2020 at 12:44 AM, karldonteljames said:

Thanks i think I've got most of the settings down:

 

just not sure what this should be:

 

I seem to be getting this error when i click apply:

/usr/bin/docker: Error response from daemon: invalid volume specification: '/mnt/user/appdata/frigate:config:ro': invalid mount config for type "bind": invalid mount path: 'config' mount path must be absolute.
See '/usr/bin/docker run --help'.

The command failed.

 

You need to give the full path (one starting with a /) for the config path inside the container as otherwise docker does not know how to do the mapping.    I would also expect you to want read-write access rather then read-only so the container can update config information but that depends on the container requirements.   I would also update the description to be the path inside the container rather than the UnRAID level path although strictly speaking that is purely a cosmetic change. 

[xilo]

On 4/19/2020 at 6:48 PM, dee31797 said:

I'd like to help but I need information to do so.  Can you post your settings for the dhcp docker?

Settings are mainly default except for the IP address/bridge.

 

[dee31797]

11 minutes ago, xilo said:

Settings are mainly default except for the IP address/bridge.

 

 

I haven't tried this with macvlan networking recently, but I'm pretty sure it works.  

 

Can you send me the docker container logs as well as the dhcpd.conf file?

Edited April 21, 2020 by dee31797
correct config file name

[xilo]

40 minutes ago, dee31797 said:

I haven't tried this with macvlan networking recently, but I'm pretty sure it works.  

 

Can you send me the docker container logs as well as the dhcpd.conf file?

I certainly can. I will DM you with them.

Edited April 21, 2020 by xilo

[frank-unr]

I'm using the Handbrake docker. The /tmp should definitely be mapped to somewhere in appdata. As it is now, when you Open Source a folder with many videos, it creates a ton of files in /tmp/hb.????/ and can fill the docker image file.

 

I had to delete the docker.img and reinstall all my docker apps to fix the problem!  (granted there probably was a better way to recover from this but I'm not a docker expert)

 

I manually mapped /tmp to appdata and opened the same source as I did before. my /tmp/hb.1137/  contains almost 10 GB of files.

[dee31797]

14 minutes ago, frank-unr said:

I'm using the Handbrake docker. The /tmp should definitely be mapped to somewhere in appdata. As it is now, when you Open Source a folder with many videos, it creates a ton of files in /tmp/hb.????/ and can fill the docker image file.

 

I had to delete the docker.img and reinstall all my docker apps to fix the problem!  (granted there probably was a better way to recover from this but I'm not a docker expert)

 

I manually mapped /tmp to appdata and opened the same source as I did before. my /tmp/hb.1137/  contains almost 10 GB of files.

Hi @frank-unr

Thanks for the feedback.  Since it's a temporary folder, I don't set it to a persistent volume by default, but I understand if you want to manually map it.  

 

My /tmp in the Handbrake docker is current 12KB of files.

[frank-unr]

1 hour ago, dee31797 said:

Hi @frank-unr

Thanks for the feedback.  Since it's a temporary folder, I don't set it to a persistent volume by default, but I understand if you want to manually map it.  

 

My /tmp in the Handbrake docker is current 12KB of files.

I know it doesn't need to be persistent. But there is essentially no limit as to how big /tmp could become. For each 4k video I have in my source folder, 135MB of temporary files are created. And I think those are simply the preview images that are generated.

 

By default the docker image is 20GB in Unraid So if you have too many files (especially high quality) in a single folder, you fill completely the docker image easily. And in practice you don't even realize why the docker image gets full.

Edited April 22, 2020 by frank-unr

[dee31797]

1 minute ago, frank-unr said:

I know it doesn't need to be persistent. But there is essentially no limit as to how big /tmp could become. For each 4k video I have in my source folder, 135MB of temporary files are created. And I think those are simply the preview images that are generated.

 

By default the docker image is 20GB in Unraid is 20 GB. So if you have too many files (especially high quality) in a single folder, you fill completely the docker image easily. And in practice you don't even realize why the docker image gets full.

Thanks for the feedback.  

I'm very sorry for the confusion.  I wasn't saying you knew or didn't know, I was just saying why that temporary directory is not mapped to a volume by default.  All I can do from here is acknowledge your feedback and offer assistant to you if you need/want it.  Since you said you already mapped your /tmp directory on your system you are already good to go from that standpoint.  Of course, the other obvious thing is to limit the amount of 4k videos you have in your source folder, and/or increase the docker image size.

[frank-unr]

1 minute ago, dee31797 said:

Thanks for the feedback.  

I'm very sorry for the confusion.  I wasn't saying you knew or didn't know, I was just saying why that temporary directory is not mapped to a volume by default.  All I can do from here is acknowledge your feedback and offer assistant to you if you need/want it.  Since you said you already mapped your /tmp directory on your system you are already good to go from that standpoint.  Of course, the other obvious thing is to limit the amount of 4k videos you have in your source folder, and/or increase the docker image size.

I understand, thanks.

 

I'll leave it at that then. I have no idea what best practices are for files written inside a docker image. It just thought that the problem I ran into could potentially be avoided by default.

 

Thank you very much for this Handbrake docker and the responsive and courteous support.

[xilo]

5 hours ago, dee31797 said:

I haven't tried this with macvlan networking recently, but I'm pretty sure it works.  

 

Can you send me the docker container logs as well as the dhcpd.conf file?

Posting the issue/resolution:

 

Looks like I was missing a required declaration for the subnet in which the containers network interface resided.  The service wouldnt start without this.  Adding this subnet (even without a range/pool assigned) allowed the service to start and begin responding to DHCP Discover and dhcp requests on the configured subnets in the dhcpd.conf file.

[karldonteljames]

Does anyone know if MotionEye has an rtsp output?

 

If I run the stream from a couple of my cameras directly into frigate, the cameras seem to restart every few minutes, i'm not sure why, but I've successfully replicated this by stopping the frigate container for a couple of hours with no restarts. within a few minutes of frigate being started the cameras restart. I am running motion eye, so would be happy to feed motion eye into frigate if possible.

 

Any advice?

 

Thanks.

[parisv]

Hi I've installed the djaydev/intel-gpu-tools docker. VNC doesn't seem to work and the console is just blank. 

 

Here are my settings:

 

[dee31797]

4 hours ago, parisv said:

Hi I've installed the djaydev/intel-gpu-tools docker. VNC doesn't seem to work and the console is just blank. 

 

Here are my settings:

 

 

 

Please post the logs.

The webui from your settings is port 7800, so goto http://yourunraidip:7800

[parisv]

Thanks,

 

Where do I get the logs from?

 

The webui just shows a blank screen....

 

[dee31797]

2 minutes ago, parisv said:

Thanks,

 

Where do I get the logs from?

 

The webui just shows a blank screen....

 

 

logs: go to unraid dashboard, click docker icon, click logs

[parisv]

6 minutes ago, dee31797 said:

logs: go to unraid dashboard, click docker icon, click logs

 

[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] 00-app-niceness.sh: executing...
[cont-init.d] 00-app-niceness.sh: exited 0.
[cont-init.d] 00-app-script.sh: executing...
[cont-init.d] 00-app-script.sh: exited 0.
[cont-init.d] 00-app-user-map.sh: executing...
[cont-init.d] 00-app-user-map.sh: exited 0.
[cont-init.d] 00-clean-logmonitor-states.sh: executing...
[cont-init.d] 00-clean-logmonitor-states.sh: exited 0.
[cont-init.d] 00-clean-tmp-dir.sh: executing...
[cont-init.d] 00-clean-tmp-dir.sh: exited 0.
[cont-init.d] 00-set-app-deps.sh: executing...
[cont-init.d] 00-set-app-deps.sh: exited 0.
[cont-init.d] 00-set-home.sh: executing...
[cont-init.d] 00-set-home.sh: exited 0.
[cont-init.d] 00-take-config-ownership.sh: executing...
[cont-init.d] 00-take-config-ownership.sh: exited 0.
[cont-init.d] 00-xdg-runtime-dir.sh: executing...
[cont-init.d] 00-xdg-runtime-dir.sh: exited 0.
[cont-init.d] 10-certs.sh: executing...
[cont-init.d] 10-certs.sh: exited 0.
[cont-init.d] 10-cjk-font.sh: executing...
[cont-init.d] 10-cjk-font.sh: exited 0.
[cont-init.d] 10-nginx.sh: executing...
[cont-init.d] 10-nginx.sh: exited 0.
[cont-init.d] 10-vnc-password.sh: executing...
[cont-init.d] 10-vnc-password.sh: exited 0.
[cont-init.d] 10-web-index.sh: executing...
[cont-init.d] 10-web-index.sh: exited 0.
[cont-init.d] done.
[services.d] starting services
[services.d] starting s6-fdholderd...
[services.d] starting certsmonitor...
[services.d] starting nginx...
[services.d] starting xvfb...
[nginx] starting...
[certsmonitor] disabling service: secure connection not enabled.
[xvfb] starting...
The XKEYBOARD keymap compiler (xkbcomp) reports:
> Warning: Unsupported high keycode 372 for name <I372> ignored

> X11 cannot support keycodes above 255.
> This warning only shows for the first high keycode.

Errors from xkbcomp are not fatal to the X server
[services.d] starting logmonitor...
[services.d] starting statusmonitor...
[logmonitor] no file to monitor: disabling service...
[services.d] starting openbox...
[statusmonitor] no file to monitor: disabling service...
[openbox] starting...
The XKEYBOARD keymap compiler (xkbcomp) reports:
> Warning: Unsupported high keycode 372 for name <I372> ignored

> X11 cannot support keycodes above 255.
> This warning only shows for the first high keycode.

Errors from xkbcomp are not fatal to the X server
[services.d] starting x11vnc...
[services.d] starting app...
[x11vnc] starting...
[app] starting intel-gpu-tools...
07/05/2020 14:19:42 passing arg to libvncserver: -rfbport
07/05/2020 14:19:42 passing arg to libvncserver: 5900
07/05/2020 14:19:42 passing arg to libvncserver: -rfbportv6
07/05/2020 14:19:42 passing arg to libvncserver: -1
07/05/2020 14:19:42 passing arg to libvncserver: -httpportv6
07/05/2020 14:19:42 passing arg to libvncserver: -1
07/05/2020 14:19:42 passing arg to libvncserver: -desktop
07/05/2020 14:19:42 passing arg to libvncserver: intel-gpu-tools
07/05/2020 14:19:42 x11vnc version: 0.9.14 lastmod: 2015-11-14 pid: 801

[services.d] done.
07/05/2020 14:19:42 Using X display :0
07/05/2020 14:19:42 rootwin: 0x43 reswin: 0x400001 dpy: 0x31373b20
07/05/2020 14:19:42
07/05/2020 14:19:42 ------------------ USEFUL INFORMATION ------------------
07/05/2020 14:19:42 X DAMAGE available on display, using it for polling hints.
07/05/2020 14:19:42 To disable this behavior use: '-noxdamage'
07/05/2020 14:19:42
07/05/2020 14:19:42 Most compositing window managers like 'compiz' or 'beryl'
07/05/2020 14:19:42 cause X DAMAGE to fail, and so you may not see any screen
07/05/2020 14:19:42 updates via VNC. Either disable 'compiz' (recommended) or
07/05/2020 14:19:42 supply the x11vnc '-noxdamage' command line option.
07/05/2020 14:19:42 X COMPOSITE available on display, using it for window polling.
07/05/2020 14:19:42 To disable this behavior use: '-noxcomposite'
07/05/2020 14:19:42
07/05/2020 14:19:42 Wireframing: -wireframe mode is in effect for window moves.
07/05/2020 14:19:42 If this yields undesired behavior (poor response, painting
07/05/2020 14:19:42 errors, etc) it may be disabled:
07/05/2020 14:19:42 - use '-nowf' to disable wireframing completely.
07/05/2020 14:19:42 - use '-nowcr' to disable the Copy Rectangle after the
07/05/2020 14:19:42 moved window is released in the new position.
07/05/2020 14:19:42 Also see the -help entry for tuning parameters.
07/05/2020 14:19:42 You can press 3 Alt_L's (Left "Alt" key) in a row to
07/05/2020 14:19:42 repaint the screen, also see the -fixscreen option for
07/05/2020 14:19:42 periodic repaints.
07/05/2020 14:19:42 GrabServer control via XTEST.
07/05/2020 14:19:42
07/05/2020 14:19:42 Scroll Detection: -scrollcopyrect mode is in effect to
07/05/2020 14:19:42 use RECORD extension to try to detect scrolling windows
07/05/2020 14:19:42 (induced by either user keystroke or mouse input).

07/05/2020 14:19:42 If this yields undesired behavior (poor response, painting
07/05/2020 14:19:42 errors, etc) it may be disabled via: '-noscr'
07/05/2020 14:19:42 Also see the -help entry for tuning parameters.
07/05/2020 14:19:42 You can press 3 Alt_L's (Left "Alt" key) in a row to
07/05/2020 14:19:42 repaint the screen, also see the -fixscreen option for
07/05/2020 14:19:42 periodic repaints.
07/05/2020 14:19:42
07/05/2020 14:19:42 XKEYBOARD: number of keysyms per keycode 7 is greater
07/05/2020 14:19:42 than 4 and 51 keysyms are mapped above 4.
07/05/2020 14:19:42 Automatically switching to -xkb mode.
07/05/2020 14:19:42 If this makes the key mapping worse you can
07/05/2020 14:19:42 disable it with the "-noxkb" option.
07/05/2020 14:19:42 Also, remember "-remap DEAD" for accenting characters.
07/05/2020 14:19:42
07/05/2020 14:19:42 X FBPM extension not supported.
Xlib: extension "DPMS" missing on display ":0".
07/05/2020 14:19:42 X display is not capable of DPMS.
07/05/2020 14:19:42 --------------------------------------------------------
07/05/2020 14:19:42
07/05/2020 14:19:42 Default visual ID: 0x21
07/05/2020 14:19:42 Read initial data from X display into framebuffer.
07/05/2020 14:19:42 initialize_screen: fb_depth/fb_bpp/fb_Bpl 24/32/5120
07/05/2020 14:19:42
07/05/2020 14:19:42 X display :0 is 32bpp depth=24 true color
07/05/2020 14:19:42
07/05/2020 14:19:42 Listening for VNC connections on TCP port 5900
07/05/2020 14:19:42
07/05/2020 14:19:42 Xinerama is present and active (e.g. multi-head).
07/05/2020 14:19:42 Xinerama: number of sub-screens: 1
07/05/2020 14:19:42 Xinerama: no blackouts needed (only one sub-screen)
07/05/2020 14:19:42
07/05/2020 14:19:42 fb read rate: 2302 MB/sec
07/05/2020 14:19:42 fast read: reset -wait ms to: 10
07/05/2020 14:19:42 fast read: reset -defer ms to: 10
07/05/2020 14:19:42 The X server says there are 10 mouse buttons.

07/05/2020 14:19:42 screen setup finished.
07/05/2020 14:19:42

The VNC desktop is: 803664a6653a:0

0

******************************************************************************
Have you tried the x11vnc '-ncache' VNC client-side pixel caching feature yet?

The scheme stores pixel data offscreen on the VNC viewer side for faster
retrieval. It should work with any VNC viewer. Try it by running:

x11vnc -ncache 10 ...

One can also add -ncache_cr for smooth 'copyrect' window motion.
More info: http://www.karlrunge.com/x11vnc/faq.html#faq-client-caching

[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...
[app] starting intel-gpu-tools...

 

[dee31797]

2 minutes ago, parisv said:

 

 

The app can't find the GPU for some reason.  

Goto the unraid cli console, type 

ls -la /dev/dri

post the output here

[parisv]

9 minutes ago, dee31797 said:

The app can't find the GPU for some reason.  

Goto the unraid cli console, type 

ls -la /dev/dri

post the output here

 

root@tower:~# ls -la /dev/dri

/bin/ls: cannot access '/dev/dri': No such file or directory

root@tower:~# 

 

that's odd I added this to my go file yesterday to help h/w transcode for plex.

 

#!/bin/bash

# Start the Management Utility

/usr/local/sbin/emhttp &

modprobe i915

chmod -R 777 /dev/dri

~