ptr727

Ok, I'll try it, any pointers on how to script VM start stops in unraid?

Hi, I have a VM where I map config paths to appdata. How can I stop and restart the VM similar to how docker containers are managed?

Trying to do GPU only, does not seem to make any progress. Log shows: 16:40:33:Enabled folding slot 00: READY gpu:0:GP106GL [Quadro P2000] [MED-XN71] 3935 91m16:40:33:ERROR:No compute devices matched GPU #0 NVIDIA:7 GP106GL [Quadro P2000] [MED-XN71] 3935. You may need to update your graphics drivers. Is it a driver issue or no work items for a P2000?

Chrome for the webui is a no go, Msft Edge works. With Chrome I keep getting: "ERROR:WU01:FS01:Exception: 10001: Server responded: HTTP_SERVICE_UNAVAILABLE"

I have no problem using the spin up or spin down buttons, so whatever unraid is doing does work.

New user, installed on two similar systems, only difference is number of drives. Default ports does not work for host, need to change port number from 18888 to 8888, else keep getting connection refused. Fist server no problem with running tests. Second server crash in what appears to be a timeout waiting for the 20 spinning drives to spin up: ``` DiskSpeed - Disk Diagnostics & Reporting tool Version: 2.4 Scanning Hardware 08:25:25 Spinning up hard drives 08:25:25 Scanning system storage Lucee 5.2.9.31 Error (application) Messagetimeout [90000 ms] expired while executing [/usr/sbin/hwinfo --pci --bridge --storage-ctrl --disk --ide --scsi] StacktraceThe Error Occurred in /var/www/ScanControllers.cfm: line 243 241: <CFOUTPUT>#TS()# Scanning system storage<br></CFOUTPUT><CFFLUSH> 242: <CFFILE action="write" file="#PersistDir#/hwinfo_storage_exec.txt" output=" /usr/sbin/hwinfo --pci --bridge --storage-ctrl --disk --ide --scsi" addnewline="NO" mode="666"> 243: <cfexecute name="/usr/sbin/hwinfo" arguments="--pci --bridge --storage-ctrl --disk --ide --scsi" variable="storage" timeout="90" /><!--- --usb-ctrl --usb --hub ---> 244: <CFFILE action="delete" file="#PersistDir#/hwinfo_storage_exec.txt"> 245: <CFFILE action="write" file="#PersistDir#/hwinfo_storage.txt" output="#storage#" addnewline="NO" mode="666"> called from /var/www/ScanControllers.cfm: line 242 240: 241: <CFOUTPUT>#TS()# Scanning system storage<br></CFOUTPUT><CFFLUSH> 242: <CFFILE action="write" file="#PersistDir#/hwinfo_storage_exec.txt" output=" /usr/sbin/hwinfo --pci --bridge --storage-ctrl --disk --ide --scsi" addnewline="NO" mode="666"> 243: <cfexecute name="/usr/sbin/hwinfo" arguments="--pci --bridge --storage-ctrl --disk --ide --scsi" variable="storage" timeout="90" /><!--- --usb-ctrl --usb --hub ---> 244: <CFFILE action="delete" file="#PersistDir#/hwinfo_storage_exec.txt"> Java Stacktracelucee.runtime.exp.ApplicationException: timeout [90000 ms] expired while executing [/usr/sbin/hwinfo --pci --bridge --storage-ctrl --disk --ide --scsi] at lucee.runtime.tag.Execute._execute(Execute.java:241) at lucee.runtime.tag.Execute.doEndTag(Execute.java:252) at scancontrollers_cfm$cf.call_000006(/ScanControllers.cfm:243) at scancontrollers_cfm$cf.call(/ScanControllers.cfm:242) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:933) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:823) at lucee.runtime.listener.ClassicAppListener._onRequest(ClassicAppListener.java:66) at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:45) at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2464) at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2454) at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2427) at lucee.runtime.engine.Request.exe(Request.java:44) at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1090) at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1038) at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:102) at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:292) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:207) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:240) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:207) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:212) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:94) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:141) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:80) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:620) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:684) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:88) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:502) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1152) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:684) at org.apache.tomcat.util.net.AprEndpoint$SocketWithOptionsProcessor.run(AprEndpoint.java:2464) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) Timestamp2/20/20 8:29:32 AM PST ```

Same happening to me running 6.8.2.

Ah, I was about to say but it only allows the top level to be excluded, not child folders, then I noticed the edit box, and I can add my own path instead of using the GUI. Would be cool if the GUI allowed sub-folder selection, but I'll wait for restore to complete, then try to exclude the Plex metadata folder. Thx

Ah, so verify is comparing the files, not just verifying integrity, got it. I bet it is the Plex metadata that is taking forever, is there an ability to exclude the metadata from backup (it can be redownloaded), maybe a path exclusion?

Hi, not sure if it is related to this plugin, but this AM I noticed that none of my dockers are running. Actually only one is running, postfix, but that does not use any appdata storage. I looked at the log, and it looks like backup ran, last reported verifying the backup, but I'm not sure why the containers were not restarted after the backup. Feb 2 02:00:01 Server-1 Plugin Auto Update: Checking for available plugin updates Feb 2 02:00:03 Server-1 Plugin Auto Update: community.applications.plg version 2020.02.01 does not meet age requirements to update Feb 2 02:00:04 Server-1 Plugin Auto Update: Community Applications Plugin Auto Update finished Feb 2 03:00:01 Server-1 CA Backup/Restore: ####################################### Feb 2 03:00:01 Server-1 CA Backup/Restore: Community Applications appData Backup Feb 2 03:00:01 Server-1 CA Backup/Restore: Applications will be unavailable during Feb 2 03:00:02 Server-1 CA Backup/Restore: this process. They will automatically Feb 2 03:00:02 Server-1 CA Backup/Restore: be restarted upon completion. Feb 2 03:00:02 Server-1 CA Backup/Restore: ####################################### Feb 2 03:00:02 Server-1 CA Backup/Restore: Stopping Duplicacy Feb 2 03:00:02 Server-1 CA Backup/Restore: docker stop -t 60 Duplicacy Feb 2 03:00:02 Server-1 CA Backup/Restore: Stopping nginx Feb 2 03:00:06 Server-1 kernel: veth8a1bd58: renamed from eth0 Feb 2 03:00:06 Server-1 CA Backup/Restore: docker stop -t 60 nginx Feb 2 03:00:06 Server-1 CA Backup/Restore: Stopping plex Feb 2 03:00:10 Server-1 kernel: vethf123b74: renamed from eth0 Feb 2 03:00:10 Server-1 CA Backup/Restore: docker stop -t 60 plex Feb 2 03:00:10 Server-1 CA Backup/Restore: postfix set to not be stopped by ca backup's advanced settings. Skipping Feb 2 03:00:10 Server-1 CA Backup/Restore: Stopping radarr Feb 2 03:00:14 Server-1 kernel: veth3440e0e: renamed from eth0 Feb 2 03:00:14 Server-1 CA Backup/Restore: docker stop -t 60 radarr Feb 2 03:00:14 Server-1 CA Backup/Restore: Stopping sabnzbd Feb 2 03:00:18 Server-1 kernel: vethd3efd80: renamed from eth0 Feb 2 03:00:18 Server-1 CA Backup/Restore: docker stop -t 60 sabnzbd Feb 2 03:00:18 Server-1 CA Backup/Restore: Stopping sonarr Feb 2 03:00:22 Server-1 kernel: veth323bd38: renamed from eth0 Feb 2 03:00:22 Server-1 CA Backup/Restore: docker stop -t 60 sonarr Feb 2 03:00:22 Server-1 CA Backup/Restore: Stopping vouch-proxy Feb 2 03:00:23 Server-1 kernel: veth21f55b3: renamed from eth0 Feb 2 03:00:23 Server-1 CA Backup/Restore: docker stop -t 60 vouch-proxy Feb 2 03:00:23 Server-1 CA Backup/Restore: Backing up USB Flash drive config folder to Feb 2 03:00:23 Server-1 CA Backup/Restore: Using command: /usr/bin/rsync -avXHq --delete --log-file="/var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log" /boot/ "/mnt/user/backup/Unraid/USB" > /dev/null 2>&1 Feb 2 03:00:23 Server-1 CA Backup/Restore: Changing permissions on backup Feb 2 03:00:23 Server-1 CA Backup/Restore: Backing up libvirt.img to /mnt/user/backup/Unraid/libvirt/ Feb 2 03:00:23 Server-1 CA Backup/Restore: Using Command: /usr/bin/rsync -avXHq --delete --log-file="/var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log" "/mnt/user/system/libvirt/libvirt.img" "/mnt/user/backup/Unraid/libvirt/" > /dev/null 2>&1 Feb 2 03:00:27 Server-1 CA Backup/Restore: Backing Up appData from /mnt/user/appdata/ to /mnt/user/backup/Unraid/appdata/[email protected] Feb 2 03:00:27 Server-1 CA Backup/Restore: Using command: cd '/mnt/user/appdata/' && /usr/bin/tar -cvaf '/mnt/user/backup/Unraid/appdata/[email protected]/CA_backup.tar.gz' --exclude 'docker.img' * >> /var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log 2>&1 & echo $! > /tmp/ca.backup2/tempFiles/backupInProgress Feb 2 04:00:01 Server-1 Docker Auto Update: Community Applications Docker Autoupdate running Feb 2 04:00:01 Server-1 Docker Auto Update: Checking for available updates Feb 2 04:00:10 Server-1 Docker Auto Update: Installing Updates for code-server nginx sabnzbd Feb 2 04:00:40 Server-1 Docker Auto Update: Community Applications Docker Autoupdate finished Feb 2 04:40:01 Server-1 apcupsd[10670]: apcupsd exiting, signal 15 Feb 2 04:40:01 Server-1 apcupsd[10670]: apcupsd shutdown succeeded Feb 2 04:40:04 Server-1 apcupsd[13274]: apcupsd 3.14.14 (31 May 2016) slackware startup succeeded Feb 2 04:40:04 Server-1 apcupsd[13274]: NIS server startup succeeded Feb 2 06:18:13 Server-1 CA Backup/Restore: Backup Complete Feb 2 06:18:13 Server-1 CA Backup/Restore: Verifying backup Feb 2 06:18:13 Server-1 CA Backup/Restore: Using command: cd '/mnt/user/appdata/' && /usr/bin/tar --diff -C '/mnt/user/appdata/' -af '/mnt/user/backup/Unraid/appdata/[email protected]/CA_backup.tar.gz' > /var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log & echo $! > /tmp/ca.backup2/tempFiles/verifyInProgress The CA backup status tab says verifying, but it has been more than 2 hours of verifying. Is it really verifying, if so, should the containers not be restarted after backup, not after verify, else they will be offline much longer than needed? Any ideas how to find out if verify is really running, or something went wrong?

I hear you, but that is not what I see, at least one of my manually created containers, and one from docker hub via apps search, are not listed on the previous apps page (these containers do not have Unraid templates). Anyway, restoring to last known is not restoring to a versioned config, e.g. if I restore container data to date x, I may want to restore container config to date x or date y. But, I'll leave it at that.

Thanks, wish I'd known that (I bet many people don't, and like me they may look for it in the backup / restore section). But, there is no history of any of my docker hub only containers, there is also no historic versioning (or am I going to find it when I try to use it), so I still think it would be a good idea to implement docker (and maybe VM) config backup and restore along with the appdata used by the containers.

The config may have been on the flash before, but after losing the cache, restoring it, there is no docker config, and bringing back the apps, leaves them with default configs, not the old config. Previous apps makes it easier to see what I previously installed, to my knowledge it does not have a copy of the old config. Yes, I could restore the flash with appdata, or I could manually copy config files (I don't even know where to start), or ... the backup app can do it for me.

Hi, I lost my cache volume (something went wrong during a disk replace), restored appdata from backup, but all my docker configs were gone. With lots of effort I recreated each container's config, custom network bridges, environment variables, volume mappings, etc. For docker, the container configs are as important as the appdata, can an option be added to backup and restore container configs along with appdata? (same really applies to VM configs)

Hi, after running an extended test, and clicking view results, the UI loads a few thousand lines, then becomes unresponsive, and the main Unraid UI is also unresponsive. I assume results file is too big for the method being used to display the contents, maybe a download vs. display is a better option. Is there a log file on the filesystem I can view instead?

There are docker options that are not exposed in the GUI, e.g. tmpfs, user, dependencies, etc.. Having the ability to switch a container setup between vanilla GUI, or compose YAML text, would be ideal, as it allows native configuration, without needing to use the CLI, or the additional cumbersome command options in the GUI. The management code can always apply filters or sanitization, such that e.g. options like restart are exposed in the GUI, or invalid configs detected. Alternatively the config may simply be GUI or YAML, where if YAML it is all under control of the user.

Yep, I understand the meaninglessness of mapping ports in bridge mode, but without it the web UI link does not work. Of all my containers running in bridge mode, home assistant is the only container where the launch web ui link does not appear. Most other other containers do list port mappings such that they work correctly in host or bridge mode. Would be great if the web ui link always works, maybe use port mapping, or use IP address assigned in bridge setup.

Just FYI what I discovered as I switched from HASS in a VM to just the main container using a fixed IP in bridge mode: 1) HASS removed the docker port mapping, so Unraid will not show ports, and the web UI link will not work. I could not find a way to make Unraid do explicit port mappings or how to make the web ui link work, e.g. like I would manually do using docker compose when adding ports. 2) HASS runs as root, workaround is to use this solution, such that appdata permissions work as expected. Copy the run script to appdata folder and add execute permissions (or git clone and copy run file to correct folder). Edit docker config in advanced mode and add "--user 99:100" in extra parameters section. Add env UMASK and set value to 007. Make sure all config files in appdata are deleted, other than run, start container, and permissions will be correct. Hope this help somebody.

I see, so the base is ignored and only the specific layer files copied on top of your last layer, I'll try it out and see what happens.

I read the blog, and if I understand correctly you tar all the files in the docker, and drop them on your layout, I assume it is then very important that the images derive from the same base image? I created an image that derives from your image, and then installs the goodies I want: https://hub.docker.com/r/ptr727/code-server It works fine as is, and it is currently auto building when I make a change or your image changes.

I need to install DotNet Core SDK 3, which has several dependencies that are not installed, and it needs to be configured for container use. Should I 1) attempt the custom scripts path, or am I better off 2) creating my own docker file that inherits from your image as base, or 3) fork and modify your dockerfile to also include the DotNet SDK steps? See: https://github.com/dotnet/dotnet-docker/blob/master/3.0/sdk/bionic/amd64/Dockerfile

Will the "development" tag be equivalent to coder's v2 tag (that I am currently using)? How about just following coder's tagging structure, e.g. what will v3 be if development is v2?

Hi, my backup has been stuck on verifying for more than a week. While it is still in this "broken" state, I'd like to help troubleshoot to get the issue resolved. Please see here for details: https://forum.duplicati.com/t/think-youre-stuck-on-verifying-backend-data/3473/36?u=ptr727 How do I help troubleshoot in the container?