jbartlett Posted September 26, 2022 Author Share Posted September 26, 2022 On 9/23/2022 at 10:57 AM, dopeytree said: It displays an error when trying to share upload data for the database. Is there a problem with the database's end? What kind of upload? Drive image upload or Drive & Benchmark data? And please try again, I tested both and got back successful messages for both. If it does fail, note the time & time zone that you tried and I'll check the logs. Quote Link to comment
FQs19 Posted September 26, 2022 Share Posted September 26, 2022 23 hours ago, jbartlett said: It looks like the permissions on the new directory aren't correct and the application can't write to it. While the Docker config is set to R/W, that doesn't mean squat if the directory itself is not writeable by Docker. Open a shell prompt to the unraid server itself (not the Docker) and enter in the following lines. This is the same code when you run Unraid tool to apply new permissions. chmod -R u-x,go-rwx,go+u,ugo+X '/mnt/arraycache/appdata/DiskSpeed' chown -R nobody:users '/mnt/arraycache/appdata/DiskSpeed' sync I updated DiskSpeed then applied those lines of code. After starting the docker, it still won't start. Here is the error: Spoiler DiskSpeed - Disk Diagnostics & Reporting tool Version: 2.9.6 Scanning Hardware 19:16:11 Spinning up hard drives Lucee 5.3.7.47 Error (application) Message Error invoking external process Stacktrace The Error Occurred in /var/www/Spinup.cfm: line 137 135: <CFFILE action="write" file="/tmp/DiskSpeedTmp/spinup.sh" mode="766" output="#spinup#" addnewline="NO"> 136: </cflock> 137: <CFEXECUTE name="/tmp/DiskSpeedTmp/spinup.sh" timeout="0" /> 138: <CFELSE> 139: <cflock name="FileWrite" type="exclusive" throwontimeout="true" timeout="10"> called from /var/www/ScanControllers.cfm: line 257 255: </CFOUTPUT> 256: <CFFLUSH> 257: <CFINCLUDE template="Spinup.cfm"> 258: 259: <CFIF FileExists("#PersistDir#/storage.json")> called from /var/www/ScanControllers.cfm: line 250 248: <cfexecute name="/bin/ls" arguments="-l /sys/block" variable="BlockDevices" timeout="90" /> 249: <CFFILE action="delete" file="#PersistDir#/ls_sysblock_exec.txt"> 250: <CFFILE action="write" file="#PersistDir#/ls_sysblock.txt" output="#BlockDevices#" addnewline="NO" mode="666"> 251: 252: <CFOUTPUT> Java Stacktrace lucee.runtime.exp.ApplicationException: Error invoking external process at lucee.runtime.tag.Execute.doEndTag(Execute.java:259) at spinup_cfm$cf.call(/Spinup.cfm:137) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:945) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:837) at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818) at scancontrollers_cfm$cf.call_000005(/ScanControllers.cfm:257) at scancontrollers_cfm$cf.call(/ScanControllers.cfm:250) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:945) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:837) at lucee.runtime.listener.ClassicAppListener._onRequest(ClassicAppListener.java:64) at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:43) at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2416) at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2406) at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2381) at lucee.runtime.engine.Request.exe(Request.java:43) at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1170) at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1116) at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:97) at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:542) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:143) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:690) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:747) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:374) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1590) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.base/java.lang.Thread.run(Thread.java:834) Timestamp 9/26/22 7:21:12 PM EDT Here is the docker logs: Spoiler at java.base/java.lang.StringBuffer.append(StringBuffer.java:409) at java.base/java.io.StringWriter.write(StringWriter.java:99) at lucee.commons.io.IOUtil.copy(IOUtil.java:351) at lucee.commons.io.IOUtil.copy(IOUtil.java:312) at lucee.commons.io.IOUtil.toString(IOUtil.java:845) at lucee.commons.io.IOUtil.toString(IOUtil.java:832) at lucee.commons.io.IOUtil.toString(IOUtil.java:792) at lucee.commons.cli.StreamGobbler.run(Command.java:168) 26-Sep-2022 19:15:26.850 INFO [Thread-7] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:15:26.858 INFO [Thread-7] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 26-Sep-2022 19:15:26.858 INFO [Thread-7] org.apache.catalina.core.StandardService.stopInternal Stopping service [Catalina] 26-Sep-2022 19:15:31.920 INFO [Thread-7] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:15:31.963 INFO [Thread-7] org.apache.coyote.AbstractProtocol.destroy Destroying ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:15:31.964 INFO [Thread-7] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 26-Sep-2022 19:15:31.965 INFO [Thread-7] org.apache.coyote.AbstractProtocol.destroy Destroying ProtocolHandler ["ajp-nio-127.0.0.1-8009"] NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 26-Sep-2022 19:16:06.645 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat/9.0.39 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: Oct 6 2020 14:11:46 UTC 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.39.0 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.15.46-Unraid 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /usr/local/openjdk-11 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 11.0.9+11 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Oracle Corporation 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /usr/local/tomcat 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /usr/local/tomcat 26-Sep-2022 19:16:06.658 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED 26-Sep-2022 19:16:06.658 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/local/tomcat/conf/logging.properties 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xms64m 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx512m 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.security.egd=file:/dev/./urandom 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs= 26-Sep-2022 19:16:06.660 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/local/tomcat 26-Sep-2022 19:16:06.660 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/local/tomcat 26-Sep-2022 19:16:06.660 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/usr/local/tomcat/temp 26-Sep-2022 19:16:06.662 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.25] using APR version [1.6.5]. 26-Sep-2022 19:16:06.663 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true]. 26-Sep-2022 19:16:06.663 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true] 26-Sep-2022 19:16:06.664 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.1n 15 Mar 2022] 26-Sep-2022 19:16:06.850 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:16:06.866 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 26-Sep-2022 19:16:06.867 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [370] milliseconds 26-Sep-2022 19:16:06.892 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina] 26-Sep-2022 19:16:06.892 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.39] WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/usr/local/tomcat/lucee/lucee.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 26-Sep-2022 19:16:07.771 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:16:07.777 SEVERE [main] org.apache.catalina.util.LifecycleBase.handleSubClassException Failed to start component [Connector[AJP/1.3-8009]] org.apache.catalina.LifecycleException: Protocol handler start failed at org.apache.catalina.connector.Connector.startInternal(Connector.java:1067) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) at org.apache.catalina.core.StandardService.startInternal(StandardService.java:438) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) at org.apache.catalina.startup.Catalina.start(Catalina.java:772) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:342) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:473) Caused by: java.lang.IllegalArgumentException: The AJP Connector is configured with secretRequired="true" but the secret attribute is either null or "". This combination is not valid. at org.apache.coyote.ajp.AbstractAjpProtocol.start(AbstractAjpProtocol.java:270) at org.apache.catalina.connector.Connector.startInternal(Connector.java:1064) ... 12 more 26-Sep-2022 19:16:07.778 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [910] milliseconds Exception in thread "Thread-27" java.lang.OutOfMemoryError: Java heap space at java.base/java.util.Arrays.copyOf(Arrays.java:3745) at java.base/java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:172) at java.base/java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:686) at java.base/java.lang.StringBuffer.append(StringBuffer.java:409) at java.base/java.io.StringWriter.write(StringWriter.java:99) at lucee.commons.io.IOUtil.copy(IOUtil.java:351) at lucee.commons.io.IOUtil.copy(IOUtil.java:312) at lucee.commons.io.IOUtil.toString(IOUtil.java:845) at lucee.commons.io.IOUtil.toString(IOUtil.java:832) at lucee.commons.io.IOUtil.toString(IOUtil.java:792) at lucee.commons.cli.StreamGobbler.run(Command.java:168) 26.09.2022 19:16:07,551 ERROR [server.application] application->no password set and no password file found at [/opt/lucee/server/lucee-server/context/password.txt] I also attached the diagnostics. I did not restart my unRAID server during this. If that needs to be done, let me know. Thanks for the help. threadripper19-diagnostics-20220926-1925.zip Quote Link to comment
dopeytree Posted September 27, 2022 Share Posted September 27, 2022 (edited) 9 hours ago, jbartlett said: What kind of upload? Drive image upload or Drive & Benchmark data? And please try again, I tested both and got back successful messages for both. If it does fail, note the time & time zone that you tried and I'll check the logs. hi this is what it says no error code is given. There was an error processing the data. Error Data: I'm just checking pfsense to make sure its not my firewall blocking it, but don't see why it would be blocked.. Time for logs is 02:13 (London time) on 27th sept 22. Am using an m1 mac on safari (sometimes shows up as mozilla in logs) Edited September 27, 2022 by dopeytree Quote Link to comment
Zonediver Posted September 27, 2022 Share Posted September 27, 2022 (edited) REQUEST: After EVERY UPDATE, all tumpnail pictures of all my drives are gone and i have to re-implement it by hand... I dont know, how often i did this... but its boring... Also the Overlay-Info is not stored... Is it possible to store the pictures in an array that "survives" an update? Thanks! Edited September 27, 2022 by Zonediver Quote Link to comment
jbartlett Posted September 27, 2022 Author Share Posted September 27, 2022 17 hours ago, FQs19 said: I updated DiskSpeed then applied those lines of code. After starting the docker, it still won't start. Remove the DiskSpeed directory, edit the Docker image, and save it. Check to see if the DiskSpeed directory has been recreated. Quote Link to comment
jbartlett Posted September 27, 2022 Author Share Posted September 27, 2022 5 hours ago, Zonediver said: REQUEST: After EVERY UPDATE, all tumpnail pictures of all my drives are gone and i have to re-implement it by hand... I dont know, how often i did this... but its boring... Also the Overlay-Info is not stored... Is it possible to store the pictures in an array that "survives" an update? Thanks! This is something I've been wanting to investigate too. But after you edit a drive image, click the "Submit Drive" button that shows up after you save the update (or viewing the drive after updating). Click the button again to confirm. You only need to do this step once per drive model. Next update, it should restore your drive image & overlay from what you uploaded. This is a per-machine setting. 1 Quote Link to comment
FQs19 Posted September 27, 2022 Share Posted September 27, 2022 38 minutes ago, jbartlett said: Remove the DiskSpeed directory, edit the Docker image, and save it. Check to see if the DiskSpeed directory has been recreated. I deleted the DiskSpeed directory, edited the docker image and saved it. It did create a new DiskSpeed directory. I then opened the webgui and the same error popped up: Spoiler DiskSpeed - Disk Diagnostics & Reporting tool Version: 2.9.6 Scanning Hardware 13:06:47 Spinning up hard drives Lucee 5.3.7.47 Error (application) Message Error invoking external process Stacktrace The Error Occurred in /var/www/Spinup.cfm: line 137 135: <CFFILE action="write" file="/tmp/DiskSpeedTmp/spinup.sh" mode="766" output="#spinup#" addnewline="NO"> 136: </cflock> 137: <CFEXECUTE name="/tmp/DiskSpeedTmp/spinup.sh" timeout="0" /> 138: <CFELSE> 139: <cflock name="FileWrite" type="exclusive" throwontimeout="true" timeout="10"> called from /var/www/ScanControllers.cfm: line 257 255: </CFOUTPUT> 256: <CFFLUSH> 257: <CFINCLUDE template="Spinup.cfm"> 258: 259: <CFIF FileExists("#PersistDir#/storage.json")> called from /var/www/ScanControllers.cfm: line 250 248: <cfexecute name="/bin/ls" arguments="-l /sys/block" variable="BlockDevices" timeout="90" /> 249: <CFFILE action="delete" file="#PersistDir#/ls_sysblock_exec.txt"> 250: <CFFILE action="write" file="#PersistDir#/ls_sysblock.txt" output="#BlockDevices#" addnewline="NO" mode="666"> 251: 252: <CFOUTPUT> Java Stacktrace lucee.runtime.exp.ApplicationException: Error invoking external process at lucee.runtime.tag.Execute.doEndTag(Execute.java:259) at spinup_cfm$cf.call(/Spinup.cfm:137) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:945) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:837) at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818) at scancontrollers_cfm$cf.call_000005(/ScanControllers.cfm:257) at scancontrollers_cfm$cf.call(/ScanControllers.cfm:250) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:945) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:837) at lucee.runtime.listener.ClassicAppListener._onRequest(ClassicAppListener.java:64) at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:43) at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2416) at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2406) at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2381) at lucee.runtime.engine.Request.exe(Request.java:43) at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1170) at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1116) at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:97) at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:542) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:143) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:690) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:747) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:374) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1590) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.base/java.lang.Thread.run(Thread.java:834) Timestamp 9/27/22 1:11:48 PM EDT I'm attaching diagnostics. threadripper19-diagnostics-20220927-1314.zip Quote Link to comment
Stubbs Posted September 28, 2022 Share Posted September 28, 2022 What's this? (from the log, straight after installation) WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/usr/local/tomcat/lucee/lucee.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release Quote Link to comment
jbartlett Posted September 28, 2022 Author Share Posted September 28, 2022 6 hours ago, Stubbs said: What's this? (from the log, straight after installation) WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/usr/local/tomcat/lucee/lucee.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release Looks to be harmless, related to Java 11. https://dev.lucee.org/t/illegal-reflective-access/7052 https://issues.apache.org/jira/browse/FELIX-5765 Quote Link to comment
Snubbers Posted October 5, 2022 Share Posted October 5, 2022 I've just installed a trial version of unRAID (alongside my main unRAID server). I've got a USB stick (Sandisk 32Gb) for the main array and an NVME for cache and an SSD as a second pool. Diskspeed detects all teh controllers and disks, showing the USB drives (the main array and the boot flash) all connected to the USB controller and there are drive images (close enough for the SAN DISK usb sticks).. Clicking on NVME or SSD brings up the info and benchmark buttons on the right.. Clicking on a USB drive brings the image of the drive up on the right, but no info or buttons. Is it possible to Benchmark USB Sticks? My intent is to use this very low power USFF PC as an app server, so don't need an array, so followed advice on the forums to drop in a USB stick to get around the array issue and that works well, but I would love to benchmark the USB sticks as I may use them for backups and other purposes, but wanted to check their performance. Apologies if I'm missing something, I've searched hte thread but can't see anything to confirm/deny if USB drives can be benchmarked. Quote Link to comment
jbartlett Posted October 5, 2022 Author Share Posted October 5, 2022 @Snubbers - There's no plans to add benchmarking of USB sticks because there's too many factors that can influence the results. However, you can perform the same test manually with the following command dd if=/dev/sdx of=/dev/null bs=1310720 skip=0 iflag=direct status=progress conv=noerror Replace "sdx" with your drive's device ID (such as "sda" for your UNRAID boot stick). Press CTRL-C to stop the scan when the reported speeds stabilize. 1 Quote Link to comment
IZSkiSurfer Posted October 12, 2022 Share Posted October 12, 2022 On 9/27/2022 at 1:26 AM, FQs19 said: I updated DiskSpeed then applied those lines of code. After starting the docker, it still won't start. Here is the error: Hide contents DiskSpeed - Disk Diagnostics & Reporting tool Version: 2.9.6 Scanning Hardware 19:16:11 Spinning up hard drives Lucee 5.3.7.47 Error (application) Message Error invoking external process Stacktrace The Error Occurred in /var/www/Spinup.cfm: line 137 135: <CFFILE action="write" file="/tmp/DiskSpeedTmp/spinup.sh" mode="766" output="#spinup#" addnewline="NO"> 136: </cflock> 137: <CFEXECUTE name="/tmp/DiskSpeedTmp/spinup.sh" timeout="0" /> 138: <CFELSE> 139: <cflock name="FileWrite" type="exclusive" throwontimeout="true" timeout="10"> called from /var/www/ScanControllers.cfm: line 257 255: </CFOUTPUT> 256: <CFFLUSH> 257: <CFINCLUDE template="Spinup.cfm"> 258: 259: <CFIF FileExists("#PersistDir#/storage.json")> called from /var/www/ScanControllers.cfm: line 250 248: <cfexecute name="/bin/ls" arguments="-l /sys/block" variable="BlockDevices" timeout="90" /> 249: <CFFILE action="delete" file="#PersistDir#/ls_sysblock_exec.txt"> 250: <CFFILE action="write" file="#PersistDir#/ls_sysblock.txt" output="#BlockDevices#" addnewline="NO" mode="666"> 251: 252: <CFOUTPUT> Java Stacktrace lucee.runtime.exp.ApplicationException: Error invoking external process at lucee.runtime.tag.Execute.doEndTag(Execute.java:259) at spinup_cfm$cf.call(/Spinup.cfm:137) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:945) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:837) at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:818) at scancontrollers_cfm$cf.call_000005(/ScanControllers.cfm:257) at scancontrollers_cfm$cf.call(/ScanControllers.cfm:250) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:945) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:837) at lucee.runtime.listener.ClassicAppListener._onRequest(ClassicAppListener.java:64) at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:43) at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2416) at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2406) at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2381) at lucee.runtime.engine.Request.exe(Request.java:43) at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1170) at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1116) at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:97) at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:542) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:143) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:690) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:747) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:374) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1590) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.base/java.lang.Thread.run(Thread.java:834) Timestamp 9/26/22 7:21:12 PM EDT Here is the docker logs: Hide contents at java.base/java.lang.StringBuffer.append(StringBuffer.java:409) at java.base/java.io.StringWriter.write(StringWriter.java:99) at lucee.commons.io.IOUtil.copy(IOUtil.java:351) at lucee.commons.io.IOUtil.copy(IOUtil.java:312) at lucee.commons.io.IOUtil.toString(IOUtil.java:845) at lucee.commons.io.IOUtil.toString(IOUtil.java:832) at lucee.commons.io.IOUtil.toString(IOUtil.java:792) at lucee.commons.cli.StreamGobbler.run(Command.java:168) 26-Sep-2022 19:15:26.850 INFO [Thread-7] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:15:26.858 INFO [Thread-7] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 26-Sep-2022 19:15:26.858 INFO [Thread-7] org.apache.catalina.core.StandardService.stopInternal Stopping service [Catalina] 26-Sep-2022 19:15:31.920 INFO [Thread-7] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:15:31.963 INFO [Thread-7] org.apache.coyote.AbstractProtocol.destroy Destroying ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:15:31.964 INFO [Thread-7] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 26-Sep-2022 19:15:31.965 INFO [Thread-7] org.apache.coyote.AbstractProtocol.destroy Destroying ProtocolHandler ["ajp-nio-127.0.0.1-8009"] NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 26-Sep-2022 19:16:06.645 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat/9.0.39 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: Oct 6 2020 14:11:46 UTC 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.39.0 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.15.46-Unraid 26-Sep-2022 19:16:06.648 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /usr/local/openjdk-11 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 11.0.9+11 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Oracle Corporation 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /usr/local/tomcat 26-Sep-2022 19:16:06.649 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /usr/local/tomcat 26-Sep-2022 19:16:06.658 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED 26-Sep-2022 19:16:06.658 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/local/tomcat/conf/logging.properties 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xms64m 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx512m 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.security.egd=file:/dev/./urandom 26-Sep-2022 19:16:06.659 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs= 26-Sep-2022 19:16:06.660 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/local/tomcat 26-Sep-2022 19:16:06.660 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/local/tomcat 26-Sep-2022 19:16:06.660 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/usr/local/tomcat/temp 26-Sep-2022 19:16:06.662 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.25] using APR version [1.6.5]. 26-Sep-2022 19:16:06.663 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true]. 26-Sep-2022 19:16:06.663 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true] 26-Sep-2022 19:16:06.664 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.1n 15 Mar 2022] 26-Sep-2022 19:16:06.850 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:16:06.866 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 26-Sep-2022 19:16:06.867 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [370] milliseconds 26-Sep-2022 19:16:06.892 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina] 26-Sep-2022 19:16:06.892 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.39] WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/usr/local/tomcat/lucee/lucee.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 26-Sep-2022 19:16:07.771 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8888"] 26-Sep-2022 19:16:07.777 SEVERE [main] org.apache.catalina.util.LifecycleBase.handleSubClassException Failed to start component [Connector[AJP/1.3-8009]] org.apache.catalina.LifecycleException: Protocol handler start failed at org.apache.catalina.connector.Connector.startInternal(Connector.java:1067) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) at org.apache.catalina.core.StandardService.startInternal(StandardService.java:438) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:930) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) at org.apache.catalina.startup.Catalina.start(Catalina.java:772) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:342) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:473) Caused by: java.lang.IllegalArgumentException: The AJP Connector is configured with secretRequired="true" but the secret attribute is either null or "". This combination is not valid. at org.apache.coyote.ajp.AbstractAjpProtocol.start(AbstractAjpProtocol.java:270) at org.apache.catalina.connector.Connector.startInternal(Connector.java:1064) ... 12 more 26-Sep-2022 19:16:07.778 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [910] milliseconds Exception in thread "Thread-27" java.lang.OutOfMemoryError: Java heap space at java.base/java.util.Arrays.copyOf(Arrays.java:3745) at java.base/java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:172) at java.base/java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:686) at java.base/java.lang.StringBuffer.append(StringBuffer.java:409) at java.base/java.io.StringWriter.write(StringWriter.java:99) at lucee.commons.io.IOUtil.copy(IOUtil.java:351) at lucee.commons.io.IOUtil.copy(IOUtil.java:312) at lucee.commons.io.IOUtil.toString(IOUtil.java:845) at lucee.commons.io.IOUtil.toString(IOUtil.java:832) at lucee.commons.io.IOUtil.toString(IOUtil.java:792) at lucee.commons.cli.StreamGobbler.run(Command.java:168) 26.09.2022 19:16:07,551 ERROR [server.application] application->no password set and no password file found at [/opt/lucee/server/lucee-server/context/password.txt] I also attached the diagnostics. I did not restart my unRAID server during this. If that needs to be done, let me know. Thanks for the help. threadripper19-diagnostics-20220926-1925.zip 175.92 kB · 0 downloads Just want to let you know that I have the exact same error. I was bricking my array yesterday and startet a fresh array, downloaded all previous installed CA stuff and ending with exactly that same result. I created an empy password.txt but doesn't help. GUI stalls after "Spinning up hard drives" (even if I have not a single spinning rust installed :p). Quote Link to comment
IZSkiSurfer Posted October 12, 2022 Share Posted October 12, 2022 7 minutes ago, IZSkiSurfer said: Just want to let you know that I have the exact same error. I was bricking my array yesterday and startet a fresh array, downloaded all previous installed CA stuff and ending with exactly that same result. I created an empy password.txt but doesn't help. GUI stalls after "Spinning up hard drives" (even if I have not a single spinning rust installed :p). Ich think the problem might be related to this: # cat /tmp/DiskSpeedTmp/spinup.sh /tmp/DiskSpeedTmp/spinup_nvme0n1.sh & /tmp/DiskSpeedTmp/spinup_sda.sh & /tmp/DiskSpeedTmp/spinup_sdb.sh & /tmp/DiskSpeedTmp/spinup_sdc.sh & # cat /tmp/DiskSpeedTmp/spinup_nvme0n1.sh dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=190497 iflag=direct conv=noerror dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=283361 iflag=direct conv=noerror dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=309807 iflag=direct conv=noerror dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=557696 iflag=direct conv=noerror dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=909170 iflag=direct conv=noerror It tries to "spinup" the nvme0n1 (which exists). This drive is the only one in the array (no parity what so ever atm.) Because this takes forever I think catalina runs out of memory immediatly I'm not that into the docker architecture/unraid yet so I dunno why it can't read from the device. Quote Link to comment
FQs19 Posted October 12, 2022 Share Posted October 12, 2022 3 hours ago, IZSkiSurfer said: Just want to let you know that I have the exact same error. I was bricking my array yesterday and startet a fresh array, downloaded all previous installed CA stuff and ending with exactly that same result. I created an empy password.txt but doesn't help. GUI stalls after "Spinning up hard drives" (even if I have not a single spinning rust installed :p). I haven't even tried to install that plugin again. Hopefully you can figure out what is going on. Goodluck. Quote Link to comment
IZSkiSurfer Posted October 13, 2022 Share Posted October 13, 2022 22 hours ago, IZSkiSurfer said: Ich think the problem might be related to this: # cat /tmp/DiskSpeedTmp/spinup.sh /tmp/DiskSpeedTmp/spinup_nvme0n1.sh & /tmp/DiskSpeedTmp/spinup_sda.sh & /tmp/DiskSpeedTmp/spinup_sdb.sh & /tmp/DiskSpeedTmp/spinup_sdc.sh & # cat /tmp/DiskSpeedTmp/spinup_nvme0n1.sh dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=190497 iflag=direct conv=noerror dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=283361 iflag=direct conv=noerror dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=309807 iflag=direct conv=noerror dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=557696 iflag=direct conv=noerror dd if=/dev/nvme0n1 of=/dev/null bs=512 count=1 skip=909170 iflag=direct conv=noerror It tries to "spinup" the nvme0n1 (which exists). This drive is the only one in the array (no parity what so ever atm.) Because this takes forever I think catalina runs out of memory immediatly I'm not that into the docker architecture/unraid yet so I dunno why it can't read from the device. Small update: The problem seems to be the blocksize 512. I tried it on baremetal 512 won't work, 4096 will work. I switched my nvme to 4K mode for maximum performance. So I guess iflag=direct in combination with an 4K blocksize does technically not work ;). So the DiskSpeed docker should first check the blocksize being used before generating the temporary shell scripts. E.g. by using "lsblk -o MIN-IO -rdn /dev/nvme0n1" 1 Quote Link to comment
jbartlett Posted October 13, 2022 Author Share Posted October 13, 2022 8 hours ago, IZSkiSurfer said: Small update: The problem seems to be the blocksize 512. I tried it on baremetal 512 won't work, 4096 will work. I switched my nvme to 4K mode for maximum performance. So I guess iflag=direct in combination with an 4K blocksize does technically not work ;). So the DiskSpeed docker should first check the blocksize being used before generating the temporary shell scripts. E.g. by using "lsblk -o MIN-IO -rdn /dev/nvme0n1" How did you switch your nvme to 4K mode? DiskSpeed doesn't use a 512 byte block size. The block size that DiskSpeed uses is the values returned for MaxSectorsPerRequest multiplied by LogicalSectorSize. From my investigations, this is the same block size that the OS determines to use in access the drive. Max Sectors Per Request is determined via: blockdev --getmaxsect /dev/nvme0n1 For my drive, I get back "2560" Blocksizes for nvme drives are determined using the command "nvme list" and getting the value from the Format column. You'll need to be inside the DiskSpeed Docker to run this command. Enter via "docker exec -it DiskSpeed bash" My system returned Node SN Model Namespace Usage Format FW Rev ---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- -------- /dev/nvme0n1 S3X4NB0K309824V Samsung SSD 960 EVO 500GB 1 191.01 GB / 500.11 GB 512 B + 0 B 3B7QCXE7 /dev/nvme1n1 175014425233 WDC WDS256G1X0C-00ENX0 1 256.06 GB / 256.06 GB 512 B + 0 B B35900WD So the block size is 2560 x 512 or 1310720 bytes. AKA bs=1310720 for the dd command. 1 Quote Link to comment
IZSkiSurfer Posted October 14, 2022 Share Posted October 14, 2022 (edited) 13 hours ago, jbartlett said: How did you switch your nvme to 4K mode? nvme format -lbaf=1 /dev/nvme0n1 I sideloaded the nvme binary to unraid. But take care - don't do this on a drive without a backup. It will erase the data. As far as I digged into the cfm files those are the generated spinup scripts and they clearly have bs=512 as you can see. It might be that a 1310720 blocksize is used later for the benchmark but the spinup scripts do not - at least not for me.. Any other information you need? Edited October 14, 2022 by IZSkiSurfer warning added Quote Link to comment
jbartlett Posted October 14, 2022 Author Share Posted October 14, 2022 9 hours ago, IZSkiSurfer said: As far as I digged into the cfm files those are the generated spinup scripts and they clearly have bs=512 as you can see. It might be that a 1310720 blocksize is used later for the benchmark but the spinup scripts do not - at least not for me.. Any other information you need? Ah, I follow now. That spinup code is ancient from around when I first wrote the Docker version. If the drives hasn't been scanned yet (or are being rescanned), there's no information on them so it defaults to a 512 byte block size. I also recall seeing that the spinup sometimes worked and sometimes didn't in the past, this might be the reason why. After hunting around, looks like I can gather the block size from /sys/class/block/nvme0n1/queue What do you get from the following commands? cat /sys/class/block/nvme0n1/queue/hw_sector_size cat /sys/class/block/nvme0n1/queue/logical_block_size cat /sys/class/block/nvme0n1/queue/physical_block_size Quote Link to comment
Spazhead Posted October 16, 2022 Share Posted October 16, 2022 getting this JAVA error when trying to start up.. Quote Link to comment
IZSkiSurfer Posted October 17, 2022 Share Posted October 17, 2022 On 10/14/2022 at 10:50 PM, jbartlett said: What do you get from the following commands? cat /sys/class/block/nvme0n1/queue/hw_sector_size cat /sys/class/block/nvme0n1/queue/logical_block_size cat /sys/class/block/nvme0n1/queue/physical_block_size Sorry I was very busy the last days. # cat /sys/class/block/nvme0n1/queue/hw_sector_size 4096 # cat /sys/class/block/nvme0n1/queue/logical_block_size 4096 # cat /sys/class/block/nvme0n1/queue/physical_block_size 4096 On 10/16/2022 at 7:50 PM, Spazhead said: getting this JAVA error when trying to start up.. Try this in your docker console: echo '' > /opt/lucee/server/lucee-server/context/password.txt 1 Quote Link to comment
jbartlett Posted October 30, 2022 Author Share Posted October 30, 2022 Version 2.9.7 deployed. Change Log Correct issue of Drive images not preserving over installing a new version of this application Verify that the DiskSpeed application can write to the externally mapped volume Prevent against some potential race conditions on formatting drive images on full system scan On fresh startup, fetch device's block size from "/sys/class/block/DeviceID/queue/logical_block_size" for use in forcing a drive's spin-up Note: While your drive images will persist over this update if you have not previously submitted the drive image to the HDDB, the style formatting will not persist due to a bug on a second scan of your controllers setting the saved configuration to match one given drive. I was able to add code to persist the drive image. Ways to resolve this: If you don't care about your benchmarks, click on the button "Purge everything and start over". Note: After at least one benchmark is done on a drive, you have the ability to recover previous benchmarks that were uploaded to the HDDB by viewing the drive in question and clicking on the button "Manage Benchmarks". Edit a given drive and correct the text overlay. If you have multiple drives of the same model, you'll have an additional checkbox labeled "Apply changes to all drives of the same model" - check it. Quote Link to comment
IZSkiSurfer Posted October 31, 2022 Share Posted October 31, 2022 (edited) On 10/30/2022 at 2:32 AM, jbartlett said: Version 2.9.7 deployed. On fresh startup, fetch device's block size from "/sys/class/block/DeviceID/queue/logical_block_size" for use in forcing a drive's spin-up Sorry but the spinup_* file(s) are still wrong... bs=512 instead of bs=4096 I double checked it's 2.9.7 and also removed the container completely and pulled fresh. Also tried to delete everything under /tmp/ and restarting the container. It's always generated with bs=512 I checked the Spinup.cfm and I think the problem could be that you loop i from 1 to 9 so you miss the first nvme which is enumerated as nvme0n1 Edit: I can confirm if you use <CFSET DeviceID="nvme#i-1#n1"> it works. The next problem is somewhere in the Benchmarking cfm files. They run the following command: dd if=/dev/nvme0n1 of=/dev/null bs=10240 skip=0 iflag=direct conv=noerror status=progress 10240 is also not working with a drive which uses 4K --> dd: error reading '/dev/nvme0n1': Invalid argument And I found a bug: If the manufacturer of a drive is not detected (= Unknown) and you head over to the image edit page there are some errors. Edited November 1, 2022 by IZSkiSurfer Quote Link to comment
jbartlett Posted November 1, 2022 Author Share Posted November 1, 2022 16 hours ago, IZSkiSurfer said: I can confirm if you use <CFSET DeviceID="nvme#i-1#n1"> it works. It was supposed to loop from 0 to 9 instead of 1 to 9. I made that change. 16 hours ago, IZSkiSurfer said: The next problem is somewhere in the Benchmarking cfm files. They run the following command: dd if=/dev/nvme0n1 of=/dev/null bs=10240 skip=0 iflag=direct conv=noerror status=progress 10240 is also not working with a drive which uses 4K --> dd: error reading '/dev/nvme0n1': Invalid argument I'll take a look at the block size computation. Can you email me a small debug file from the "Create Debug File" from the DiskSpeed app to [email protected]? I'm currently adding proper SSD benchmarking so it's kinda moot in 99% of the cases. It will write ten 2GB files and then read the ten files back taking the min/max/avg times, bypassing the system cache. Requires a mounted partition with at least 25GB of free space. That logic is done, now working on figuring out how to render that on a chart with a stock ticker reflecting the three values. 16 hours ago, IZSkiSurfer said: And I found a bug: If the manufacturer of a drive is not detected (= Unknown) and you head over to the image edit page there are some errors. Thank you, I'll investigate. Quote Link to comment
FQs19 Posted November 2, 2022 Share Posted November 2, 2022 On 11/1/2022 at 12:39 PM, jbartlett said: It was supposed to loop from 0 to 9 instead of 1 to 9. I made that change. I'll take a look at the block size computation. Can you email me a small debug file from the "Create Debug File" from the DiskSpeed app to [email protected]? I'm currently adding proper SSD benchmarking so it's kinda moot in 99% of the cases. It will write ten 2GB files and then read the ten files back taking the min/max/avg times, bypassing the system cache. Requires a mounted partition with at least 25GB of free space. That logic is done, now working on figuring out how to render that on a chart with a stock ticker reflecting the three values. Thank you, I'll investigate. I'm still unable to get this plugin to work just like @IZSkiSurfer Looking forward to getting it working again. Here's the error from the webgui: Spoiler DiskSpeed - Disk Diagnostics & Reporting tool Version: 2.9.7 Scanning Hardware 18:47:07 Spinning up hard drives Lucee 5.3.9.166 Error (application) Message Error invoking external process Stacktrace The Error Occurred in /var/www/Spinup.cfm: line 149 147: <CFFILE action="write" file="/tmp/DiskSpeedTmp/spinup.sh" mode="766" output="#spinup#" addnewline="NO"> 148: </cflock> 149: <CFEXECUTE name="/tmp/DiskSpeedTmp/spinup.sh" timeout="0" /> 150: <CFELSE> 151: <cflock name="FileWrite" type="exclusive" throwontimeout="true" timeout="10"> called from /var/www/ScanControllers.cfm: line 264 262: </CFOUTPUT> 263: <CFFLUSH> 264: <CFINCLUDE template="Spinup.cfm"> 265: 266: <CFIF FileExists("#PersistDir#/storage.json")> called from /var/www/ScanControllers.cfm: line 257 255: <cfexecute name="/bin/ls" arguments="-l /sys/block" variable="BlockDevices" timeout="90" /> 256: <CFFILE action="delete" file="#PersistDir#/ls_sysblock_exec.txt"> 257: <CFFILE action="write" file="#PersistDir#/ls_sysblock.txt" output="#BlockDevices#" addnewline="NO" mode="666"> 258: 259: <CFOUTPUT> Java Stacktrace lucee.runtime.exp.ApplicationException: Error invoking external process at lucee.runtime.tag.Execute.doEndTag(Execute.java:266) at spinup_cfm$cf.call(/Spinup.cfm:149) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:1054) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:946) at lucee.runtime.PageContextImpl.doInclude(PageContextImpl.java:927) at scancontrollers_cfm$cf.call_000005(/ScanControllers.cfm:264) at scancontrollers_cfm$cf.call(/ScanControllers.cfm:257) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:1054) at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:946) at lucee.runtime.listener.ClassicAppListener._onRequest(ClassicAppListener.java:65) at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:45) at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2490) at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2476) at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2447) at lucee.runtime.engine.Request.exe(Request.java:45) at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1198) at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1144) at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:97) at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:541) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:687) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:769) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:360) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:890) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1789) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.base/java.lang.Thread.run(Thread.java:829) Timestamp 11/2/22 6:52:09 PM EDT Here's the logs from DiskSpeed: Spoiler text error warn system array login NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 02-Nov-2022 18:46:43.259 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat/9.0.65 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: Jul 14 2022 12:28:53 UTC 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.65.0 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.19.14-Unraid 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /usr/local/openjdk-11 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 11.0.16+8 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Oracle Corporation 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /usr/local/tomcat 02-Nov-2022 18:46:43.262 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /usr/local/tomcat 02-Nov-2022 18:46:43.278 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED 02-Nov-2022 18:46:43.278 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED 02-Nov-2022 18:46:43.278 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED 02-Nov-2022 18:46:43.278 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED 02-Nov-2022 18:46:43.278 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 02-Nov-2022 18:46:43.279 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/local/tomcat/conf/logging.properties 02-Nov-2022 18:46:43.279 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager 02-Nov-2022 18:46:43.279 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048 02-Nov-2022 18:46:43.279 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources 02-Nov-2022 18:46:43.279 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027 02-Nov-2022 18:46:43.279 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xms64m 02-Nov-2022 18:46:43.279 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx512m 02-Nov-2022 18:46:43.280 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.security.egd=file:/dev/./urandom 02-Nov-2022 18:46:43.280 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs= 02-Nov-2022 18:46:43.280 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/local/tomcat 02-Nov-2022 18:46:43.280 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/local/tomcat 02-Nov-2022 18:46:43.280 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/usr/local/tomcat/temp 02-Nov-2022 18:46:43.296 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.35] using APR version [1.7.0]. 02-Nov-2022 18:46:43.296 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], UDS [true]. 02-Nov-2022 18:46:43.296 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true] 02-Nov-2022 18:46:43.298 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.1n 15 Mar 2022] 02-Nov-2022 18:46:43.513 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8888"] 02-Nov-2022 18:46:43.532 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [465] milliseconds 02-Nov-2022 18:46:43.560 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina] 02-Nov-2022 18:46:43.560 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.65] WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/usr/local/tomcat/lucee/lucee.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 02-Nov-2022 18:46:45.306 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8888"] 02-Nov-2022 18:46:45.316 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [1784] milliseconds Exception in thread "Thread-31" java.lang.OutOfMemoryError: Java heap space at java.base/java.util.Arrays.copyOf(Arrays.java:3745) at java.base/java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:172) at java.base/java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:686) at java.base/java.lang.StringBuffer.append(StringBuffer.java:414) at java.base/java.io.StringWriter.write(StringWriter.java:99) at lucee.commons.io.IOUtil.copy(IOUtil.java:390) at lucee.commons.io.IOUtil.copy(IOUtil.java:351) at lucee.commons.io.IOUtil.toString(IOUtil.java:881) at lucee.commons.io.IOUtil.toString(IOUtil.java:868) at lucee.commons.io.IOUtil.toString(IOUtil.java:828) at lucee.commons.cli.StreamGobbler.run(Command.java:187) Quote Link to comment
jbartlett Posted November 3, 2022 Author Share Posted November 3, 2022 @FQs19 - You've got two errors here, the 2nd one (logs from DiskSpeed) shows an out of memory condition. How much memory does your system have? Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.