DiskSpeed, hdd/ssd benchmarking (unRAID 6+), version 2.10.8

[Zonediver]

12 hours ago, jbartlett said:

Please open a command shell to your unraid box or the DiskSpeed app and enter the following commands and reply with the result:

lsblk /dev/nvme0n1

lsblk /dev/nvme1n1

 

Look at this

 

FYI: None of this three mentioned conditions are true...

.) Drive not mounted - No - alle drives are mounted

.) Less the 25GB free - No - 467GB/585GB free

.) Part of a pool - No

So there must be some other error 🤣

 

FYI2: It takes "ages" till the webGUI cames up... maybe another new problem?

 

FYI3:

 

Edited December 7, 2022 by Zonediver

[jbartlett]

5 hours ago, Zonediver said:

FYI: None of this three mentioned conditions are true...

.) Drive not mounted - No - alle drives are mounted

.) Less the 25GB free - No - 467GB/585GB free

.) Part of a pool - No

So there must be some other error 🤣

 

FYI2: It takes "ages" till the webGUI cames up... maybe another new problem?

 

I pushed a tweaked 2.10 up, please update and try again. I added a list of partitions to the check to see if the drive assignments have been updated but I missed that it forces the drives to spin up one at a time.

 

As for the benchmarking part, after updating the app, open and click on the "Create Debug File" link at the bottom and then the left button on the dialog. Attach to a reply or email it to [email protected]

[MustardTiger]

On 12/3/2022 at 1:43 AM, jbartlett said:

 

I've found that this error by itself is harmless, it's the OS trying to identify what the drive supports.

 

If you want to try to isolate what is causing the problem, here are the series of commands that are executed. Start the DiskSpeed docker app but do not open the web interface. Open a command shell on the system and enter the following:

 

docker exec -it DiskSpeed bash

 

Unfortunately, the debug files you sent did not include any of the data files that are created while scanning the drive. Please try running the following to see if any of these cause issues. I don't need to know what worked or what was returned, just which one blew up if any.
 

/usr/bin/lspci
/bin/ls -l /sys/dev/block
/bin/lsblk
/bin/ls -l /sys/block
/usr/sbin/hwinfo --pci --bridge --storage-ctrl --disk --ide --scsi
/usr/bin/lspci -D
/usr/bin/find /sys/devices -name usb?
/bin/ls -l /sys/block
/usr/sbin/nvme list
/usr/bin/lshw -c storage
/sbin/blockdev --getmaxsect /dev/nvme0n1
/sbin/blockdev --getsize64 /dev/nvme0n1
/sbin/hdparm -I /dev/nvme0n1
/usr/bin/lshw -xml
/usr/sbin/dmidecode -t 2
/usr/sbin/dmidecode -t 9
/bin/df -B 1KB
/sbin/parted -m /dev/nvme0n1 unit B print free
/sbin/blkid -o export /dev/nvme0n1
/sbin/blkid -n -o mountpoint /dev/nvme0n1

 

If these all work, I'll see about adding support for adding a "sync" after each file creation to enforce the data to be saved prior to running the more dynamically generated commands.

 

 

All those commands bar one seemed to work fine, in the sense that they all out output something. The one which didn't seem to output anything was this one:
 

root@2cd6bad055fb:/usr/local/tomcat# /sbin/hdparm -I /dev/nvme0n1

/dev/nvme0n1:

 

I'm guessing that's just something to do with hdparm not being for NVMe devices, and if that is the case then all these commands seem to have worked. 

 

I'll attach the outputs of those commands anyway, since I already output them into a doc for myself to look through.

 

DiskSpeed command outputs.txt

[jbartlett]

@MustardTiger - I added a debug version of DiskSpeed for you to try which forces the diagnostic files from not being removed after the hardware scan. Please update the Docker repository to "jbartlett777/diskspeed:2.10a" and open DiskSpeed.

 

After the hardware is scanned, it'll prompt you to create a debug file, please do so and email it to the address given.

[jsmontague]

Getting an error starting DiskSpeed GUI. Its been a little bit since I've run it, so not sure if this is an issue since upgrading to 6.11.5 or with a new drive model I have installed, Toshiba MG04SCA60EA. 

DiskSpeed ERROR.txt

[jbartlett]

8 hours ago, jsmontague said:

Getting an error starting DiskSpeed GUI. Its been a little bit since I've run it, so not sure if this is an issue since upgrading to 6.11.5 or with a new drive model I have installed, Toshiba MG04SCA60EA. 

 

That drive has an interesting block size of either 4,096 / 4,160 / 4,224 bytes.

 

Please update the Docker DiskSpeed settings to pull from repository "jbartlett777/diskspeed:2.10a" - this version has more robust logging plus additional error trapping added. It should allow you to get past that point (but may error elsewhere) and will display a link at the bottom to create a debug file if it successfully finishes. However, prior to doing so, please click on the DiskSpeed icon in Unraid and select "Console" and then enter the following command: cp /tmp/DiskSpeedTmp/spinup.sh /tmp/DiskSpeed/spinup.sh

 

If it errors again, update the URL to replace "/ScanControllers.cfm" with "/isolated/CreateDebugInfo.cfm?Back=1"

 

When creating the debug file, please select the middle option for missing controllers or drives.

 

 

[shwa87]

Greetings,

 

I'm trying to run the drive benchmark and I'm getting the following errors:

Message	variable [ISSSD] doesn't exist
Stacktrace	The Error Occurred in
/var/www/Benchmark.cfm: line 482 
480: </CFIF>
481: </CFIF>
482: <CFIF IsSSD>
483: <CFIF HW[Key].Ports[PortNo].Attrib.Size.Bytes GT SSDMaxBytes>
484: <CFSET SSDMaxBytes=HW[Key].Ports[PortNo].Attrib.Size.Bytes>

Java Stacktrace	lucee.runtime.exp.ExpressionException: variable [ISSSD] doesn't exist
  at lucee.runtime.type.scope.UndefinedImpl.get(UndefinedImpl.java:242)
  at lucee.runtime.type.scope.UndefinedImpl.get(UndefinedImpl.java:184)
  at benchmark_cfm$cf.call(/Benchmark.cfm:482)
  at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:1056)
  at lucee.runtime.PageContextImpl._doInclude(PageContextImpl.java:948)
  at lucee.runtime.listener.ClassicAppListener._onRequest(ClassicAppListener.java:65)
  at lucee.runtime.listener.MixedAppListener.onRequest(MixedAppListener.java:45)
  at lucee.runtime.PageContextImpl.execute(PageContextImpl.java:2493)
  at lucee.runtime.PageContextImpl._execute(PageContextImpl.java:2478)
  at lucee.runtime.PageContextImpl.executeCFML(PageContextImpl.java:2449)
  at lucee.runtime.engine.Request.exe(Request.java:45)
  at lucee.runtime.engine.CFMLEngineImpl._service(CFMLEngineImpl.java:1216)
  at lucee.runtime.engine.CFMLEngineImpl.serviceCFML(CFMLEngineImpl.java:1162)
  at lucee.loader.engine.CFMLEngineWrapper.serviceCFML(CFMLEngineWrapper.java:97)
  at lucee.loader.servlet.CFMLServlet.service(CFMLServlet.java:51)
  at javax.servlet.http.HttpServlet.service(HttpServlet.java:764)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
  at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
  at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197)
  at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
  at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:541)
  at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135)
  at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
  at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:687)
  at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:769)
  at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
  at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:360)
  at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399)
  at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
  at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:890)
  at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1789)
  at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
  at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
  at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
  at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
  at java.base/java.lang.Thread.run(Thread.java:829)
 
Timestamp	12/12/22 12:40:32 PM CST

 

Any and all assistance is appreciated.

[jbartlett]

On 12/12/2022 at 11:01 AM, shwa87 said:

Greetings,

 

I'm trying to run the drive benchmark and I'm getting the following errors:

Message	variable [ISSSD] doesn't exist
Stacktrace	The Error Occurred in
/var/www/Benchmark.cfm: line 482 
480: </CFIF>
481: </CFIF>
482: <CFIF IsSSD>
483: <CFIF HW[Key].Ports[PortNo].Attrib.Size.Bytes GT SSDMaxBytes>
484: <CFSET SSDMaxBytes=HW[Key].Ports[PortNo].Attrib.Size.Bytes>

 

Any and all assistance is appreciated.

 

Please update the docker, it should reflect version 2.10.1. I corrected the logic error that caused this issue.

[opentoe]

I ran the diskspeed without issue, which displayed a nice webview of the results. Accidentally I closed the browser and could not get to display again. Even looked in my history. Is there a way to display the results from previous tests using the browser to view them?

 

Thanks

 

[jbartlett]

15 hours ago, opentoe said:

I ran the diskspeed without issue, which displayed a nice webview of the results. Accidentally I closed the browser and could not get to display again. Even looked in my history. Is there a way to display the results from previous tests using the browser to view them?

 

Thanks

 

 

If you are running DiskSpeed via UNRAID, click on the Docker tab and then click on the DiskSpeed icon. Select "WebUI".

 

For other installations, use the given IP of the machine running Docker with port 18888.

Examples:

http://localhost:18888/

http://192.168.1.2:18888/

 

 

[emb531]

Hello, I am unable to benchmark my NVME drives with the latest update:

 

Unable to benchmark for the following reason
* No mounted partitions were found.
You will need to restart the DiskSpeed docker after making changes to mounted drives for changes to take effect.

 

I have restarted the container with the same issue, if I do the Rescan Controllers option I see these errors in my syslog:

 

Dec 16 15:09:41 Saturn kernel: nvme0: Admin Cmd(0x7f), I/O Error (sct 0x0 / sc 0x1) 
Dec 16 15:09:41 Saturn kernel: nvme1: Admin Cmd(0x7f), I/O Error (sct 0x0 / sc 0x1) 
Dec 16 15:10:12 Saturn kernel: nvme nvme1: controller is down; will reset: CSTS=0x3, PCI_STATUS=0x10
Dec 16 15:10:12 Saturn kernel: nvme1: Admin Cmd(0x6), I/O Error (sct 0x3 / sc 0x71) 
Dec 16 15:10:12 Saturn kernel: nvme nvme1: Shutdown timeout set to 10 seconds
Dec 16 15:10:12 Saturn kernel: nvme nvme1: 16/0/0 default/read/poll queues

 

I emailed you a debug file at [email protected] - thanks!

[youngfish]

I installed DiskSpeed today. All harddiks in the array are benchmarked OK. But for my SSD (cache configured in RAID1) and my unassigned NVME (formatted and has already used as dedicated VM drive with unassigned plugin) disk, it refused to benchmark:

 

Unable to benchmark for the following reason
* No mounted partitions were found.
You will need to restart the DiskSpeed docker after making changes to mounted drives for changes to take effect.

 

I guess it is a common problem.

[opentoe]

14 hours ago, jbartlett said:

 

If you are running DiskSpeed via UNRAID, click on the Docker tab and then click on the DiskSpeed icon. Select "WebUI".

 

For other installations, use the given IP of the machine running Docker with port 18888.

Examples:

http://localhost:18888/

http://192.168.1.2:18888/

 

 

Yes thank you but I wanted to know how to view previous results. I did the testing but closed my browser window by mistake and now when I view the webui it starts from scratch.

[jbartlett]

On 12/17/2022 at 12:47 AM, opentoe said:

Yes thank you but I wanted to know how to view previous results. I did the testing but closed my browser window by mistake and now when I view the webui it starts from scratch.

 

If you're asking this, you're likely not using the Docker version of the application or you would see the benchmarks when you opened up the application's site in the given URL's.

 

What are you running?

[deepinder27]

I am having the same issue. Previously it used to work fine. Dont know whats wrong now.

On 12/16/2022 at 11:09 PM, youngfish said:

I installed DiskSpeed today. All harddiks in the array are benchmarked OK. But for my SSD (cache configured in RAID1) and my unassigned NVME (formatted and has already used as dedicated VM drive with unassigned plugin) disk, it refused to benchmark:

 

Unable to benchmark for the following reason
* No mounted partitions were found.
You will need to restart the DiskSpeed docker after making changes to mounted drives for changes to take effect.

 

I guess it is a common problem.

 

[mayberts]

On 12/17/2022 at 3:09 AM, youngfish said:

I installed DiskSpeed today. All harddiks in the array are benchmarked OK. But for my SSD (cache configured in RAID1) and my unassigned NVME (formatted and has already used as dedicated VM drive with unassigned plugin) disk, it refused to benchmark:

 

Unable to benchmark for the following reason
* No mounted partitions were found.
You will need to restart the DiskSpeed docker after making changes to mounted drives for changes to take effect.

 

I guess it is a common problem.

I'm also getting this issue.  I recently added 4 500GB nvme drives, with a total of 8 nvme drives. the first four used to bench, now none of them do.

[jsmontague]

On 12/10/2022 at 6:33 PM, jbartlett said:

 

That drive has an interesting block size of either 4,096 / 4,160 / 4,224 bytes.

 

Please update the Docker DiskSpeed settings to pull from repository "jbartlett777/diskspeed:2.10a" - this version has more robust logging plus additional error trapping added. It should allow you to get past that point (but may error elsewhere) and will display a link at the bottom to create a debug file if it successfully finishes. However, prior to doing so, please click on the DiskSpeed icon in Unraid and select "Console" and then enter the following command: cp /tmp/DiskSpeedTmp/spinup.sh /tmp/DiskSpeed/spinup.sh

 

If it errors again, update the URL to replace "/ScanControllers.cfm" with "/isolated/CreateDebugInfo.cfm?Back=1"

 

When creating the debug file, please select the middle option for missing controllers or drives.

 

 

I sent the debug file in email. I moved the docker back to 2.10.1 and DiskSpeed was able to start and found all my drives. However I can't benchmark any drives;

 

Unable to benchmark for the following reason
* No mounted partitions were found.
You will need to restart the DiskSpeed docker after making changes to mounted drives for changes to take effect.

[mayberts]

I can bench all my drives with version 2.9.7

[jsmontague]

I am still unable to spin up drives on any version below 2.10.1. 

 

Version: 2.9.7.1
 

Scanning Hardware
08:09:48 Spinning up hard drives

Lucee 5.3.9.166 Error (application)

MessageError invoking external process

[jbartlett]

6 hours ago, jsmontague said:

I am still unable to spin up drives on any version below 2.10.1. 

 

Version: 2.9.7.1
 

Scanning Hardware
08:09:48 Spinning up hard drives

Lucee 5.3.9.166 Error (application)

MessageError invoking external process

 

Version 2.10.1 has error trapping added around calling the Spinup function. It's probably still happening, but it ignores the spinup issue and keeps moving forward.

 

I'm looking into the debug files that were sent.

[opentoe]

On 12/18/2022 at 8:04 PM, jbartlett said:

 

If you're asking this, you're likely not using the Docker version of the application or you would see the benchmarks when you opened up the application's site in the given URL's.

 

What are you running?

I must have asked the question wrong, I am positively using the docker version. When I select the Webui it takes me to the attached screen. All I would like to see is the last results. I haven't hit any of the buttons, I don't want to accidently erase them. See attached. Thanks.

[jbartlett]

7 hours ago, opentoe said:

I must have asked the question wrong, I am positively using the docker version. When I select the Webui it takes me to the attached screen. All I would like to see is the last results. I haven't hit any of the buttons, I don't want to accidently erase them. See attached. Thanks.

 

Okay, everything looks almost ok. Are you saying that you clicked the "Bookmark Drives" button and it finished and displayed the graphs but now it does not? It should be displayed right under that button. Likewise, if you click on any of the drives, it's benchmark will be displayed on it's information page. Here, it doesn't seem that any benchmarks happened.

 

There's a couple things that could cause this. If you clicked "Purge Everything and start over", that erases your past benchmarks from your system. If the benchmark is somehow invalid such as the abort button was pressed or a benchmark did not complete, it is removed. If the "Abort Benchmark" button updated to "Continue", the benchmark process fully ran successfully.

 

It's safe to click "Benchmark Drives" or click on one drive and run the benchmark on it for a faster result. If the benchmarks still don't display, run another single drive benchmark and click just to the right of the period at the end of the "Click on a drive label to hide or show it." to toggle the visibility of the hidden iframes that are doing the actual work. If there was an error, it would be displayed there.

 

If you accidentally erased your benchmarks, you can recover your past benchmarks if you had uploaded them to the hddb by clicking the "Upload Drive & Benchmarks" button. View a drive and click on the "Manage Benchmarks" button. The next page will display every benchmark on your system and what had been uploaded. Click on the drive label in the legend to hide or show individual benchmarks. Any that are visible when you click "Update Benchmarks" are saved locally, the rest are removed locally. Ideal if you have a ton of benchmarks but only want to see your oldest and newest for example.

 

On a side note, many of your drives don't have images when they exist in the HDDB. When clicking the "Rescan Controllers" button, does it indicate any issues fetching the images?

 

[opentoe]

1 hour ago, jbartlett said:

 

Okay, everything looks almost ok. Are you saying that you clicked the "Bookmark Drives" button and it finished and displayed the graphs but now it does not? It should be displayed right under that button. Likewise, if you click on any of the drives, it's benchmark will be displayed on it's information page. Here, it doesn't seem that any benchmarks happened.

 

There's a couple things that could cause this. If you clicked "Purge Everything and start over", that erases your past benchmarks from your system. If the benchmark is somehow invalid such as the abort button was pressed or a benchmark did not complete, it is removed. If the "Abort Benchmark" button updated to "Continue", the benchmark process fully ran successfully.

 

It's safe to click "Benchmark Drives" or click on one drive and run the benchmark on it for a faster result. If the benchmarks still don't display, run another single drive benchmark and click just to the right of the period at the end of the "Click on a drive label to hide or show it." to toggle the visibility of the hidden iframes that are doing the actual work. If there was an error, it would be displayed there.

 

If you accidentally erased your benchmarks, you can recover your past benchmarks if you had uploaded them to the hddb by clicking the "Upload Drive & Benchmarks" button. View a drive and click on the "Manage Benchmarks" button. The next page will display every benchmark on your system and what had been uploaded. Click on the drive label in the legend to hide or show individual benchmarks. Any that are visible when you click "Update Benchmarks" are saved locally, the rest are removed locally. Ideal if you have a ton of benchmarks but only want to see your oldest and newest for example.

 

On a side note, many of your drives don't have images when they exist in the HDDB. When clicking the "Rescan Controllers" button, does it indicate any issues fetching the images?

 

Ok thanks. I will check it out tonight when I get back. I don't remember doing any single drive benchmarks. I've just done all at once and when finished that screen comes up with ALL the drives benchmarks. That's the page I was looking for. The previous results did finish fine, I just happen to close the browser window by mistake. Is there a default URL that would display that particular page?

[jbartlett]

6 hours ago, opentoe said:

Ok thanks. I will check it out tonight when I get back. I don't remember doing any single drive benchmarks. I've just done all at once and when finished that screen comes up with ALL the drives benchmarks. That's the page I was looking for. The previous results did finish fine, I just happen to close the browser window by mistake. Is there a default URL that would display that particular page?

 

The main page displays all the benchmarks, clicking the page header on any page will take you there. The benchmark final result as shown isn't available once you leave it but you can click on the 3 line button on the top-right corner to download an image version of it.

 

Here's how it looks on my system

Edited December 22, 2022 by jbartlett

[opentoe]

Thanks. I wanted to start from scratch so I purged and doing a scan now.