peace-keeping-villa8590

I have removed all but one of the Dell EMC drives and I was doing more searching around and found the a driver from dell for these drives from their website. @ich777 I think this might be what is needed. https://links.homeserver.co/vigWT

Drive formatted as NTFS, xfs and no filesystem. I am convinced it's a problem with the firmware of these drives. Thanks for actually helping me out trying to figure out what the issue but I don't have the hardware required to update the firmware and I'm pulling these drives.

Comparing the vm kernel version to Unraids, I was really surprised. Ext4 I think but it also says "Contents FAT..."

5.15.0

Do you have any insight as to why a VM on the same disk is faster?

I'm still working on moving the drives to test backplanes/cables. I was trying to find what driver was being used if I passed one of the drives through an Ubuntu VM using dmesg. Unsurprisingly, it said virtio. user@ubuntu-desktop:~$ dmesg | grep vda [ 4.261295] virtio_blk virtio2: [vda] 7501476528 512-byte logical blocks (3.84 TB/3.49 TiB) [ 4.274482] vda: vda1 vda2 [ 6.259732] EXT4-fs (vda2): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. [ 7.796338] EXT4-fs (vda2): re-mounted. Opts: errors=remount-ro. Quota mode: none. I doubt this is helpful but when I ran a similar command in Unraid, I got this: (command "dmesg") [248219.706259] sd 21:0:5:0: [sdp] tag#2403 ASC=0x1c ASCQ=0x2 [248219.712616] sd 21:0:3:0: [sdn] tag#2419 Sense Key : 0x1 [current] [248219.712629] sd 21:0:3:0: [sdn] tag#2419 ASC=0x1c ASCQ=0x2 [248219.720138] sd 21:0:6:0: [sdq] tag#2426 Sense Key : 0x1 [current] [248219.720149] sd 21:0:6:0: [sdq] tag#2426 ASC=0x1c ASCQ=0x2 [248219.720630] sd 21:0:1:0: [sdl] tag#2430 Sense Key : 0x1 [current] [248219.720640] sd 21:0:1:0: [sdl] tag#2430 ASC=0x1c ASCQ=0x2 [248258.167861] sd 21:0:3:0: [sdn] tag#2392 Sense Key : 0x1 [current] [248258.167872] sd 21:0:3:0: [sdn] tag#2392 ASC=0x1c ASCQ=0x2 [248258.179608] sd 21:0:6:0: [sdq] tag#2369 Sense Key : 0x1 [current] [248258.179620] sd 21:0:6:0: [sdq] tag#2369 ASC=0x1c ASCQ=0x2 [248258.179923] sd 21:0:1:0: [sdl] tag#2372 Sense Key : 0x1 [current] [248258.179934] sd 21:0:1:0: [sdl] tag#2372 ASC=0x1c ASCQ=0x2 [248258.186416] sd 21:0:5:0: [sdp] tag#2375 Sense Key : 0x1 [current] [248258.186427] sd 21:0:5:0: [sdp] tag#2375 ASC=0x1c ASCQ=0x2 [248296.567609] sd 21:0:6:0: [sdq] tag#2410 Sense Key : 0x1 [current] [248296.567622] sd 21:0:6:0: [sdq] tag#2410 ASC=0x1c ASCQ=0x2 [248296.570863] sd 21:0:3:0: [sdn] tag#2418 Sense Key : 0x1 [current] [248296.570877] sd 21:0:3:0: [sdn] tag#2418 ASC=0x1c ASCQ=0x2 [248296.575627] sd 21:0:5:0: [sdp] tag#2422 Sense Key : 0x1 [current] [248296.575641] sd 21:0:5:0: [sdp] tag#2422 ASC=0x1c ASCQ=0x2 [248296.584953] sd 21:0:1:0: [sdl] tag#2427 Sense Key : 0x1 [current] [248296.584965] sd 21:0:1:0: [sdl] tag#2427 ASC=0x1c ASCQ=0x2 [248334.937341] sd 21:0:3:0: [sdn] tag#2373 Sense Key : 0x1 [current] [248334.937352] sd 21:0:3:0: [sdn] tag#2373 ASC=0x1c ASCQ=0x2 [248334.946946] sd 21:0:6:0: [sdq] tag#2414 Sense Key : 0x1 [current] [248334.946957] sd 21:0:6:0: [sdq] tag#2414 ASC=0x1c ASCQ=0x2 [248334.958650] sd 21:0:1:0: [sdl] tag#2424 Sense Key : 0x1 [current] [248334.958661] sd 21:0:1:0: [sdl] tag#2424 ASC=0x1c ASCQ=0x2 [248334.959567] sd 21:0:5:0: [sdp] tag#2429 Sense Key : 0x1 [current] [248334.959581] sd 21:0:5:0: [sdp] tag#2429 ASC=0x1c ASCQ=0x2 [248373.442500] sd 21:0:1:0: [sdl] tag#2406 Sense Key : 0x1 [current] [248373.442511] sd 21:0:1:0: [sdl] tag#2406 ASC=0x1c ASCQ=0x2 [248373.442824] sd 21:0:3:0: [sdn] tag#2412 Sense Key : 0x1 [current] [248373.442838] sd 21:0:3:0: [sdn] tag#2412 ASC=0x1c ASCQ=0x2 [248373.454508] sd 21:0:6:0: [sdq] tag#2426 Sense Key : 0x1 [current] [248373.454520] sd 21:0:6:0: [sdq] tag#2426 ASC=0x1c ASCQ=0x2 [248373.462298] sd 21:0:5:0: [sdp] tag#2368 Sense Key : 0x1 [current] [248373.462310] sd 21:0:5:0: [sdp] tag#2368 ASC=0x1c ASCQ=0x2 [248412.138995] sd 21:0:3:0: [sdn] tag#2480 Sense Key : 0x1 [current] [248412.139009] sd 21:0:3:0: [sdn] tag#2480 ASC=0x1c ASCQ=0x2 [248412.140368] sd 21:0:1:0: [sdl] tag#2373 Sense Key : 0x1 [current] [248412.140379] sd 21:0:1:0: [sdl] tag#2373 ASC=0x1c ASCQ=0x2 [248412.142965] sd 21:0:6:0: [sdq] tag#2376 Sense Key : 0x1 [current] [248412.142975] sd 21:0:6:0: [sdq] tag#2376 ASC=0x1c ASCQ=0x2 [248412.147805] sd 21:0:5:0: [sdp] tag#2382 Sense Key : 0x1 [current] [248412.147814] sd 21:0:5:0: [sdp] tag#2382 ASC=0x1c ASCQ=0x2 [248450.422994] sd 21:0:3:0: [sdn] tag#2406 Sense Key : 0x1 [current] [248450.423005] sd 21:0:3:0: [sdn] tag#2406 ASC=0x1c ASCQ=0x2 [248450.423741] sd 21:0:6:0: [sdq] tag#2416 Sense Key : 0x1 [current] [248450.423752] sd 21:0:6:0: [sdq] tag#2416 ASC=0x1c ASCQ=0x2 [248450.427170] sd 21:0:1:0: [sdl] tag#2395 Sense Key : 0x1 [current] [248450.427181] sd 21:0:1:0: [sdl] tag#2395 ASC=0x1c ASCQ=0x2 [248450.438265] sd 21:0:5:0: [sdp] tag#2407 Sense Key : 0x1 [current] [248450.438276] sd 21:0:5:0: [sdp] tag#2407 ASC=0x1c ASCQ=0x2 [248488.893587] sd 21:0:5:0: [sdp] tag#2373 Sense Key : 0x1 [current] [248488.893598] sd 21:0:5:0: [sdp] tag#2373 ASC=0x1c ASCQ=0x2 [248488.893782] sd 21:0:1:0: [sdl] tag#2376 Sense Key : 0x1 [current] [248488.893794] sd 21:0:1:0: [sdl] tag#2376 ASC=0x1c ASCQ=0x2 [248488.898964] sd 21:0:3:0: [sdn] tag#2385 Sense Key : 0x1 [current] [248488.898976] sd 21:0:3:0: [sdn] tag#2385 ASC=0x1c ASCQ=0x2 [248488.907327] sd 21:0:6:0: [sdq] tag#2393 Sense Key : 0x1 [current] [248488.907338] sd 21:0:6:0: [sdq] tag#2393 ASC=0x1c ASCQ=0x2 [248527.460434] sd 21:0:1:0: [sdl] tag#2393 Sense Key : 0x1 [current] [248527.460447] sd 21:0:1:0: [sdl] tag#2393 ASC=0x1c ASCQ=0x2 [248527.461847] sd 21:0:5:0: [sdp] tag#2402 Sense Key : 0x1 [current] [248527.461861] sd 21:0:5:0: [sdp] tag#2402 ASC=0x1c ASCQ=0x2 [248527.466022] sd 21:0:3:0: [sdn] tag#2415 Sense Key : 0x1 [current] [248527.466033] sd 21:0:3:0: [sdn] tag#2415 ASC=0x1c ASCQ=0x2 [248527.477625] sd 21:0:6:0: [sdq] tag#2425 Sense Key : 0x1 [current] [248527.477637] sd 21:0:6:0: [sdq] tag#2425 ASC=0x1c ASCQ=0x2 [248565.808494] sd 21:0:3:0: [sdn] tag#2408 Sense Key : 0x1 [current] [248565.808505] sd 21:0:3:0: [sdn] tag#2408 ASC=0x1c ASCQ=0x2 [248565.809041] sd 21:0:1:0: [sdl] tag#2414 Sense Key : 0x1 [current] [248565.809052] sd 21:0:1:0: [sdl] tag#2414 ASC=0x1c ASCQ=0x2 [248565.812678] sd 21:0:6:0: [sdq] tag#2422 Sense Key : 0x1 [current] [248565.812689] sd 21:0:6:0: [sdq] tag#2422 ASC=0x1c ASCQ=0x2 [248565.813991] sd 21:0:5:0: [sdp] tag#2427 Sense Key : 0x1 [current] [248565.814003] sd 21:0:5:0: [sdp] tag#2427 ASC=0x1c ASCQ=0x2 [248604.668351] sd 21:0:6:0: [sdq] tag#2401 Sense Key : 0x1 [current] [248604.668362] sd 21:0:6:0: [sdq] tag#2401 ASC=0x1c ASCQ=0x2 [248604.673686] sd 21:0:3:0: [sdn] tag#2462 Sense Key : 0x1 [current] [248604.673696] sd 21:0:3:0: [sdn] tag#2462 ASC=0x1c ASCQ=0x2 [248604.675502] sd 21:0:5:0: [sdp] tag#2408 Sense Key : 0x1 [current] [248604.675512] sd 21:0:5:0: [sdp] tag#2408 ASC=0x1c ASCQ=0x2 [248604.677797] sd 21:0:1:0: [sdl] tag#2411 Sense Key : 0x1 [current] [248604.677808] sd 21:0:1:0: [sdl] tag#2411 ASC=0x1c ASCQ=0x2 [248643.932036] sd 21:0:6:0: [sdq] tag#2405 Sense Key : 0x1 [current] [248643.932047] sd 21:0:6:0: [sdq] tag#2405 ASC=0x1c ASCQ=0x2 [248643.937087] sd 21:0:3:0: [sdn] tag#2409 Sense Key : 0x1 [current] [248643.937097] sd 21:0:3:0: [sdn] tag#2409 ASC=0x1c ASCQ=0x2 [248643.940116] sd 21:0:5:0: [sdp] tag#2413 Sense Key : 0x1 [current] [248643.940128] sd 21:0:5:0: [sdp] tag#2413 ASC=0x1c ASCQ=0x2 [248643.942183] sd 21:0:1:0: [sdl] tag#2418 Sense Key : 0x1 [current] [248643.942197] sd 21:0:1:0: [sdl] tag#2418 ASC=0x1c ASCQ=0x2 [248682.423425] sd 21:0:3:0: [sdn] tag#2390 Sense Key : 0x1 [current] [248682.423439] sd 21:0:3:0: [sdn] tag#2390 ASC=0x1c ASCQ=0x2 [248682.426274] sd 21:0:6:0: [sdq] tag#2395 Sense Key : 0x1 [current] [248682.426286] sd 21:0:6:0: [sdq] tag#2395 ASC=0x1c ASCQ=0x2 [248682.434388] sd 21:0:1:0: [sdl] tag#2399 Sense Key : 0x1 [current] [248682.434399] sd 21:0:1:0: [sdl] tag#2399 ASC=0x1c ASCQ=0x2 [248682.438521] sd 21:0:5:0: [sdp] tag#2402 Sense Key : 0x1 [current] [248682.438533] sd 21:0:5:0: [sdp] tag#2402 ASC=0x1c ASCQ=0x2 [248721.774477] sd 21:0:6:0: [sdq] tag#2423 Sense Key : 0x1 [current] [248721.774489] sd 21:0:6:0: [sdq] tag#2423 ASC=0x1c ASCQ=0x2 [248721.786443] sd 21:0:3:0: [sdn] tag#2385 Sense Key : 0x1 [current] [248721.786455] sd 21:0:3:0: [sdn] tag#2385 ASC=0x1c ASCQ=0x2 [248721.787370] sd 21:0:5:0: [sdp] tag#2436 Sense Key : 0x1 [current] [248721.787382] sd 21:0:5:0: [sdp] tag#2436 ASC=0x1c ASCQ=0x2 [248721.793309] sd 21:0:1:0: [sdl] tag#2391 Sense Key : 0x1 [current] [248721.793320] sd 21:0:1:0: [sdl] tag#2391 ASC=0x1c ASCQ=0x2 [248760.780654] sd 21:0:6:0: [sdq] tag#2379 Sense Key : 0x1 [current] [248760.780665] sd 21:0:6:0: [sdq] tag#2379 ASC=0x1c ASCQ=0x2 [248760.788329] sd 21:0:1:0: [sdl] tag#2394 Sense Key : 0x1 [current] [248760.788340] sd 21:0:1:0: [sdl] tag#2394 ASC=0x1c ASCQ=0x2 [248760.788345] sd 21:0:5:0: [sdp] tag#2479 Sense Key : 0x1 [current] [248760.788355] sd 21:0:5:0: [sdp] tag#2479 ASC=0x1c ASCQ=0x2 [248760.793627] sd 21:0:3:0: [sdn] tag#2482 Sense Key : 0x1 [current] [248760.793639] sd 21:0:3:0: [sdn] tag#2482 ASC=0x1c ASCQ=0x2 [248800.055562] sd 21:0:1:0: [sdl] tag#2432 Sense Key : 0x1 [current] [248800.055573] sd 21:0:1:0: [sdl] tag#2432 ASC=0x1c ASCQ=0x2 [248800.064021] sd 21:0:5:0: [sdp] tag#2461 Sense Key : 0x1 [current] [248800.064033] sd 21:0:5:0: [sdp] tag#2461 ASC=0x1c ASCQ=0x2 [248800.067141] sd 21:0:6:0: [sdq] tag#2464 Sense Key : 0x1 [current] [248800.067155] sd 21:0:6:0: [sdq] tag#2464 ASC=0x1c ASCQ=0x2 [248800.078555] sd 21:0:3:0: [sdn] tag#2403 Sense Key : 0x1 [current] [248800.078567] sd 21:0:3:0: [sdn] tag#2403 ASC=0x1c ASCQ=0x2 [248838.584640] sd 21:0:6:0: [sdq] tag#2473 Sense Key : 0x1 [current] [248838.584653] sd 21:0:6:0: [sdq] tag#2473 ASC=0x1c ASCQ=0x2 [248838.587778] sd 21:0:1:0: [sdl] tag#2384 Sense Key : 0x1 [current] [248838.587789] sd 21:0:1:0: [sdl] tag#2384 ASC=0x1c ASCQ=0x2 [248838.588746] sd 21:0:5:0: [sdp] tag#2483 Sense Key : 0x1 [current] [248838.588757] sd 21:0:5:0: [sdp] tag#2483 ASC=0x1c ASCQ=0x2 [248838.597151] sd 21:0:3:0: [sdn] tag#2434 Sense Key : 0x1 [current] [248838.597164] sd 21:0:3:0: [sdn] tag#2434 ASC=0x1c ASCQ=0x2 [248876.967514] sd 21:0:5:0: [sdp] tag#2381 Sense Key : 0x1 [current] [248876.967527] sd 21:0:5:0: [sdp] tag#2381 ASC=0x1c ASCQ=0x2 [248876.973675] sd 21:0:6:0: [sdq] tag#2488 Sense Key : 0x1 [current] [248876.973686] sd 21:0:6:0: [sdq] tag#2488 ASC=0x1c ASCQ=0x2 [248876.977160] sd 21:0:1:0: [sdl] tag#2491 Sense Key : 0x1 [current] [248876.977172] sd 21:0:1:0: [sdl] tag#2491 ASC=0x1c ASCQ=0x2 [248876.982006] sd 21:0:3:0: [sdn] tag#2432 Sense Key : 0x1 [current] [248876.982015] sd 21:0:3:0: [sdn] tag#2432 ASC=0x1c ASCQ=0x2 [248915.371980] sd 21:0:1:0: [sdl] tag#2446 Sense Key : 0x1 [current] [248915.371990] sd 21:0:1:0: [sdl] tag#2446 ASC=0x1c ASCQ=0x2 [248915.379325] sd 21:0:3:0: [sdn] tag#2449 Sense Key : 0x1 [current] [248915.379338] sd 21:0:3:0: [sdn] tag#2449 ASC=0x1c ASCQ=0x2 [248915.380540] sd 21:0:5:0: [sdp] tag#2392 Sense Key : 0x1 [current] [248915.380555] sd 21:0:5:0: [sdp] tag#2392 ASC=0x1c ASCQ=0x2 [248915.381144] sd 21:0:6:0: [sdq] tag#2395 Sense Key : 0x1 [current] [248915.381156] sd 21:0:6:0: [sdq] tag#2395 ASC=0x1c ASCQ=0x2 [248953.794205] sd 21:0:3:0: [sdn] tag#2417 Sense Key : 0x1 [current] [248953.794216] sd 21:0:3:0: [sdn] tag#2417 ASC=0x1c ASCQ=0x2 [248953.795317] sd 21:0:6:0: [sdq] tag#2420 Sense Key : 0x1 [current] [248953.795328] sd 21:0:6:0: [sdq] tag#2420 ASC=0x1c ASCQ=0x2 [248953.795899] sd 21:0:1:0: [sdl] tag#2424 Sense Key : 0x1 [current] [248953.795911] sd 21:0:1:0: [sdl] tag#2424 ASC=0x1c ASCQ=0x2 [248953.796039] sd 21:0:5:0: [sdp] tag#2465 Sense Key : 0x1 [current] [248953.796050] sd 21:0:5:0: [sdp] tag#2465 ASC=0x1c ASCQ=0x2 [248992.148799] sd 21:0:3:0: [sdn] tag#2455 Sense Key : 0x1 [current] [248992.148810] sd 21:0:3:0: [sdn] tag#2455 ASC=0x1c ASCQ=0x2 [248992.157354] sd 21:0:6:0: [sdq] tag#2459 Sense Key : 0x1 [current] [248992.157366] sd 21:0:6:0: [sdq] tag#2459 ASC=0x1c ASCQ=0x2 [248992.161263] sd 21:0:5:0: [sdp] tag#2394 Sense Key : 0x1 [current] [248992.161275] sd 21:0:5:0: [sdp] tag#2394 ASC=0x1c ASCQ=0x2 [248992.164245] sd 21:0:1:0: [sdl] tag#2397 Sense Key : 0x1 [current] [248992.164255] sd 21:0:1:0: [sdl] tag#2397 ASC=0x1c ASCQ=0x2 [249030.520045] sd 21:0:6:0: [sdq] tag#2395 Sense Key : 0x1 [current] [249030.520055] sd 21:0:6:0: [sdq] tag#2395 ASC=0x1c ASCQ=0x2 [249030.527536] sd 21:0:3:0: [sdn] tag#2481 Sense Key : 0x1 [current] [249030.527548] sd 21:0:3:0: [sdn] tag#2481 ASC=0x1c ASCQ=0x2 [249030.527662] sd 21:0:5:0: [sdp] tag#2480 Sense Key : 0x1 [current] [249030.527673] sd 21:0:5:0: [sdp] tag#2480 ASC=0x1c ASCQ=0x2 [249030.536884] sd 21:0:1:0: [sdl] tag#2484 Sense Key : 0x1 [current] [249030.536894] sd 21:0:1:0: [sdl] tag#2484 ASC=0x1c ASCQ=0x2 [249068.933101] sd 21:0:3:0: [sdn] tag#2419 Sense Key : 0x1 [current] [249068.933112] sd 21:0:3:0: [sdn] tag#2419 ASC=0x1c ASCQ=0x2 [249068.934243] sd 21:0:6:0: [sdq] tag#2424 Sense Key : 0x1 [current] [249068.934254] sd 21:0:6:0: [sdq] tag#2424 ASC=0x1c ASCQ=0x2 [249068.939124] sd 21:0:1:0: [sdl] tag#2374 Sense Key : 0x1 [current] [249068.939136] sd 21:0:1:0: [sdl] tag#2374 ASC=0x1c ASCQ=0x2 [249068.941128] sd 21:0:5:0: [sdp] tag#2377 Sense Key : 0x1 [current] [249068.941139] sd 21:0:5:0: [sdp] tag#2377 ASC=0x1c ASCQ=0x2 [249107.288503] sd 21:0:6:0: [sdq] tag#2414 Sense Key : 0x1 [current] [249107.288515] sd 21:0:6:0: [sdq] tag#2414 ASC=0x1c ASCQ=0x2 [249107.293134] sd 21:0:1:0: [sdl] tag#2426 Sense Key : 0x1 [current] [249107.293145] sd 21:0:1:0: [sdl] tag#2426 ASC=0x1c ASCQ=0x2 [249107.296237] sd 21:0:3:0: [sdn] tag#2431 Sense Key : 0x1 [current] [249107.296248] sd 21:0:3:0: [sdn] tag#2431 ASC=0x1c ASCQ=0x2 [249107.302933] sd 21:0:5:0: [sdp] tag#2370 Sense Key : 0x1 [current] [249107.302941] sd 21:0:5:0: [sdp] tag#2370 ASC=0x1c ASCQ=0x2 [249145.785352] sd 21:0:6:0: [sdq] tag#2379 Sense Key : 0x1 [current] [249145.785363] sd 21:0:6:0: [sdq] tag#2379 ASC=0x1c ASCQ=0x2 [249145.786995] sd 21:0:3:0: [sdn] tag#2383 Sense Key : 0x1 [current] [249145.787008] sd 21:0:3:0: [sdn] tag#2383 ASC=0x1c ASCQ=0x2 [249145.788805] sd 21:0:1:0: [sdl] tag#2390 Sense Key : 0x1 [current] [249145.788817] sd 21:0:1:0: [sdl] tag#2390 ASC=0x1c ASCQ=0x2 [249145.795983] sd 21:0:5:0: [sdp] tag#2397 Sense Key : 0x1 [current] [249145.795994] sd 21:0:5:0: [sdp] tag#2397 ASC=0x1c ASCQ=0x2 [249184.370938] sd 21:0:1:0: [sdl] tag#2403 Sense Key : 0x1 [current] [249184.370949] sd 21:0:1:0: [sdl] tag#2403 ASC=0x1c ASCQ=0x2 [249184.380243] sd 21:0:3:0: [sdn] tag#2372 Sense Key : 0x1 [current] [249184.380257] sd 21:0:3:0: [sdn] tag#2372 ASC=0x1c ASCQ=0x2 [249184.380647] sd 21:0:6:0: [sdq] tag#2375 Sense Key : 0x1 [current] [249184.380662] sd 21:0:6:0: [sdq] tag#2375 ASC=0x1c ASCQ=0x2 [249184.385132] sd 21:0:5:0: [sdp] tag#2378 Sense Key : 0x1 [current] [249184.385143] sd 21:0:5:0: [sdp] tag#2378 ASC=0x1c ASCQ=0x2 [249222.706590] sd 21:0:3:0: [sdn] tag#2375 Sense Key : 0x1 [current] [249222.706601] sd 21:0:3:0: [sdn] tag#2375 ASC=0x1c ASCQ=0x2 [249222.711123] sd 21:0:5:0: [sdp] tag#2382 Sense Key : 0x1 [current] [249222.711134] sd 21:0:5:0: [sdp] tag#2382 ASC=0x1c ASCQ=0x2 [249222.715219] sd 21:0:6:0: [sdq] tag#2385 Sense Key : 0x1 [current] [249222.715230] sd 21:0:6:0: [sdq] tag#2385 ASC=0x1c ASCQ=0x2 [249222.715616] sd 21:0:1:0: [sdl] tag#2388 Sense Key : 0x1 [current] [249222.715625] sd 21:0:1:0: [sdl] tag#2388 ASC=0x1c ASCQ=0x2 [249261.142086] sd 21:0:3:0: [sdn] tag#2414 Sense Key : 0x1 [current] [249261.142099] sd 21:0:3:0: [sdn] tag#2414 ASC=0x1c ASCQ=0x2 [249261.143074] sd 21:0:1:0: [sdl] tag#2421 Sense Key : 0x1 [current] [249261.143085] sd 21:0:1:0: [sdl] tag#2421 ASC=0x1c ASCQ=0x2 [249261.144252] sd 21:0:5:0: [sdp] tag#2427 Sense Key : 0x1 [current] [249261.144263] sd 21:0:5:0: [sdp] tag#2427 ASC=0x1c ASCQ=0x2 [249261.151939] sd 21:0:6:0: [sdq] tag#2374 Sense Key : 0x1 [current] [249261.151951] sd 21:0:6:0: [sdq] tag#2374 ASC=0x1c ASCQ=0x2 [249299.517513] sd 21:0:3:0: [sdn] tag#2415 Sense Key : 0x1 [current] [249299.517524] sd 21:0:3:0: [sdn] tag#2415 ASC=0x1c ASCQ=0x2 [249299.521643] sd 21:0:5:0: [sdp] tag#2418 Sense Key : 0x1 [current] [249299.521653] sd 21:0:5:0: [sdp] tag#2418 ASC=0x1c ASCQ=0x2 [249299.522016] sd 21:0:1:0: [sdl] tag#2421 Sense Key : 0x1 [current] [249299.522027] sd 21:0:1:0: [sdl] tag#2421 ASC=0x1c ASCQ=0x2 [249299.525094] sd 21:0:6:0: [sdq] tag#2424 Sense Key : 0x1 [current] [249299.525104] sd 21:0:6:0: [sdq] tag#2424 ASC=0x1c ASCQ=0x2 [249337.828037] sd 21:0:3:0: [sdn] tag#2384 Sense Key : 0x1 [current] [249337.828048] sd 21:0:3:0: [sdn] tag#2384 ASC=0x1c ASCQ=0x2 [249337.833223] sd 21:0:6:0: [sdq] tag#2402 Sense Key : 0x1 [current] [249337.833234] sd 21:0:6:0: [sdq] tag#2402 ASC=0x1c ASCQ=0x2 [249337.833331] sd 21:0:1:0: [sdl] tag#2406 Sense Key : 0x1 [current] [249337.833342] sd 21:0:1:0: [sdl] tag#2406 ASC=0x1c ASCQ=0x2 [249337.836874] sd 21:0:5:0: [sdp] tag#2474 Sense Key : 0x1 [current] [249337.836888] sd 21:0:5:0: [sdp] tag#2474 ASC=0x1c ASCQ=0x2 [249376.280766] sd 21:0:3:0: [sdn] tag#2380 Sense Key : 0x1 [current] [249376.280780] sd 21:0:3:0: [sdn] tag#2380 ASC=0x1c ASCQ=0x2 [249376.282894] sd 21:0:6:0: [sdq] tag#2383 Sense Key : 0x1 [current] [249376.282908] sd 21:0:6:0: [sdq] tag#2383 ASC=0x1c ASCQ=0x2 [249376.288966] sd 21:0:1:0: [sdl] tag#2386 Sense Key : 0x1 [current] [249376.288978] sd 21:0:1:0: [sdl] tag#2386 ASC=0x1c ASCQ=0x2 [249376.290512] sd 21:0:5:0: [sdp] tag#2389 Sense Key : 0x1 [current] [249376.290524] sd 21:0:5:0: [sdp] tag#2389 ASC=0x1c ASCQ=0x2 [249414.654015] sd 21:0:3:0: [sdn] tag#2464 Sense Key : 0x1 [current] [249414.654030] sd 21:0:3:0: [sdn] tag#2464 ASC=0x1c ASCQ=0x2 [249414.655641] sd 21:0:6:0: [sdq] tag#2395 Sense Key : 0x1 [current] [249414.655652] sd 21:0:6:0: [sdq] tag#2395 ASC=0x1c ASCQ=0x2 [249414.656915] sd 21:0:1:0: [sdl] tag#2398 Sense Key : 0x1 [current] [249414.656927] sd 21:0:1:0: [sdl] tag#2398 ASC=0x1c ASCQ=0x2 [249414.659192] sd 21:0:5:0: [sdp] tag#2408 Sense Key : 0x1 [current] [249414.659204] sd 21:0:5:0: [sdp] tag#2408 ASC=0x1c ASCQ=0x2 [249453.065318] sd 21:0:6:0: [sdq] tag#2482 Sense Key : 0x1 [current] [249453.065329] sd 21:0:6:0: [sdq] tag#2482 ASC=0x1c ASCQ=0x2 [249453.072515] sd 21:0:3:0: [sdn] tag#2383 Sense Key : 0x1 [current] [249453.072525] sd 21:0:3:0: [sdn] tag#2383 ASC=0x1c ASCQ=0x2 [249453.075277] sd 21:0:1:0: [sdl] tag#2485 Sense Key : 0x1 [current] [249453.075289] sd 21:0:1:0: [sdl] tag#2485 ASC=0x1c ASCQ=0x2 [249453.078704] sd 21:0:5:0: [sdp] tag#2386 Sense Key : 0x1 [current] [249453.078713] sd 21:0:5:0: [sdp] tag#2386 ASC=0x1c ASCQ=0x2 [249491.489512] sd 21:0:6:0: [sdq] tag#2388 Sense Key : 0x1 [current] [249491.489522] sd 21:0:6:0: [sdq] tag#2388 ASC=0x1c ASCQ=0x2 [249491.497318] sd 21:0:1:0: [sdl] tag#2401 Sense Key : 0x1 [current] [249491.497328] sd 21:0:1:0: [sdl] tag#2401 ASC=0x1c ASCQ=0x2 [249491.498826] sd 21:0:5:0: [sdp] tag#2404 Sense Key : 0x1 [current] [249491.498838] sd 21:0:5:0: [sdp] tag#2404 ASC=0x1c ASCQ=0x2 [249491.501140] sd 21:0:3:0: [sdn] tag#2407 Sense Key : 0x1 [current] [249491.501152] sd 21:0:3:0: [sdn] tag#2407 ASC=0x1c ASCQ=0x2 [249529.875932] sd 21:0:1:0: [sdl] tag#2458 Sense Key : 0x1 [current] [249529.875943] sd 21:0:1:0: [sdl] tag#2458 ASC=0x1c ASCQ=0x2 [249529.883500] sd 21:0:3:0: [sdn] tag#2379 Sense Key : 0x1 [current] [249529.883511] sd 21:0:3:0: [sdn] tag#2379 ASC=0x1c ASCQ=0x2 [249529.887734] sd 21:0:5:0: [sdp] tag#2482 Sense Key : 0x1 [current] [249529.887744] sd 21:0:5:0: [sdp] tag#2482 ASC=0x1c ASCQ=0x2 [249529.890864] sd 21:0:6:0: [sdq] tag#2485 Sense Key : 0x1 [current] [249529.890875] sd 21:0:6:0: [sdq] tag#2485 ASC=0x1c ASCQ=0x2 [249568.652704] sd 21:0:6:0: [sdq] tag#2434 Sense Key : 0x1 [current] [249568.652714] sd 21:0:6:0: [sdq] tag#2434 ASC=0x1c ASCQ=0x2 [249568.662962] sd 21:0:3:0: [sdn] tag#2438 Sense Key : 0x1 [current] [249568.662973] sd 21:0:3:0: [sdn] tag#2438 ASC=0x1c ASCQ=0x2 [249568.666710] sd 21:0:1:0: [sdl] tag#2415 Sense Key : 0x1 [current] [249568.666721] sd 21:0:1:0: [sdl] tag#2415 ASC=0x1c ASCQ=0x2 [249568.672205] sd 21:0:5:0: [sdp] tag#2420 Sense Key : 0x1 [current] [249568.672215] sd 21:0:5:0: [sdp] tag#2420 ASC=0x1c ASCQ=0x2 [249607.934592] sd 21:0:6:0: [sdq] tag#2423 Sense Key : 0x1 [current] [249607.934605] sd 21:0:6:0: [sdq] tag#2423 ASC=0x1c ASCQ=0x2 [249607.937438] sd 21:0:1:0: [sdl] tag#2388 Sense Key : 0x1 [current] [249607.937449] sd 21:0:1:0: [sdl] tag#2388 ASC=0x1c ASCQ=0x2 [249607.944875] sd 21:0:3:0: [sdn] tag#2378 Sense Key : 0x1 [current] [249607.944887] sd 21:0:3:0: [sdn] tag#2378 ASC=0x1c ASCQ=0x2 [249607.947231] sd 21:0:5:0: [sdp] tag#2385 Sense Key : 0x1 [current] [249607.947242] sd 21:0:5:0: [sdp] tag#2385 ASC=0x1c ASCQ=0x2 [249646.269317] sd 21:0:1:0: [sdl] tag#2382 Sense Key : 0x1 [current] [249646.269330] sd 21:0:1:0: [sdl] tag#2382 ASC=0x1c ASCQ=0x2 [249646.270550] sd 21:0:5:0: [sdp] tag#2388 Sense Key : 0x1 [current] [249646.270561] sd 21:0:5:0: [sdp] tag#2388 ASC=0x1c ASCQ=0x2 [249646.272644] sd 21:0:6:0: [sdq] tag#2399 Sense Key : 0x1 [current] [249646.272655] sd 21:0:6:0: [sdq] tag#2399 ASC=0x1c ASCQ=0x2 [249646.277496] sd 21:0:3:0: [sdn] tag#2403 Sense Key : 0x1 [current] [249646.277508] sd 21:0:3:0: [sdn] tag#2403 ASC=0x1c ASCQ=0x2 [249684.744933] sd 21:0:5:0: [sdp] tag#2427 Sense Key : 0x1 [current] [249684.744946] sd 21:0:5:0: [sdp] tag#2427 ASC=0x1c ASCQ=0x2 [249684.744987] sd 21:0:6:0: [sdq] tag#2428 Sense Key : 0x1 [current] [249684.745000] sd 21:0:6:0: [sdq] tag#2428 ASC=0x1c ASCQ=0x2 [249684.746136] sd 21:0:1:0: [sdl] tag#2432 Sense Key : 0x1 [current] [249684.746146] sd 21:0:1:0: [sdl] tag#2432 ASC=0x1c ASCQ=0x2 [249684.752295] sd 21:0:3:0: [sdn] tag#2431 Sense Key : 0x1 [current] [249684.752306] sd 21:0:3:0: [sdn] tag#2431 ASC=0x1c ASCQ=0x2 [249723.243761] sd 21:0:5:0: [sdp] tag#2375 Sense Key : 0x1 [current] [249723.243775] sd 21:0:5:0: [sdp] tag#2375 ASC=0x1c ASCQ=0x2 [249723.249736] sd 21:0:1:0: [sdl] tag#2383 Sense Key : 0x1 [current] [249723.249748] sd 21:0:1:0: [sdl] tag#2383 ASC=0x1c ASCQ=0x2 [249723.256562] sd 21:0:3:0: [sdn] tag#2386 Sense Key : 0x1 [current] [249723.256571] sd 21:0:3:0: [sdn] tag#2386 ASC=0x1c ASCQ=0x2 [249723.258674] sd 21:0:6:0: [sdq] tag#2478 Sense Key : 0x1 [current] [249723.258686] sd 21:0:6:0: [sdq] tag#2478 ASC=0x1c ASCQ=0x2 [249761.544012] sd 21:0:3:0: [sdn] tag#2425 Sense Key : 0x1 [current] [249761.544023] sd 21:0:3:0: [sdn] tag#2425 ASC=0x1c ASCQ=0x2 [249761.555977] sd 21:0:1:0: [sdl] tag#2399 Sense Key : 0x1 [current] [249761.555989] sd 21:0:1:0: [sdl] tag#2399 ASC=0x1c ASCQ=0x2 [249761.561926] sd 21:0:6:0: [sdq] tag#2460 Sense Key : 0x1 [current] [249761.561937] sd 21:0:6:0: [sdq] tag#2460 ASC=0x1c ASCQ=0x2 [249761.562929] sd 21:0:5:0: [sdp] tag#2402 Sense Key : 0x1 [current] [249761.562941] sd 21:0:5:0: [sdp] tag#2402 ASC=0x1c ASCQ=0x2 [249799.978084] sd 21:0:6:0: [sdq] tag#2443 Sense Key : 0x1 [current] [249799.978095] sd 21:0:6:0: [sdq] tag#2443 ASC=0x1c ASCQ=0x2 [249799.985261] sd 21:0:1:0: [sdl] tag#2449 Sense Key : 0x1 [current] [249799.985273] sd 21:0:1:0: [sdl] tag#2449 ASC=0x1c ASCQ=0x2 [249799.986097] sd 21:0:5:0: [sdp] tag#2452 Sense Key : 0x1 [current] [249799.986109] sd 21:0:5:0: [sdp] tag#2452 ASC=0x1c ASCQ=0x2 [249799.989505] sd 21:0:3:0: [sdn] tag#2417 Sense Key : 0x1 [current] [249799.989517] sd 21:0:3:0: [sdn] tag#2417 ASC=0x1c ASCQ=0x2 [249838.371094] sd 21:0:3:0: [sdn] tag#2414 Sense Key : 0x1 [current] [249838.371107] sd 21:0:3:0: [sdn] tag#2414 ASC=0x1c ASCQ=0x2 [249838.372674] sd 21:0:6:0: [sdq] tag#2466 Sense Key : 0x1 [current] [249838.372685] sd 21:0:6:0: [sdq] tag#2466 ASC=0x1c ASCQ=0x2 [249838.378145] sd 21:0:1:0: [sdl] tag#2418 Sense Key : 0x1 [current] [249838.378157] sd 21:0:1:0: [sdl] tag#2418 ASC=0x1c ASCQ=0x2 [249838.382936] sd 21:0:5:0: [sdp] tag#2421 Sense Key : 0x1 [current] [249838.382946] sd 21:0:5:0: [sdp] tag#2421 ASC=0x1c ASCQ=0x2 [249876.835646] sd 21:0:5:0: [sdp] tag#2491 Sense Key : 0x1 [current] [249876.835658] sd 21:0:5:0: [sdp] tag#2491 ASC=0x1c ASCQ=0x2 [249876.838958] sd 21:0:6:0: [sdq] tag#2390 Sense Key : 0x1 [current] [249876.838969] sd 21:0:6:0: [sdq] tag#2390 ASC=0x1c ASCQ=0x2 [249876.843325] sd 21:0:1:0: [sdl] tag#2495 Sense Key : 0x1 [current] [249876.843336] sd 21:0:1:0: [sdl] tag#2495 ASC=0x1c ASCQ=0x2 [249876.844403] sd 21:0:3:0: [sdn] tag#2393 Sense Key : 0x1 [current] [249876.844410] sd 21:0:3:0: [sdn] tag#2393 ASC=0x1c ASCQ=0x2 [249915.280482] sd 21:0:6:0: [sdq] tag#2411 Sense Key : 0x1 [current] [249915.280495] sd 21:0:6:0: [sdq] tag#2411 ASC=0x1c ASCQ=0x2 [249915.281558] sd 21:0:3:0: [sdn] tag#2419 Sense Key : 0x1 [current] [249915.281570] sd 21:0:3:0: [sdn] tag#2419 ASC=0x1c ASCQ=0x2 [249915.282414] sd 21:0:1:0: [sdl] tag#2428 Sense Key : 0x1 [current] [249915.282426] sd 21:0:1:0: [sdl] tag#2428 ASC=0x1c ASCQ=0x2 [249915.290152] sd 21:0:5:0: [sdp] tag#2386 Sense Key : 0x1 [current] [249915.290164] sd 21:0:5:0: [sdp] tag#2386 ASC=0x1c ASCQ=0x2 [249953.618700] sd 21:0:1:0: [sdl] tag#2556 Sense Key : 0x1 [current] [249953.618711] sd 21:0:1:0: [sdl] tag#2556 ASC=0x1c ASCQ=0x2 [249953.628190] sd 21:0:6:0: [sdq] tag#2494 Sense Key : 0x1 [current] [249953.628200] sd 21:0:6:0: [sdq] tag#2494 ASC=0x1c ASCQ=0x2 [249953.630673] sd 21:0:3:0: [sdn] tag#2434 Sense Key : 0x1 [current] [249953.630684] sd 21:0:3:0: [sdn] tag#2434 ASC=0x1c ASCQ=0x2 [249953.637412] sd 21:0:5:0: [sdp] tag#2437 Sense Key : 0x1 [current] [249953.637420] sd 21:0:5:0: [sdp] tag#2437 ASC=0x1c ASCQ=0x2 [249992.092367] sd 21:0:1:0: [sdl] tag#2444 Sense Key : 0x1 [current] [249992.092378] sd 21:0:1:0: [sdl] tag#2444 ASC=0x1c ASCQ=0x2 [249992.093206] sd 21:0:5:0: [sdp] tag#2449 Sense Key : 0x1 [current] [249992.093217] sd 21:0:5:0: [sdp] tag#2449 ASC=0x1c ASCQ=0x2 [249992.094419] sd 21:0:6:0: [sdq] tag#2456 Sense Key : 0x1 [current] [249992.094430] sd 21:0:6:0: [sdq] tag#2456 ASC=0x1c ASCQ=0x2 [249992.094461] sd 21:0:3:0: [sdn] tag#2463 Sense Key : 0x1 [current] [249992.094472] sd 21:0:3:0: [sdn] tag#2463 ASC=0x1c ASCQ=0x2 I'm not sure if it could be realted but I thought it was worth mentioning.

I'm aware of the bug your referencing. I believe the bug in the firmware was corrected already as these drives are past the 32k hours and while they are slower then expected, they still work. From what I can gather, the bug causes the drives to brick and you can't recover them.

I’m working on this. I need to coordinate for someone to physically move the drives.

/dev/sdo is a PM1633 while /dev/sdm and /dev/sdm are PM1643a. Although they look identical, the sticker indicate a different model. Pictures of drives: https://immich.homeserver.co/share/-AJcKk4boamv9W45SaQYUxNP9dngMrZwtRrTRqe1_nk9VQ_8Ui1cQRwkLlpmh6inY8s https://immich.homeserver.co/share/_AR5gyqPa2WFCi97Q87nJryO_4COCSdFGBGYp9vRxfk7B0I4d1PgMRDumb-htzQqdE0

Yes it is.

sdparm -i gives even more information for the same drives. root@Tower:~# sdparm -i /dev/sdk /dev/sdr /dev/sdu /dev/sdt /dev/sdv /dev/sds /dev/sdg /dev/sdm /dev/sdo /dev/sdk: SAMSUNG P1633N38 EMC3840 EQP6 Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538a06849530 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a06849532 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a06849531 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538A06849531 /dev/sdr: NETAPP X356_S16333T8ATE NA04 Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538a0692d900 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a0692d901 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a0692d903 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538A0692D903 /dev/sdu: SAMSUNG P1633N38 EMC3840 EQP6 Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538a0697fa00 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a0697fa02 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a0697fa01 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538A0697FA01 /dev/sdt: SAMSUNG P1633N38 EMC3840 EQP6 Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538a16c1a480 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a16c1a482 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a16c1a481 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538A16C1A481 /dev/sdv: SAMSUNG P1633N38 EMC3840 EQPC Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538a76291d90 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a76291d92 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a76291d91 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538A76291D91 /dev/sds: SAMSUNG P1633N38 EMC3840 EQPC Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538a762993a0 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a762993a2 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a762993a1 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538A762993A1 /dev/sdg: NETAPP X356_S164A3T8ATE NA03 Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538b0112d420 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538b0112d421 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538b0112d423 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538B0112D423 /dev/sdm: NETAPP X356_S164A3T8ATE NA03 Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538b003824a0 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538b003824a1 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538b003824a3 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538B003824A3 /dev/sdo: NETAPP X356_S16333T8ATE NA04 Device identification VPD page: Addressed logical unit: designator type: NAA, code set: Binary 0x5002538a0692de00 Target port: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a0692de01 designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5002538a0692de03 designator type: SCSI name string, code set: UTF-8 SCSI name string: naa.5002538A0692DE03

root@Tower:~# sdparm -g WCE /dev/sdk /dev/sdr /dev/sdu /dev/sdt /dev/sdv /dev/sds /dev/sdg /dev/sdm /dev/sdo /dev/sdk: SAMSUNG P1633N38 EMC3840 EQP6 WCE 1 [cha: y, def: 1, sav: 1] /dev/sdr: NETAPP X356_S16333T8ATE NA04 WCE 1 [cha: y, def: 0, sav: 1] /dev/sdu: SAMSUNG P1633N38 EMC3840 EQP6 WCE 1 [cha: y, def: 1, sav: 1] /dev/sdt: SAMSUNG P1633N38 EMC3840 EQP6 WCE 1 [cha: y, def: 1, sav: 1] /dev/sdv: SAMSUNG P1633N38 EMC3840 EQPC WCE 1 [cha: y, def: 0, sav: 1] /dev/sds: SAMSUNG P1633N38 EMC3840 EQPC WCE 1 [cha: y, def: 0, sav: 1] /dev/sdg: NETAPP X356_S164A3T8ATE NA03 WCE 1 [cha: y, def: 0, sav: 1] /dev/sdm: NETAPP X356_S164A3T8ATE NA03 WCE 1 [cha: y, def: 0, sav: 1] /dev/sdo: NETAPP X356_S16333T8ATE NA04 WCE 1 [cha: y, def: 0, sav: 1] This is the results of sdparm WCE current configuration. To me, this information doesn't give any clues as to the issue. As far as I can tell, no, they don't have the same firmware. sdg and sdm have "NA03" firmware which are the two drives that are faster then the rest. These two drives also have a different model number, PM1643a The other drives have various firmwares but are are all PM1633 model numbers.

According to system devices, the two faster drives are on separate HBA’s. Since I did the testing on different FS’s, the drives labels changed. Maybe I can look into sg_utils to see if I can find out a driver or if the drives have any issues.

I did a few tests, but all had the same results.

I have never delt with anything like this but since a windows VM's disk performance is better then natively in Unraid, for whatever reason it does't just work. I greatly appreciate you taking the time to reply. I am working to figure out how to identify what driver these drives need but it will surely take me a while. I am in the process right now of testing this. I just need to pull all the data off this pool so I can test different FS performance.

I can't remember if I tested this but I will do so. It may take a bit since the I'm remotely administering the server for several months.

I made this post under the presumption that the current driver Unraid uses doesn't support these drives. After Unraid 7 was released and they still don't seem to be supported, and reading this post: I thought it could be possible to add the support for these drives with adding a kernel extension or custom kernel build. If this isn't making sense to anyone, it's probably because I'm not all familiar with doing this. I'm trying my best to explain BLUF is I have these drives in my server that are not performing as expected based on the testing outlined in the linked thread in the OP. After consulting LimeTech, they said it was most likely a driver issue and could be possibly fixed in future version of Unraid with newer kernels.

While I don't have the experience/knowledge to answer definitively, I suspect that it's not an HBA issue. Reason being, if the disks are passed through to a windows VM, they perform a lot faster than natively in Unraid. I performed this test and posted the results in the linked thread in OP with some CrystalDiskMark benchmarks. I already attempted to update the firmware in this post https://forums.servethehome.com/index.php?threads/pm-1633-mzils3t8hcjm-3-8tb-firmware-update.45169/ with no luck. I tried to also update the HBA but was unable to understand the StorCLI well enough. Fearing any issues, I stopped.

A while ago, I started a thread for some slow performance with some SSD's. I contacted LimeTech and came to the conclusion of it being a kernel compatibility issue. Link to thread: If this is the case, I wanted to see if it was possible to a kernel extension via a plugin? I was reading a thread about @ich777 and another user saying it was a possibility. Since Unraid 7 didn't add support for these drives, I'm attempting to explore this option which I need some advice as to how to accomplish this? All the drives are Samsung 3.84TB datacenter SSD's with various firmwares. I will add that the drives with "NA03" firmware perform well and the rest, not so well. lsscsi -sig removed removed removed removed removed removed [19:0:3:0] disk NETAPP X356_S164A3T8ATE NA03 /dev/sdg 35002538b003824a0 /dev/sg6 3.84TB [19:0:4:0] disk NETAPP X356_S164A3T8ATE NA03 /dev/sdh 35002538b0112d420 /dev/sg7 3.84TB removed removed removed [21:0:0:0] disk SAMSUNG P1633N38 EMC3840 EQP6 /dev/sdl 35002538a06849530 /dev/sg11 3.84TB removed removed removed [21:0:4:0] disk NETAPP X356_S16333T8ATE NA04 /dev/sdp 35002538a0692de00 /dev/sg15 3.84TB removed [21:0:6:0] disk NETAPP X356_S16333T8ATE NA04 /dev/sdr 35002538a0692d900 /dev/sg17 3.84TB [21:0:7:0] disk SAMSUNG P1633N38 EMC3840 EQPC /dev/sds 35002538a762993a0 /dev/sg18 3.84TB [21:0:8:0] disk SAMSUNG P1633N38 EMC3840 EQP6 /dev/sdt 35002538a16c1a480 /dev/sg19 3.84TB [21:0:9:0] disk SAMSUNG P1633N38 EMC3840 EQP6 /dev/sdu 35002538a0697fa00 /dev/sg20 3.84TB [21:0:10:0] disk SAMSUNG P1633N38 EMC3840 EQPC /dev/sdv 35002538a76291d90 /dev/sg21 3.84TB

If I'm following along correctly, the 9400-16i is bottlenecking these drives right? If this is correct, what HBA would fix it?

They are 12Gb SAS SSD's

I feel embarrassed to ask this question but here it goes. If my 4 HDD backplane has one SFF-8643 connection and I connect it to a port of my 9400-16i HBA, does that mean each drive will get 1 PCIE lane for data to transfer? Asking for a friend....

I recently found out that Siverstone recently came out with a new backplane for several of their chassis' to add support for NVME storage devices. https://www.silverstonetek.com/en/product/info/server-nas/rac_bp_304n/ I thought I would share this in case others can benefit. They told me they should be available mid to late February 2025.

This fixed the issue. Thanks

timeout -k 1.5 3.0 intel_gpu_top -J -s 1000 [ { "period": { "duration": 364.096241, "unit": "ms" }, "frequency": { "requested": 0.000000, "actual": 0.000000, "unit": "MHz" }, "interrupts": { "count": 0.000000, "unit": "irq/s" }, "rc6": { "value": 100.000000, "unit": "%" }, "engines": { "Render/3D": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" }, "Blitter": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" }, "Video": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" }, "VideoEnhance": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" }, "Compute": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" } }, "clients": { } } { "period": { "duration": 1293.811501, "unit": "ms" }, "frequency": { "requested": 0.000000, "actual": 0.000000, "unit": "MHz" }, "interrupts": { "count": 0.000000, "unit": "irq/s" }, "rc6": { "value": 100.000000, "unit": "%" }, "engines": { "Render/3D": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" }, "Blitter": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" }, "Video": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" }, "VideoEnhance": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" }, "Compute": { "busy": 0.000000, "sema": 0.000000, "wait": 0.000000, "unit": "%" } }, "clients": { } }