A while ago, I started a thread for some slow performance with some SSD's. I contacted LimeTech and came to the conclusion of it being a kernel compatibility issue. Link to thread: 

If this is the case, I wanted to see if it was possible to a kernel extension via a plugin? I was reading a thread about @ich777 and another user saying it was a possibility. Since Unraid 7 didn't add support for these drives, I'm attempting to explore this option which I need some advice as to how to accomplish this? All the drives are Samsung 3.84TB datacenter SSD's with various firmwares. I will add that the drives with "NA03" firmware perform well and the rest, not so well. 

 

lsscsi -sig
removed
removed
removed

removed
removed
removed
[19:0:3:0]   disk    NETAPP   X356_S164A3T8ATE NA03  /dev/sdg   35002538b003824a0  /dev/sg6   3.84TB
[19:0:4:0]   disk    NETAPP   X356_S164A3T8ATE NA03  /dev/sdh   35002538b0112d420  /dev/sg7   3.84TB
removed
removed

removed

[21:0:0:0]   disk    SAMSUNG  P1633N38 EMC3840 EQP6  /dev/sdl   35002538a06849530  /dev/sg11  3.84TB
removed
removed
removed
[21:0:4:0]   disk    NETAPP   X356_S16333T8ATE NA04  /dev/sdp   35002538a0692de00  /dev/sg15  3.84TB
removed
[21:0:6:0]   disk    NETAPP   X356_S16333T8ATE NA04  /dev/sdr   35002538a0692d900  /dev/sg17  3.84TB
[21:0:7:0]   disk    SAMSUNG  P1633N38 EMC3840 EQPC  /dev/sds   35002538a762993a0  /dev/sg18  3.84TB
[21:0:8:0]   disk    SAMSUNG  P1633N38 EMC3840 EQP6  /dev/sdt   35002538a16c1a480  /dev/sg19  3.84TB
[21:0:9:0]   disk    SAMSUNG  P1633N38 EMC3840 EQP6  /dev/sdu   35002538a0697fa00  /dev/sg20  3.84TB
[21:0:10:0]  disk    SAMSUNG  P1633N38 EMC3840 EQPC  /dev/sdv   35002538a76291d90  /dev/sg21  3.84TB 

8 hours ago, peace-keeping-villa8590 said:

I wanted to see if it was possible to a kernel extension via a plugin?

I'm not too sure what you want to do exactly...?

Is there a dedicated driver out there for those drives?

I mean I'm here to help but usually there are no drivers for hard drives on Linux.

 

8 hours ago, peace-keeping-villa8590 said:

Samsung 3.84TB datacenter SSD's

I for example also use Enterprise grade SSDs for my main Cache Pool: Samsung PM983 M2 NVME 3,84TB drives and have no performance issues at all, granted that they are M2 drives.

 

Just a wild guess but could the HBA be the culprit that it doesn't play nicely with these drives in combination with Linux?

Have you yet tried to use a SATA to SAS adapter because most SAS drives should be able to run on SATA as well <- just throwing ideas around.

Have you yet tried another filesystem, maybe BTRFS <- for testing purposes?

8 hours ago, ich777 said:

Just a wild guess but could the HBA be the culprit that it doesn't play nicely with these drives in combination with Linux?

Have you yet tried to use a SATA to SAS adapter because most SAS drives should be able to run on SATA as well <- just throwing ideas around.

Have you yet tried another filesystem, maybe BTRFS <- for testing purposes?

While I don't have the experience/knowledge to answer definitively, I suspect that it's not an HBA issue. Reason being, if the disks are passed through to a windows VM, they perform a lot faster than natively in Unraid. I performed this test and posted the results in the linked thread in OP with some CrystalDiskMark benchmarks. I already attempted to update the firmware in this post https://forums.servethehome.com/index.php?threads/pm-1633-mzils3t8hcjm-3-8tb-firmware-update.45169/ with no luck. I tried to also update the HBA but was unable to understand the StorCLI well enough. Fearing any issues, I stopped. 

8 hours ago, ich777 said:

I'm not too sure what you want to do exactly...?

Is there a dedicated driver out there for those drives?

I mean I'm here to help but usually there are no drivers for hard drives on Linux.

I made this post under the presumption that the current driver Unraid uses doesn't support these drives. After Unraid 7 was released and they still don't seem to be supported, and reading this post: 

 I thought it could be possible to add the support for these drives with adding a kernel extension or custom kernel build. If this isn't making sense to anyone, it's probably because I'm not all familiar with doing this. I'm trying my best to explain 

 

BLUF is I have these drives in my server that are not performing as expected based on the testing outlined in the linked thread in the OP. After consulting LimeTech, they said it was most likely a driver issue and could be possibly fixed in future version of Unraid with newer kernels. 

9 hours ago, ich777 said:

Have you yet tried another filesystem, maybe BTRFS <- for testing purposes?

I can't remember if I tested this but I will do so. It may take a bit since the I'm remotely administering the server for several months. 

1 hour ago, peace-keeping-villa8590 said:

I made this post under the presumption that the current driver Unraid uses doesn't support these drives.

As said above, to my knowledge for SATA/SAS devices there are no custom drivers needed and they should just work OOB.

Unless you can tell me which driver should be compiled I can't help with that, sorry. Hard drives are usually natively supported by Linux itself.

 

I could see possible a firmware issue with the drives in combination with ZFS and the firmware on the drives.

 

Please also make sure to test another filesystem because on Windows you most certainly also used NTFS for testing your drives correct?

5 hours ago, ich777 said:

As said above, to my knowledge for SATA/SAS devices there are no custom drivers needed and they should just work OOB.

I have never delt with anything like this but since a windows VM's disk performance is better then natively in Unraid, for whatever reason it does't just work. I greatly appreciate you taking the time to reply. I am working to figure out how to identify what driver these drives need but it will surely take me a while.

 

5 hours ago, ich777 said:

I could see possible a firmware issue with the drives in combination with ZFS and the firmware on the drives.

 

Please also make sure to test another filesystem because on Windows you most certainly also used NTFS for testing your drives correct?

 I am in the process right now of testing this. I just need to pull all the data off this pool so I can test different FS performance. 

23 hours ago, ich777 said:

Please also make sure to test another filesystem because on Windows you most certainly also used NTFS for testing your drives correct?

I did a few tests, but all had the same results. 

This is very strange since one of the devices is performing much faster than the other ones, I assume that if you swap cables/ports, the issue follows the devices?

According to system devices, the two faster drives are on separate HBA’s. Since I did the testing on different FS’s, the drives labels changed. Maybe I can look into sg_utils to see if I can find out a driver or if the drives have any issues.

Do they all have the same firmware?

2 minutes ago, JorgeB said:

Do they all have the same firmware?

root@Tower:~# sdparm -g WCE /dev/sdk /dev/sdr /dev/sdu /dev/sdt /dev/sdv /dev/sds /dev/sdg /dev/sdm /dev/sdo
    /dev/sdk: SAMSUNG   P1633N38 EMC3840  EQP6
WCE           1  [cha: y, def:  1, sav:  1]
    /dev/sdr: NETAPP    X356_S16333T8ATE  NA04
WCE           1  [cha: y, def:  0, sav:  1]
    /dev/sdu: SAMSUNG   P1633N38 EMC3840  EQP6
WCE           1  [cha: y, def:  1, sav:  1]
    /dev/sdt: SAMSUNG   P1633N38 EMC3840  EQP6
WCE           1  [cha: y, def:  1, sav:  1]
    /dev/sdv: SAMSUNG   P1633N38 EMC3840  EQPC
WCE           1  [cha: y, def:  0, sav:  1]
    /dev/sds: SAMSUNG   P1633N38 EMC3840  EQPC
WCE           1  [cha: y, def:  0, sav:  1]
    /dev/sdg: NETAPP    X356_S164A3T8ATE  NA03
WCE           1  [cha: y, def:  0, sav:  1]
    /dev/sdm: NETAPP    X356_S164A3T8ATE  NA03
WCE           1  [cha: y, def:  0, sav:  1]
    /dev/sdo: NETAPP    X356_S16333T8ATE  NA04
WCE           1  [cha: y, def:  0, sav:  1]

 

This is the results of sdparm WCE current configuration. To me, this information doesn't give any clues as to the issue.  As far as I can tell, no, they don't have the same firmware. sdg and sdm have "NA03" firmware which are the two drives that are faster then the rest. These two drives also have a different model number, PM1643a The other drives have various firmwares but are are all PM1633 model numbers. 

8 minutes ago, peace-keeping-villa8590 said:

    /dev/sdo: NETAPP    X356_S16333T8ATE  NA04
WCE           1  [cha: y, def:  0, sav:  1]

And this one is also slow?

sdparm -i gives even more information for the same drives. 

 

root@Tower:~# sdparm -i /dev/sdk /dev/sdr /dev/sdu /dev/sdt /dev/sdv /dev/sds /dev/sdg /dev/sdm /dev/sdo
    /dev/sdk: SAMSUNG   P1633N38 EMC3840  EQP6
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538a06849530
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a06849532
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a06849531
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538A06849531

    /dev/sdr: NETAPP    X356_S16333T8ATE  NA04
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538a0692d900
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a0692d901
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a0692d903
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538A0692D903

    /dev/sdu: SAMSUNG   P1633N38 EMC3840  EQP6
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538a0697fa00
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a0697fa02
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a0697fa01
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538A0697FA01

    /dev/sdt: SAMSUNG   P1633N38 EMC3840  EQP6
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538a16c1a480
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a16c1a482
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a16c1a481
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538A16C1A481

    /dev/sdv: SAMSUNG   P1633N38 EMC3840  EQPC
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538a76291d90
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a76291d92
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a76291d91
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538A76291D91

    /dev/sds: SAMSUNG   P1633N38 EMC3840  EQPC
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538a762993a0
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a762993a2
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a762993a1
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538A762993A1

    /dev/sdg: NETAPP    X356_S164A3T8ATE  NA03
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538b0112d420
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538b0112d421
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538b0112d423
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538B0112D423

    /dev/sdm: NETAPP    X356_S164A3T8ATE  NA03
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538b003824a0
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538b003824a1
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538b003824a3
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538B003824A3

    /dev/sdo: NETAPP    X356_S16333T8ATE  NA04
Device identification VPD page:
  Addressed logical unit:
    designator type: NAA,  code set: Binary
      0x5002538a0692de00
  Target port:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a0692de01
    designator type: Relative target port,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      Relative target port: 0x1
  Target device that contains addressed lu:
    designator type: NAA,  code set: Binary
     transport: Serial Attached SCSI Protocol (SPL-4)
      0x5002538a0692de03
    designator type: SCSI name string,  code set: UTF-8
      SCSI name string:
      naa.5002538A0692DE03

6 minutes ago, JorgeB said:

And this one is also slow?

Yes it is. 

33 minutes ago, peace-keeping-villa8590 said:

    /dev/sdg: NETAPP    X356_S164A3T8ATE  NA03
WCE           1  [cha: y, def:  0, sav:  1]
    /dev/sdm: NETAPP    X356_S164A3T8ATE  NA03
WCE           1  [cha: y, def:  0, sav:  1]
    /dev/sdo: NETAPP    X356_S16333T8ATE  NA04
WCE           1  [cha: y, def:  0, sav:  1]

 

So these 3 are the same model, they will be using the same driver, the firmware could be the difference, this assuming that if you swap cables/ports between the two, the one with NA04 is always the slow one.

/dev/sdo is a PM1633 while /dev/sdm and /dev/sdm are PM1643a. Although they look identical, the sticker indicate a different model. 

Pictures of drives: 

https://immich.homeserver.co/share/-AJcKk4boamv9W45SaQYUxNP9dngMrZwtRrTRqe1_nk9VQ_8Ui1cQRwkLlpmh6inY8s

 

https://immich.homeserver.co/share/_AR5gyqPa2WFCi97Q87nJryO_4COCSdFGBGYp9vRxfk7B0I4d1PgMRDumb-htzQqdE0

 

 

Still the driver will be the same, if there's an issue with Linux, I would suspect it's firmware related, again, assuming that 

2 hours ago, JorgeB said:

if you swap cables/ports between the two, the one with NA04 is always the slow one.

 

15 hours ago, JorgeB said:

This is very strange since one of the devices is performing much faster than the other ones, I assume that if you swap cables/ports, the issue follows the devices?

I’m working on this. I need to coordinate for someone to physically move the drives.

FYI you should upgrade your firmware to at least NA04.
Lower revisions have a firmware bug that bricks them at a specific powered on age, poke around on servethehome forums for more info.

3 minutes ago, tjb_altf4 said:

FYI you should upgrade your firmware to at least NA04.
Lower revisions have a firmware bug that bricks them at a specific powered on age, poke around on servethehome forums for more info.

I'm aware of the bug your referencing. I believe the bug in the firmware was corrected already as these drives are past the 32k hours and while they are slower then expected, they still work. From what I can gather, the bug causes the drives to brick and you can't recover them. 

I'm still working on moving the drives to test backplanes/cables. 

 

On 1/26/2025 at 1:06 PM, ich777 said:

As said above, to my knowledge for SATA/SAS devices there are no custom drivers needed and they should just work OOB.

Unless you can tell me which driver should be compiled I can't help with that, sorry. Hard drives are usually natively supported by Linux itself.

I was trying to find what driver was being used if I passed one of the drives through an Ubuntu VM using dmesg. Unsurprisingly, it said virtio. 

 

user@ubuntu-desktop:~$ dmesg | grep  vda
[    4.261295] virtio_blk virtio2: [vda] 7501476528 512-byte logical blocks (3.84 TB/3.49 TiB)
[    4.274482]  vda: vda1 vda2
[    6.259732] EXT4-fs (vda2): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.
[    7.796338] EXT4-fs (vda2): re-mounted. Opts: errors=remount-ro. Quota mode: none. 

 

I doubt this is helpful but when I ran a similar command  in Unraid, I got this: (command "dmesg")

 

[248219.706259] sd 21:0:5:0: [sdp] tag#2403 ASC=0x1c ASCQ=0x2 
[248219.712616] sd 21:0:3:0: [sdn] tag#2419 Sense Key : 0x1 [current] 
[248219.712629] sd 21:0:3:0: [sdn] tag#2419 ASC=0x1c ASCQ=0x2 
[248219.720138] sd 21:0:6:0: [sdq] tag#2426 Sense Key : 0x1 [current] 
[248219.720149] sd 21:0:6:0: [sdq] tag#2426 ASC=0x1c ASCQ=0x2 
[248219.720630] sd 21:0:1:0: [sdl] tag#2430 Sense Key : 0x1 [current] 
[248219.720640] sd 21:0:1:0: [sdl] tag#2430 ASC=0x1c ASCQ=0x2 
[248258.167861] sd 21:0:3:0: [sdn] tag#2392 Sense Key : 0x1 [current] 
[248258.167872] sd 21:0:3:0: [sdn] tag#2392 ASC=0x1c ASCQ=0x2 
[248258.179608] sd 21:0:6:0: [sdq] tag#2369 Sense Key : 0x1 [current] 
[248258.179620] sd 21:0:6:0: [sdq] tag#2369 ASC=0x1c ASCQ=0x2 
[248258.179923] sd 21:0:1:0: [sdl] tag#2372 Sense Key : 0x1 [current] 
[248258.179934] sd 21:0:1:0: [sdl] tag#2372 ASC=0x1c ASCQ=0x2 
[248258.186416] sd 21:0:5:0: [sdp] tag#2375 Sense Key : 0x1 [current] 
[248258.186427] sd 21:0:5:0: [sdp] tag#2375 ASC=0x1c ASCQ=0x2 
[248296.567609] sd 21:0:6:0: [sdq] tag#2410 Sense Key : 0x1 [current] 
[248296.567622] sd 21:0:6:0: [sdq] tag#2410 ASC=0x1c ASCQ=0x2 
[248296.570863] sd 21:0:3:0: [sdn] tag#2418 Sense Key : 0x1 [current] 
[248296.570877] sd 21:0:3:0: [sdn] tag#2418 ASC=0x1c ASCQ=0x2 
[248296.575627] sd 21:0:5:0: [sdp] tag#2422 Sense Key : 0x1 [current] 
[248296.575641] sd 21:0:5:0: [sdp] tag#2422 ASC=0x1c ASCQ=0x2 
[248296.584953] sd 21:0:1:0: [sdl] tag#2427 Sense Key : 0x1 [current] 
[248296.584965] sd 21:0:1:0: [sdl] tag#2427 ASC=0x1c ASCQ=0x2 
[248334.937341] sd 21:0:3:0: [sdn] tag#2373 Sense Key : 0x1 [current] 
[248334.937352] sd 21:0:3:0: [sdn] tag#2373 ASC=0x1c ASCQ=0x2 
[248334.946946] sd 21:0:6:0: [sdq] tag#2414 Sense Key : 0x1 [current] 
[248334.946957] sd 21:0:6:0: [sdq] tag#2414 ASC=0x1c ASCQ=0x2 
[248334.958650] sd 21:0:1:0: [sdl] tag#2424 Sense Key : 0x1 [current] 
[248334.958661] sd 21:0:1:0: [sdl] tag#2424 ASC=0x1c ASCQ=0x2 
[248334.959567] sd 21:0:5:0: [sdp] tag#2429 Sense Key : 0x1 [current] 
[248334.959581] sd 21:0:5:0: [sdp] tag#2429 ASC=0x1c ASCQ=0x2 
[248373.442500] sd 21:0:1:0: [sdl] tag#2406 Sense Key : 0x1 [current] 
[248373.442511] sd 21:0:1:0: [sdl] tag#2406 ASC=0x1c ASCQ=0x2 
[248373.442824] sd 21:0:3:0: [sdn] tag#2412 Sense Key : 0x1 [current] 
[248373.442838] sd 21:0:3:0: [sdn] tag#2412 ASC=0x1c ASCQ=0x2 
[248373.454508] sd 21:0:6:0: [sdq] tag#2426 Sense Key : 0x1 [current] 
[248373.454520] sd 21:0:6:0: [sdq] tag#2426 ASC=0x1c ASCQ=0x2 
[248373.462298] sd 21:0:5:0: [sdp] tag#2368 Sense Key : 0x1 [current] 
[248373.462310] sd 21:0:5:0: [sdp] tag#2368 ASC=0x1c ASCQ=0x2 
[248412.138995] sd 21:0:3:0: [sdn] tag#2480 Sense Key : 0x1 [current] 
[248412.139009] sd 21:0:3:0: [sdn] tag#2480 ASC=0x1c ASCQ=0x2 
[248412.140368] sd 21:0:1:0: [sdl] tag#2373 Sense Key : 0x1 [current] 
[248412.140379] sd 21:0:1:0: [sdl] tag#2373 ASC=0x1c ASCQ=0x2 
[248412.142965] sd 21:0:6:0: [sdq] tag#2376 Sense Key : 0x1 [current] 
[248412.142975] sd 21:0:6:0: [sdq] tag#2376 ASC=0x1c ASCQ=0x2 
[248412.147805] sd 21:0:5:0: [sdp] tag#2382 Sense Key : 0x1 [current] 
[248412.147814] sd 21:0:5:0: [sdp] tag#2382 ASC=0x1c ASCQ=0x2 
[248450.422994] sd 21:0:3:0: [sdn] tag#2406 Sense Key : 0x1 [current] 
[248450.423005] sd 21:0:3:0: [sdn] tag#2406 ASC=0x1c ASCQ=0x2 
[248450.423741] sd 21:0:6:0: [sdq] tag#2416 Sense Key : 0x1 [current] 
[248450.423752] sd 21:0:6:0: [sdq] tag#2416 ASC=0x1c ASCQ=0x2 
[248450.427170] sd 21:0:1:0: [sdl] tag#2395 Sense Key : 0x1 [current] 
[248450.427181] sd 21:0:1:0: [sdl] tag#2395 ASC=0x1c ASCQ=0x2 
[248450.438265] sd 21:0:5:0: [sdp] tag#2407 Sense Key : 0x1 [current] 
[248450.438276] sd 21:0:5:0: [sdp] tag#2407 ASC=0x1c ASCQ=0x2 
[248488.893587] sd 21:0:5:0: [sdp] tag#2373 Sense Key : 0x1 [current] 
[248488.893598] sd 21:0:5:0: [sdp] tag#2373 ASC=0x1c ASCQ=0x2 
[248488.893782] sd 21:0:1:0: [sdl] tag#2376 Sense Key : 0x1 [current] 
[248488.893794] sd 21:0:1:0: [sdl] tag#2376 ASC=0x1c ASCQ=0x2 
[248488.898964] sd 21:0:3:0: [sdn] tag#2385 Sense Key : 0x1 [current] 
[248488.898976] sd 21:0:3:0: [sdn] tag#2385 ASC=0x1c ASCQ=0x2 
[248488.907327] sd 21:0:6:0: [sdq] tag#2393 Sense Key : 0x1 [current] 
[248488.907338] sd 21:0:6:0: [sdq] tag#2393 ASC=0x1c ASCQ=0x2 
[248527.460434] sd 21:0:1:0: [sdl] tag#2393 Sense Key : 0x1 [current] 
[248527.460447] sd 21:0:1:0: [sdl] tag#2393 ASC=0x1c ASCQ=0x2 
[248527.461847] sd 21:0:5:0: [sdp] tag#2402 Sense Key : 0x1 [current] 
[248527.461861] sd 21:0:5:0: [sdp] tag#2402 ASC=0x1c ASCQ=0x2 
[248527.466022] sd 21:0:3:0: [sdn] tag#2415 Sense Key : 0x1 [current] 
[248527.466033] sd 21:0:3:0: [sdn] tag#2415 ASC=0x1c ASCQ=0x2 
[248527.477625] sd 21:0:6:0: [sdq] tag#2425 Sense Key : 0x1 [current] 
[248527.477637] sd 21:0:6:0: [sdq] tag#2425 ASC=0x1c ASCQ=0x2 
[248565.808494] sd 21:0:3:0: [sdn] tag#2408 Sense Key : 0x1 [current] 
[248565.808505] sd 21:0:3:0: [sdn] tag#2408 ASC=0x1c ASCQ=0x2 
[248565.809041] sd 21:0:1:0: [sdl] tag#2414 Sense Key : 0x1 [current] 
[248565.809052] sd 21:0:1:0: [sdl] tag#2414 ASC=0x1c ASCQ=0x2 
[248565.812678] sd 21:0:6:0: [sdq] tag#2422 Sense Key : 0x1 [current] 
[248565.812689] sd 21:0:6:0: [sdq] tag#2422 ASC=0x1c ASCQ=0x2 
[248565.813991] sd 21:0:5:0: [sdp] tag#2427 Sense Key : 0x1 [current] 
[248565.814003] sd 21:0:5:0: [sdp] tag#2427 ASC=0x1c ASCQ=0x2 
[248604.668351] sd 21:0:6:0: [sdq] tag#2401 Sense Key : 0x1 [current] 
[248604.668362] sd 21:0:6:0: [sdq] tag#2401 ASC=0x1c ASCQ=0x2 
[248604.673686] sd 21:0:3:0: [sdn] tag#2462 Sense Key : 0x1 [current] 
[248604.673696] sd 21:0:3:0: [sdn] tag#2462 ASC=0x1c ASCQ=0x2 
[248604.675502] sd 21:0:5:0: [sdp] tag#2408 Sense Key : 0x1 [current] 
[248604.675512] sd 21:0:5:0: [sdp] tag#2408 ASC=0x1c ASCQ=0x2 
[248604.677797] sd 21:0:1:0: [sdl] tag#2411 Sense Key : 0x1 [current] 
[248604.677808] sd 21:0:1:0: [sdl] tag#2411 ASC=0x1c ASCQ=0x2 
[248643.932036] sd 21:0:6:0: [sdq] tag#2405 Sense Key : 0x1 [current] 
[248643.932047] sd 21:0:6:0: [sdq] tag#2405 ASC=0x1c ASCQ=0x2 
[248643.937087] sd 21:0:3:0: [sdn] tag#2409 Sense Key : 0x1 [current] 
[248643.937097] sd 21:0:3:0: [sdn] tag#2409 ASC=0x1c ASCQ=0x2 
[248643.940116] sd 21:0:5:0: [sdp] tag#2413 Sense Key : 0x1 [current] 
[248643.940128] sd 21:0:5:0: [sdp] tag#2413 ASC=0x1c ASCQ=0x2 
[248643.942183] sd 21:0:1:0: [sdl] tag#2418 Sense Key : 0x1 [current] 
[248643.942197] sd 21:0:1:0: [sdl] tag#2418 ASC=0x1c ASCQ=0x2 
[248682.423425] sd 21:0:3:0: [sdn] tag#2390 Sense Key : 0x1 [current] 
[248682.423439] sd 21:0:3:0: [sdn] tag#2390 ASC=0x1c ASCQ=0x2 
[248682.426274] sd 21:0:6:0: [sdq] tag#2395 Sense Key : 0x1 [current] 
[248682.426286] sd 21:0:6:0: [sdq] tag#2395 ASC=0x1c ASCQ=0x2 
[248682.434388] sd 21:0:1:0: [sdl] tag#2399 Sense Key : 0x1 [current] 
[248682.434399] sd 21:0:1:0: [sdl] tag#2399 ASC=0x1c ASCQ=0x2 
[248682.438521] sd 21:0:5:0: [sdp] tag#2402 Sense Key : 0x1 [current] 
[248682.438533] sd 21:0:5:0: [sdp] tag#2402 ASC=0x1c ASCQ=0x2 
[248721.774477] sd 21:0:6:0: [sdq] tag#2423 Sense Key : 0x1 [current] 
[248721.774489] sd 21:0:6:0: [sdq] tag#2423 ASC=0x1c ASCQ=0x2 
[248721.786443] sd 21:0:3:0: [sdn] tag#2385 Sense Key : 0x1 [current] 
[248721.786455] sd 21:0:3:0: [sdn] tag#2385 ASC=0x1c ASCQ=0x2 
[248721.787370] sd 21:0:5:0: [sdp] tag#2436 Sense Key : 0x1 [current] 
[248721.787382] sd 21:0:5:0: [sdp] tag#2436 ASC=0x1c ASCQ=0x2 
[248721.793309] sd 21:0:1:0: [sdl] tag#2391 Sense Key : 0x1 [current] 
[248721.793320] sd 21:0:1:0: [sdl] tag#2391 ASC=0x1c ASCQ=0x2 
[248760.780654] sd 21:0:6:0: [sdq] tag#2379 Sense Key : 0x1 [current] 
[248760.780665] sd 21:0:6:0: [sdq] tag#2379 ASC=0x1c ASCQ=0x2 
[248760.788329] sd 21:0:1:0: [sdl] tag#2394 Sense Key : 0x1 [current] 
[248760.788340] sd 21:0:1:0: [sdl] tag#2394 ASC=0x1c ASCQ=0x2 
[248760.788345] sd 21:0:5:0: [sdp] tag#2479 Sense Key : 0x1 [current] 
[248760.788355] sd 21:0:5:0: [sdp] tag#2479 ASC=0x1c ASCQ=0x2 
[248760.793627] sd 21:0:3:0: [sdn] tag#2482 Sense Key : 0x1 [current] 
[248760.793639] sd 21:0:3:0: [sdn] tag#2482 ASC=0x1c ASCQ=0x2 
[248800.055562] sd 21:0:1:0: [sdl] tag#2432 Sense Key : 0x1 [current] 
[248800.055573] sd 21:0:1:0: [sdl] tag#2432 ASC=0x1c ASCQ=0x2 
[248800.064021] sd 21:0:5:0: [sdp] tag#2461 Sense Key : 0x1 [current] 
[248800.064033] sd 21:0:5:0: [sdp] tag#2461 ASC=0x1c ASCQ=0x2 
[248800.067141] sd 21:0:6:0: [sdq] tag#2464 Sense Key : 0x1 [current] 
[248800.067155] sd 21:0:6:0: [sdq] tag#2464 ASC=0x1c ASCQ=0x2 
[248800.078555] sd 21:0:3:0: [sdn] tag#2403 Sense Key : 0x1 [current] 
[248800.078567] sd 21:0:3:0: [sdn] tag#2403 ASC=0x1c ASCQ=0x2 
[248838.584640] sd 21:0:6:0: [sdq] tag#2473 Sense Key : 0x1 [current] 
[248838.584653] sd 21:0:6:0: [sdq] tag#2473 ASC=0x1c ASCQ=0x2 
[248838.587778] sd 21:0:1:0: [sdl] tag#2384 Sense Key : 0x1 [current] 
[248838.587789] sd 21:0:1:0: [sdl] tag#2384 ASC=0x1c ASCQ=0x2 
[248838.588746] sd 21:0:5:0: [sdp] tag#2483 Sense Key : 0x1 [current] 
[248838.588757] sd 21:0:5:0: [sdp] tag#2483 ASC=0x1c ASCQ=0x2 
[248838.597151] sd 21:0:3:0: [sdn] tag#2434 Sense Key : 0x1 [current] 
[248838.597164] sd 21:0:3:0: [sdn] tag#2434 ASC=0x1c ASCQ=0x2 
[248876.967514] sd 21:0:5:0: [sdp] tag#2381 Sense Key : 0x1 [current] 
[248876.967527] sd 21:0:5:0: [sdp] tag#2381 ASC=0x1c ASCQ=0x2 
[248876.973675] sd 21:0:6:0: [sdq] tag#2488 Sense Key : 0x1 [current] 
[248876.973686] sd 21:0:6:0: [sdq] tag#2488 ASC=0x1c ASCQ=0x2 
[248876.977160] sd 21:0:1:0: [sdl] tag#2491 Sense Key : 0x1 [current] 
[248876.977172] sd 21:0:1:0: [sdl] tag#2491 ASC=0x1c ASCQ=0x2 
[248876.982006] sd 21:0:3:0: [sdn] tag#2432 Sense Key : 0x1 [current] 
[248876.982015] sd 21:0:3:0: [sdn] tag#2432 ASC=0x1c ASCQ=0x2 
[248915.371980] sd 21:0:1:0: [sdl] tag#2446 Sense Key : 0x1 [current] 
[248915.371990] sd 21:0:1:0: [sdl] tag#2446 ASC=0x1c ASCQ=0x2 
[248915.379325] sd 21:0:3:0: [sdn] tag#2449 Sense Key : 0x1 [current] 
[248915.379338] sd 21:0:3:0: [sdn] tag#2449 ASC=0x1c ASCQ=0x2 
[248915.380540] sd 21:0:5:0: [sdp] tag#2392 Sense Key : 0x1 [current] 
[248915.380555] sd 21:0:5:0: [sdp] tag#2392 ASC=0x1c ASCQ=0x2 
[248915.381144] sd 21:0:6:0: [sdq] tag#2395 Sense Key : 0x1 [current] 
[248915.381156] sd 21:0:6:0: [sdq] tag#2395 ASC=0x1c ASCQ=0x2 
[248953.794205] sd 21:0:3:0: [sdn] tag#2417 Sense Key : 0x1 [current] 
[248953.794216] sd 21:0:3:0: [sdn] tag#2417 ASC=0x1c ASCQ=0x2 
[248953.795317] sd 21:0:6:0: [sdq] tag#2420 Sense Key : 0x1 [current] 
[248953.795328] sd 21:0:6:0: [sdq] tag#2420 ASC=0x1c ASCQ=0x2 
[248953.795899] sd 21:0:1:0: [sdl] tag#2424 Sense Key : 0x1 [current] 
[248953.795911] sd 21:0:1:0: [sdl] tag#2424 ASC=0x1c ASCQ=0x2 
[248953.796039] sd 21:0:5:0: [sdp] tag#2465 Sense Key : 0x1 [current] 
[248953.796050] sd 21:0:5:0: [sdp] tag#2465 ASC=0x1c ASCQ=0x2 
[248992.148799] sd 21:0:3:0: [sdn] tag#2455 Sense Key : 0x1 [current] 
[248992.148810] sd 21:0:3:0: [sdn] tag#2455 ASC=0x1c ASCQ=0x2 
[248992.157354] sd 21:0:6:0: [sdq] tag#2459 Sense Key : 0x1 [current] 
[248992.157366] sd 21:0:6:0: [sdq] tag#2459 ASC=0x1c ASCQ=0x2 
[248992.161263] sd 21:0:5:0: [sdp] tag#2394 Sense Key : 0x1 [current] 
[248992.161275] sd 21:0:5:0: [sdp] tag#2394 ASC=0x1c ASCQ=0x2 
[248992.164245] sd 21:0:1:0: [sdl] tag#2397 Sense Key : 0x1 [current] 
[248992.164255] sd 21:0:1:0: [sdl] tag#2397 ASC=0x1c ASCQ=0x2 
[249030.520045] sd 21:0:6:0: [sdq] tag#2395 Sense Key : 0x1 [current] 
[249030.520055] sd 21:0:6:0: [sdq] tag#2395 ASC=0x1c ASCQ=0x2 
[249030.527536] sd 21:0:3:0: [sdn] tag#2481 Sense Key : 0x1 [current] 
[249030.527548] sd 21:0:3:0: [sdn] tag#2481 ASC=0x1c ASCQ=0x2 
[249030.527662] sd 21:0:5:0: [sdp] tag#2480 Sense Key : 0x1 [current] 
[249030.527673] sd 21:0:5:0: [sdp] tag#2480 ASC=0x1c ASCQ=0x2 
[249030.536884] sd 21:0:1:0: [sdl] tag#2484 Sense Key : 0x1 [current] 
[249030.536894] sd 21:0:1:0: [sdl] tag#2484 ASC=0x1c ASCQ=0x2 
[249068.933101] sd 21:0:3:0: [sdn] tag#2419 Sense Key : 0x1 [current] 
[249068.933112] sd 21:0:3:0: [sdn] tag#2419 ASC=0x1c ASCQ=0x2 
[249068.934243] sd 21:0:6:0: [sdq] tag#2424 Sense Key : 0x1 [current] 
[249068.934254] sd 21:0:6:0: [sdq] tag#2424 ASC=0x1c ASCQ=0x2 
[249068.939124] sd 21:0:1:0: [sdl] tag#2374 Sense Key : 0x1 [current] 
[249068.939136] sd 21:0:1:0: [sdl] tag#2374 ASC=0x1c ASCQ=0x2 
[249068.941128] sd 21:0:5:0: [sdp] tag#2377 Sense Key : 0x1 [current] 
[249068.941139] sd 21:0:5:0: [sdp] tag#2377 ASC=0x1c ASCQ=0x2 
[249107.288503] sd 21:0:6:0: [sdq] tag#2414 Sense Key : 0x1 [current] 
[249107.288515] sd 21:0:6:0: [sdq] tag#2414 ASC=0x1c ASCQ=0x2 
[249107.293134] sd 21:0:1:0: [sdl] tag#2426 Sense Key : 0x1 [current] 
[249107.293145] sd 21:0:1:0: [sdl] tag#2426 ASC=0x1c ASCQ=0x2 
[249107.296237] sd 21:0:3:0: [sdn] tag#2431 Sense Key : 0x1 [current] 
[249107.296248] sd 21:0:3:0: [sdn] tag#2431 ASC=0x1c ASCQ=0x2 
[249107.302933] sd 21:0:5:0: [sdp] tag#2370 Sense Key : 0x1 [current] 
[249107.302941] sd 21:0:5:0: [sdp] tag#2370 ASC=0x1c ASCQ=0x2 
[249145.785352] sd 21:0:6:0: [sdq] tag#2379 Sense Key : 0x1 [current] 
[249145.785363] sd 21:0:6:0: [sdq] tag#2379 ASC=0x1c ASCQ=0x2 
[249145.786995] sd 21:0:3:0: [sdn] tag#2383 Sense Key : 0x1 [current] 
[249145.787008] sd 21:0:3:0: [sdn] tag#2383 ASC=0x1c ASCQ=0x2 
[249145.788805] sd 21:0:1:0: [sdl] tag#2390 Sense Key : 0x1 [current] 
[249145.788817] sd 21:0:1:0: [sdl] tag#2390 ASC=0x1c ASCQ=0x2 
[249145.795983] sd 21:0:5:0: [sdp] tag#2397 Sense Key : 0x1 [current] 
[249145.795994] sd 21:0:5:0: [sdp] tag#2397 ASC=0x1c ASCQ=0x2 
[249184.370938] sd 21:0:1:0: [sdl] tag#2403 Sense Key : 0x1 [current] 
[249184.370949] sd 21:0:1:0: [sdl] tag#2403 ASC=0x1c ASCQ=0x2 
[249184.380243] sd 21:0:3:0: [sdn] tag#2372 Sense Key : 0x1 [current] 
[249184.380257] sd 21:0:3:0: [sdn] tag#2372 ASC=0x1c ASCQ=0x2 
[249184.380647] sd 21:0:6:0: [sdq] tag#2375 Sense Key : 0x1 [current] 
[249184.380662] sd 21:0:6:0: [sdq] tag#2375 ASC=0x1c ASCQ=0x2 
[249184.385132] sd 21:0:5:0: [sdp] tag#2378 Sense Key : 0x1 [current] 
[249184.385143] sd 21:0:5:0: [sdp] tag#2378 ASC=0x1c ASCQ=0x2 
[249222.706590] sd 21:0:3:0: [sdn] tag#2375 Sense Key : 0x1 [current] 
[249222.706601] sd 21:0:3:0: [sdn] tag#2375 ASC=0x1c ASCQ=0x2 
[249222.711123] sd 21:0:5:0: [sdp] tag#2382 Sense Key : 0x1 [current] 
[249222.711134] sd 21:0:5:0: [sdp] tag#2382 ASC=0x1c ASCQ=0x2 
[249222.715219] sd 21:0:6:0: [sdq] tag#2385 Sense Key : 0x1 [current] 
[249222.715230] sd 21:0:6:0: [sdq] tag#2385 ASC=0x1c ASCQ=0x2 
[249222.715616] sd 21:0:1:0: [sdl] tag#2388 Sense Key : 0x1 [current] 
[249222.715625] sd 21:0:1:0: [sdl] tag#2388 ASC=0x1c ASCQ=0x2 
[249261.142086] sd 21:0:3:0: [sdn] tag#2414 Sense Key : 0x1 [current] 
[249261.142099] sd 21:0:3:0: [sdn] tag#2414 ASC=0x1c ASCQ=0x2 
[249261.143074] sd 21:0:1:0: [sdl] tag#2421 Sense Key : 0x1 [current] 
[249261.143085] sd 21:0:1:0: [sdl] tag#2421 ASC=0x1c ASCQ=0x2 
[249261.144252] sd 21:0:5:0: [sdp] tag#2427 Sense Key : 0x1 [current] 
[249261.144263] sd 21:0:5:0: [sdp] tag#2427 ASC=0x1c ASCQ=0x2 
[249261.151939] sd 21:0:6:0: [sdq] tag#2374 Sense Key : 0x1 [current] 
[249261.151951] sd 21:0:6:0: [sdq] tag#2374 ASC=0x1c ASCQ=0x2 
[249299.517513] sd 21:0:3:0: [sdn] tag#2415 Sense Key : 0x1 [current] 
[249299.517524] sd 21:0:3:0: [sdn] tag#2415 ASC=0x1c ASCQ=0x2 
[249299.521643] sd 21:0:5:0: [sdp] tag#2418 Sense Key : 0x1 [current] 
[249299.521653] sd 21:0:5:0: [sdp] tag#2418 ASC=0x1c ASCQ=0x2 
[249299.522016] sd 21:0:1:0: [sdl] tag#2421 Sense Key : 0x1 [current] 
[249299.522027] sd 21:0:1:0: [sdl] tag#2421 ASC=0x1c ASCQ=0x2 
[249299.525094] sd 21:0:6:0: [sdq] tag#2424 Sense Key : 0x1 [current] 
[249299.525104] sd 21:0:6:0: [sdq] tag#2424 ASC=0x1c ASCQ=0x2 
[249337.828037] sd 21:0:3:0: [sdn] tag#2384 Sense Key : 0x1 [current] 
[249337.828048] sd 21:0:3:0: [sdn] tag#2384 ASC=0x1c ASCQ=0x2 
[249337.833223] sd 21:0:6:0: [sdq] tag#2402 Sense Key : 0x1 [current] 
[249337.833234] sd 21:0:6:0: [sdq] tag#2402 ASC=0x1c ASCQ=0x2 
[249337.833331] sd 21:0:1:0: [sdl] tag#2406 Sense Key : 0x1 [current] 
[249337.833342] sd 21:0:1:0: [sdl] tag#2406 ASC=0x1c ASCQ=0x2 
[249337.836874] sd 21:0:5:0: [sdp] tag#2474 Sense Key : 0x1 [current] 
[249337.836888] sd 21:0:5:0: [sdp] tag#2474 ASC=0x1c ASCQ=0x2 
[249376.280766] sd 21:0:3:0: [sdn] tag#2380 Sense Key : 0x1 [current] 
[249376.280780] sd 21:0:3:0: [sdn] tag#2380 ASC=0x1c ASCQ=0x2 
[249376.282894] sd 21:0:6:0: [sdq] tag#2383 Sense Key : 0x1 [current] 
[249376.282908] sd 21:0:6:0: [sdq] tag#2383 ASC=0x1c ASCQ=0x2 
[249376.288966] sd 21:0:1:0: [sdl] tag#2386 Sense Key : 0x1 [current] 
[249376.288978] sd 21:0:1:0: [sdl] tag#2386 ASC=0x1c ASCQ=0x2 
[249376.290512] sd 21:0:5:0: [sdp] tag#2389 Sense Key : 0x1 [current] 
[249376.290524] sd 21:0:5:0: [sdp] tag#2389 ASC=0x1c ASCQ=0x2 
[249414.654015] sd 21:0:3:0: [sdn] tag#2464 Sense Key : 0x1 [current] 
[249414.654030] sd 21:0:3:0: [sdn] tag#2464 ASC=0x1c ASCQ=0x2 
[249414.655641] sd 21:0:6:0: [sdq] tag#2395 Sense Key : 0x1 [current] 
[249414.655652] sd 21:0:6:0: [sdq] tag#2395 ASC=0x1c ASCQ=0x2 
[249414.656915] sd 21:0:1:0: [sdl] tag#2398 Sense Key : 0x1 [current] 
[249414.656927] sd 21:0:1:0: [sdl] tag#2398 ASC=0x1c ASCQ=0x2 
[249414.659192] sd 21:0:5:0: [sdp] tag#2408 Sense Key : 0x1 [current] 
[249414.659204] sd 21:0:5:0: [sdp] tag#2408 ASC=0x1c ASCQ=0x2 
[249453.065318] sd 21:0:6:0: [sdq] tag#2482 Sense Key : 0x1 [current] 
[249453.065329] sd 21:0:6:0: [sdq] tag#2482 ASC=0x1c ASCQ=0x2 
[249453.072515] sd 21:0:3:0: [sdn] tag#2383 Sense Key : 0x1 [current] 
[249453.072525] sd 21:0:3:0: [sdn] tag#2383 ASC=0x1c ASCQ=0x2 
[249453.075277] sd 21:0:1:0: [sdl] tag#2485 Sense Key : 0x1 [current] 
[249453.075289] sd 21:0:1:0: [sdl] tag#2485 ASC=0x1c ASCQ=0x2 
[249453.078704] sd 21:0:5:0: [sdp] tag#2386 Sense Key : 0x1 [current] 
[249453.078713] sd 21:0:5:0: [sdp] tag#2386 ASC=0x1c ASCQ=0x2 
[249491.489512] sd 21:0:6:0: [sdq] tag#2388 Sense Key : 0x1 [current] 
[249491.489522] sd 21:0:6:0: [sdq] tag#2388 ASC=0x1c ASCQ=0x2 
[249491.497318] sd 21:0:1:0: [sdl] tag#2401 Sense Key : 0x1 [current] 
[249491.497328] sd 21:0:1:0: [sdl] tag#2401 ASC=0x1c ASCQ=0x2 
[249491.498826] sd 21:0:5:0: [sdp] tag#2404 Sense Key : 0x1 [current] 
[249491.498838] sd 21:0:5:0: [sdp] tag#2404 ASC=0x1c ASCQ=0x2 
[249491.501140] sd 21:0:3:0: [sdn] tag#2407 Sense Key : 0x1 [current] 
[249491.501152] sd 21:0:3:0: [sdn] tag#2407 ASC=0x1c ASCQ=0x2 
[249529.875932] sd 21:0:1:0: [sdl] tag#2458 Sense Key : 0x1 [current] 
[249529.875943] sd 21:0:1:0: [sdl] tag#2458 ASC=0x1c ASCQ=0x2 
[249529.883500] sd 21:0:3:0: [sdn] tag#2379 Sense Key : 0x1 [current] 
[249529.883511] sd 21:0:3:0: [sdn] tag#2379 ASC=0x1c ASCQ=0x2 
[249529.887734] sd 21:0:5:0: [sdp] tag#2482 Sense Key : 0x1 [current] 
[249529.887744] sd 21:0:5:0: [sdp] tag#2482 ASC=0x1c ASCQ=0x2 
[249529.890864] sd 21:0:6:0: [sdq] tag#2485 Sense Key : 0x1 [current] 
[249529.890875] sd 21:0:6:0: [sdq] tag#2485 ASC=0x1c ASCQ=0x2 
[249568.652704] sd 21:0:6:0: [sdq] tag#2434 Sense Key : 0x1 [current] 
[249568.652714] sd 21:0:6:0: [sdq] tag#2434 ASC=0x1c ASCQ=0x2 
[249568.662962] sd 21:0:3:0: [sdn] tag#2438 Sense Key : 0x1 [current] 
[249568.662973] sd 21:0:3:0: [sdn] tag#2438 ASC=0x1c ASCQ=0x2 
[249568.666710] sd 21:0:1:0: [sdl] tag#2415 Sense Key : 0x1 [current] 
[249568.666721] sd 21:0:1:0: [sdl] tag#2415 ASC=0x1c ASCQ=0x2 
[249568.672205] sd 21:0:5:0: [sdp] tag#2420 Sense Key : 0x1 [current] 
[249568.672215] sd 21:0:5:0: [sdp] tag#2420 ASC=0x1c ASCQ=0x2 
[249607.934592] sd 21:0:6:0: [sdq] tag#2423 Sense Key : 0x1 [current] 
[249607.934605] sd 21:0:6:0: [sdq] tag#2423 ASC=0x1c ASCQ=0x2 
[249607.937438] sd 21:0:1:0: [sdl] tag#2388 Sense Key : 0x1 [current] 
[249607.937449] sd 21:0:1:0: [sdl] tag#2388 ASC=0x1c ASCQ=0x2 
[249607.944875] sd 21:0:3:0: [sdn] tag#2378 Sense Key : 0x1 [current] 
[249607.944887] sd 21:0:3:0: [sdn] tag#2378 ASC=0x1c ASCQ=0x2 
[249607.947231] sd 21:0:5:0: [sdp] tag#2385 Sense Key : 0x1 [current] 
[249607.947242] sd 21:0:5:0: [sdp] tag#2385 ASC=0x1c ASCQ=0x2 
[249646.269317] sd 21:0:1:0: [sdl] tag#2382 Sense Key : 0x1 [current] 
[249646.269330] sd 21:0:1:0: [sdl] tag#2382 ASC=0x1c ASCQ=0x2 
[249646.270550] sd 21:0:5:0: [sdp] tag#2388 Sense Key : 0x1 [current] 
[249646.270561] sd 21:0:5:0: [sdp] tag#2388 ASC=0x1c ASCQ=0x2 
[249646.272644] sd 21:0:6:0: [sdq] tag#2399 Sense Key : 0x1 [current] 
[249646.272655] sd 21:0:6:0: [sdq] tag#2399 ASC=0x1c ASCQ=0x2 
[249646.277496] sd 21:0:3:0: [sdn] tag#2403 Sense Key : 0x1 [current] 
[249646.277508] sd 21:0:3:0: [sdn] tag#2403 ASC=0x1c ASCQ=0x2 
[249684.744933] sd 21:0:5:0: [sdp] tag#2427 Sense Key : 0x1 [current] 
[249684.744946] sd 21:0:5:0: [sdp] tag#2427 ASC=0x1c ASCQ=0x2 
[249684.744987] sd 21:0:6:0: [sdq] tag#2428 Sense Key : 0x1 [current] 
[249684.745000] sd 21:0:6:0: [sdq] tag#2428 ASC=0x1c ASCQ=0x2 
[249684.746136] sd 21:0:1:0: [sdl] tag#2432 Sense Key : 0x1 [current] 
[249684.746146] sd 21:0:1:0: [sdl] tag#2432 ASC=0x1c ASCQ=0x2 
[249684.752295] sd 21:0:3:0: [sdn] tag#2431 Sense Key : 0x1 [current] 
[249684.752306] sd 21:0:3:0: [sdn] tag#2431 ASC=0x1c ASCQ=0x2 
[249723.243761] sd 21:0:5:0: [sdp] tag#2375 Sense Key : 0x1 [current] 
[249723.243775] sd 21:0:5:0: [sdp] tag#2375 ASC=0x1c ASCQ=0x2 
[249723.249736] sd 21:0:1:0: [sdl] tag#2383 Sense Key : 0x1 [current] 
[249723.249748] sd 21:0:1:0: [sdl] tag#2383 ASC=0x1c ASCQ=0x2 
[249723.256562] sd 21:0:3:0: [sdn] tag#2386 Sense Key : 0x1 [current] 
[249723.256571] sd 21:0:3:0: [sdn] tag#2386 ASC=0x1c ASCQ=0x2 
[249723.258674] sd 21:0:6:0: [sdq] tag#2478 Sense Key : 0x1 [current] 
[249723.258686] sd 21:0:6:0: [sdq] tag#2478 ASC=0x1c ASCQ=0x2 
[249761.544012] sd 21:0:3:0: [sdn] tag#2425 Sense Key : 0x1 [current] 
[249761.544023] sd 21:0:3:0: [sdn] tag#2425 ASC=0x1c ASCQ=0x2 
[249761.555977] sd 21:0:1:0: [sdl] tag#2399 Sense Key : 0x1 [current] 
[249761.555989] sd 21:0:1:0: [sdl] tag#2399 ASC=0x1c ASCQ=0x2 
[249761.561926] sd 21:0:6:0: [sdq] tag#2460 Sense Key : 0x1 [current] 
[249761.561937] sd 21:0:6:0: [sdq] tag#2460 ASC=0x1c ASCQ=0x2 
[249761.562929] sd 21:0:5:0: [sdp] tag#2402 Sense Key : 0x1 [current] 
[249761.562941] sd 21:0:5:0: [sdp] tag#2402 ASC=0x1c ASCQ=0x2 
[249799.978084] sd 21:0:6:0: [sdq] tag#2443 Sense Key : 0x1 [current] 
[249799.978095] sd 21:0:6:0: [sdq] tag#2443 ASC=0x1c ASCQ=0x2 
[249799.985261] sd 21:0:1:0: [sdl] tag#2449 Sense Key : 0x1 [current] 
[249799.985273] sd 21:0:1:0: [sdl] tag#2449 ASC=0x1c ASCQ=0x2 
[249799.986097] sd 21:0:5:0: [sdp] tag#2452 Sense Key : 0x1 [current] 
[249799.986109] sd 21:0:5:0: [sdp] tag#2452 ASC=0x1c ASCQ=0x2 
[249799.989505] sd 21:0:3:0: [sdn] tag#2417 Sense Key : 0x1 [current] 
[249799.989517] sd 21:0:3:0: [sdn] tag#2417 ASC=0x1c ASCQ=0x2 
[249838.371094] sd 21:0:3:0: [sdn] tag#2414 Sense Key : 0x1 [current] 
[249838.371107] sd 21:0:3:0: [sdn] tag#2414 ASC=0x1c ASCQ=0x2 
[249838.372674] sd 21:0:6:0: [sdq] tag#2466 Sense Key : 0x1 [current] 
[249838.372685] sd 21:0:6:0: [sdq] tag#2466 ASC=0x1c ASCQ=0x2 
[249838.378145] sd 21:0:1:0: [sdl] tag#2418 Sense Key : 0x1 [current] 
[249838.378157] sd 21:0:1:0: [sdl] tag#2418 ASC=0x1c ASCQ=0x2 
[249838.382936] sd 21:0:5:0: [sdp] tag#2421 Sense Key : 0x1 [current] 
[249838.382946] sd 21:0:5:0: [sdp] tag#2421 ASC=0x1c ASCQ=0x2 
[249876.835646] sd 21:0:5:0: [sdp] tag#2491 Sense Key : 0x1 [current] 
[249876.835658] sd 21:0:5:0: [sdp] tag#2491 ASC=0x1c ASCQ=0x2 
[249876.838958] sd 21:0:6:0: [sdq] tag#2390 Sense Key : 0x1 [current] 
[249876.838969] sd 21:0:6:0: [sdq] tag#2390 ASC=0x1c ASCQ=0x2 
[249876.843325] sd 21:0:1:0: [sdl] tag#2495 Sense Key : 0x1 [current] 
[249876.843336] sd 21:0:1:0: [sdl] tag#2495 ASC=0x1c ASCQ=0x2 
[249876.844403] sd 21:0:3:0: [sdn] tag#2393 Sense Key : 0x1 [current] 
[249876.844410] sd 21:0:3:0: [sdn] tag#2393 ASC=0x1c ASCQ=0x2 
[249915.280482] sd 21:0:6:0: [sdq] tag#2411 Sense Key : 0x1 [current] 
[249915.280495] sd 21:0:6:0: [sdq] tag#2411 ASC=0x1c ASCQ=0x2 
[249915.281558] sd 21:0:3:0: [sdn] tag#2419 Sense Key : 0x1 [current] 
[249915.281570] sd 21:0:3:0: [sdn] tag#2419 ASC=0x1c ASCQ=0x2 
[249915.282414] sd 21:0:1:0: [sdl] tag#2428 Sense Key : 0x1 [current] 
[249915.282426] sd 21:0:1:0: [sdl] tag#2428 ASC=0x1c ASCQ=0x2 
[249915.290152] sd 21:0:5:0: [sdp] tag#2386 Sense Key : 0x1 [current] 
[249915.290164] sd 21:0:5:0: [sdp] tag#2386 ASC=0x1c ASCQ=0x2 
[249953.618700] sd 21:0:1:0: [sdl] tag#2556 Sense Key : 0x1 [current] 
[249953.618711] sd 21:0:1:0: [sdl] tag#2556 ASC=0x1c ASCQ=0x2 
[249953.628190] sd 21:0:6:0: [sdq] tag#2494 Sense Key : 0x1 [current] 
[249953.628200] sd 21:0:6:0: [sdq] tag#2494 ASC=0x1c ASCQ=0x2 
[249953.630673] sd 21:0:3:0: [sdn] tag#2434 Sense Key : 0x1 [current] 
[249953.630684] sd 21:0:3:0: [sdn] tag#2434 ASC=0x1c ASCQ=0x2 
[249953.637412] sd 21:0:5:0: [sdp] tag#2437 Sense Key : 0x1 [current] 
[249953.637420] sd 21:0:5:0: [sdp] tag#2437 ASC=0x1c ASCQ=0x2 
[249992.092367] sd 21:0:1:0: [sdl] tag#2444 Sense Key : 0x1 [current] 
[249992.092378] sd 21:0:1:0: [sdl] tag#2444 ASC=0x1c ASCQ=0x2 
[249992.093206] sd 21:0:5:0: [sdp] tag#2449 Sense Key : 0x1 [current] 
[249992.093217] sd 21:0:5:0: [sdp] tag#2449 ASC=0x1c ASCQ=0x2 
[249992.094419] sd 21:0:6:0: [sdq] tag#2456 Sense Key : 0x1 [current] 
[249992.094430] sd 21:0:6:0: [sdq] tag#2456 ASC=0x1c ASCQ=0x2 
[249992.094461] sd 21:0:3:0: [sdn] tag#2463 Sense Key : 0x1 [current] 
[249992.094472] sd 21:0:3:0: [sdn] tag#2463 ASC=0x1c ASCQ=0x2 

 

I'm not sure if it could be realted but I thought it was worth mentioning. 

13 minutes ago, peace-keeping-villa8590 said:

I was trying to find what driver was being used if I passed one of the drives through an Ubuntu VM using dmesg. Unsurprisingly, it said virtio. 

Because only a driver for the controller is usually used for SATA/SAS drives and the controller does the rest.

 

Again, to my knowledge there is no driver for the drives itself.

On 1/29/2025 at 11:38 AM, ich777 said:

Because only a driver for the controller is usually used for SATA/SAS drives and the controller does the rest.

 

Again, to my knowledge there is no driver for the drives itself.

Do you have any insight as to why a VM on the same disk is faster?

1 hour ago, peace-keeping-villa8590 said:

Do you have any insight as to why a VM on the same disk is faster?

As already said, maybe it‘s the filesystem.

 

What Kernel was the Ubuntu machine using?