How to stop fstrim: /mnt/cache: FITRIM ioctl failed: Input/output error email ?


Recommended Posts

Hi,

 

Since I switched to the new Ryzen 3000 plateform, I receive this error daily by email.   I had at some point the "Dynamix SSD Trim", but it was uninstalled and I still receive those errors.  I check in User Scripts plugins, and there is no script scheduled related to TRIM... 

 

Where I can find what triggers that ? 

 

FYI, I had a SATA SSD before, and I migrated to a NVMe Gen4 SSD on the new Platform, if that make any difference.

 

The System Log has this :

 

Aug  4 04:28:55 Unraid kernel: 
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2144
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: nvme 0000:01:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 1980448
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=01:00.0 domain=0x0000 address=0x0000000000000000 flags=0x0000]
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 221867184
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412583080
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 413472432
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415348952
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417417816
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419515976
Aug  4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 421684832
Aug  4 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 159 block group(s), last error -5
Aug  4 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5
Aug  4 04:40:17 Unraid sSMTP[912]: Creating SSL connection to host
Aug  4 04:40:17 Unraid sSMTP[912]: SSL connection using TLS_AES_256_GCM_SHA384
Aug  4 04:40:19 Unraid sSMTP[912]: Sent mail for [email protected] (221 2.0.0 closing connection j22sm33387198qtp.0 - gsmtp) uid=0 username=root outbytes=484

 

Edited by Pducharme
Link to comment
2 minutes ago, Squid said:

what about


cat /etc/cron.d/root

and

crontab -l

 

 

just found it! it was in "go" file.  Running a DailyCacheTrim... 

 

My USB Key is the original from 2014 and still has lots of old stuff on it.  I'm doing some cleanup now.  I always upgraded on top of old stuff.  When I did test my new Ryzen 3000 with Unraid, I create a trial USB key of Unraid and there is so much crap on my Pro USB Key i'm using from when I built my 1st unraid.

 

 

 

Link to comment

I'm a little concerned about my brand new Cache drive, it gives those errors in the Logs.  I don't know if it is harmful or not... 

 

Aug 3 07:06:22 Unraid kernel: nvme0n1: p1
Aug 3 07:06:22 Unraid kernel: BTRFS: device fsid 8f95981b-c7e0-49dd-80d1-b16b238077aa devid 1 transid 273147 /dev/nvme0n1p1
Aug 3 07:07:58 Unraid emhttpd: Force_MP600_19258229000128553340 (nvme0n1) 512 1953525168
Aug 3 07:07:58 Unraid emhttpd: import 30 cache device: (nvme0n1) Force_MP600_19258229000128553340
Aug 3 07:08:37 Unraid emhttpd: shcmd (168): mount -t btrfs -o noatime,nodiratime /dev/nvme0n1p1 /mnt/cache
Aug 3 07:08:37 Unraid kernel: BTRFS info (device nvme0n1p1): disk space caching is enabled
Aug 3 07:08:37 Unraid kernel: BTRFS info (device nvme0n1p1): has skinny extents
Aug 3 07:08:37 Unraid kernel: BTRFS info (device nvme0n1p1): enabling ssd optimizations
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2144
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 1980448
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 221867184
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412583080
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 413472432
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415348952
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417417816
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419515976
Aug 4 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 421684832
Aug 4 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 159 block group(s), last error -5
Aug 4 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2112
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 1981408
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 221947720
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412753680
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 413557864
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415377392
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417390984
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419511288
Aug 5 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 421742984
Aug 5 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 157 block group(s), last error -5
Aug 5 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2112
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 1982144
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412920608
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 413187664
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415378744
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417409608
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419560544
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 421765096
Aug 6 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 423727096
Aug 6 04:40:02 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 157 block group(s), last error -5
Aug 6 04:40:02 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2208
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 28264
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 1983200
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 221907328
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412817112
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 413209680
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415391776
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417400296
Aug 7 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419511288
Aug 7 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 164 block group(s), last error -5
Aug 7 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2208
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 27528
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 43104
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 221907000
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412590280
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 413212144
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415404160
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417400296
Aug 8 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419498888
Aug 8 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 163 block group(s), last error -5
Aug 8 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2112
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 43072
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 221907104
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412902448
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 413606840
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415404560
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417458312
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419506816
Aug 9 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 422036896
Aug 9 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 158 block group(s), last error -5
Aug 9 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2208
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 28504
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 43072
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 221905752
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412753672
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 414462904
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415408064
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417473536
Aug 10 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419511288
Aug 10 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 158 block group(s), last error -5
Aug 10 04:40:01 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 2208
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 10816
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 43072
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 221907824
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 412819344
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 414473160
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 415413064
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 417473560
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 419515976
Aug 11 04:40:01 Unraid kernel: print_req_error: I/O error, dev nvme0n1, sector 422057856
Aug 11 04:40:02 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 174 block group(s), last error -5
Aug 11 04:40:02 Unraid kernel: BTRFS warning (device nvme0n1p1): failed to trim 1 device(s), last error -5

 

Link to comment
19 hours ago, johnnie.black said:

There are some NVMe devices that have issues with trim, I don't see what brand/model you're using, but Samsung NVMe devices are known to work without issues.

It is a brand new Corsair MP600 Pcie gen4 nvme drive. Is there a way to disable something to stop getting those errors?

Link to comment
  • 1 month later...
10 hours ago, subivoodoo said:

Hi,

 

Same issue here with my new Corsair MP600 SSD.

 

Any solutions?

 

On 8/12/2019 at 11:48 PM, Squid said:

If its the only SSD in the system, then simply uninstall Dynamix SSD trim

Otherwise, use the user scripts plugin and do it manually

fstrim /mnt/cache

or

fstrim /mnt/disks/blah

 

Link to comment
  • 2 weeks later...

Hi,

 

Great hint thanks a lot!!! I really do passthrough and therefore I have IOMMU enabeld on a Ryzen 3600 + B450.

 

Adding iommu=pt avic=1 to the kernel boot line works for me. Now I can trim my new Corsair MP600 cache drive without IO_PAGE_FAULT:

 

#fstrim -v /mnt/cache
/mnt/cache: 1.5 TiB (1600709320704 bytes) trimmed

 

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.