General IO Errors

Hi,

My server has been up and running fine for years. Today it is down. Please help!

Clicking around the UI is slow, and 50% of the time gives me this error message in the browser:

Warning: shell_exec(): Unable to execute 'logger error: '/webGui/include/DeviceList.php': missing csrf_token' in /usr/local/emhttp/plugins/dynamix/include/local_prepend.php on line 18

I went to the syslog and it has been throwing this error every 5 mins for the last 2 weeks:

Sep 14 12:45:06 Server_name ntfs-3g[26405]: Failed to read vcn 0x0: Input/output error
Sep 14 12:45:06 Server_name kernel: Buffer I/O error on dev sdt1, logical block 36, async page read
Sep 14 12:50:06 Server_name ntfs-3g[26405]: ntfs_attr_pread_i: ntfs_pread failed: Input/output error
Sep 14 12:50:06 Server_name ntfs-3g[26405]: Failed to read vcn 0x0: Input/output error

Then last night it started throwing this error every 5 mins:

Sep 18 01:50:29 Server_name emhttpd: Pro key detected, GUID: ***REDACTED*** FILE: /boot/config/Pro.key
Sep 18 01:50:54 Server_name emhttpd: Unregistered - flash device error (ENOFLASH7)
Sep 18 01:56:22 Server_name emhttpd: Unregistered - flash device blacklisted (EBLACKLISTED2)

and now all I am getting in the logs is this over and over:
 

Sep 18 14:24:50 Server_name emhttpd: read SMART /dev/sdf
Sep 18 14:24:50 Server_name emhttpd: error: device_read_smart, 7977: Cannot allocate memory (12): device_spinup: stream did not open: sdf

and

Sep 18 14:17:57 Server_name php-fpm[5669]: [ERROR] fork() failed: Resource temporarily unavailable (11)

I have tried exporting diagnostics but the server just hangs.

My basic knowledge is suggesting that my flash drive is toast, but I dont want to go down that route without some confirmation from somebody who knows a bit more

Any help or guidance on how to troubleshoot or fix this issue is much appreciated. Thanks in advance!

Edited September 18, 20232 yr by Ascii227