abhi.ko

I will read through and try updating the FW, biggest problem I see is that there is no 9300-16i product on the Broadcom site. So should I use the 9305-16i as the product. Do you know? Found it, not sure why I couldn't yesterday while filtering for the HBA. Also I tried to boot into the LSI Bios yesterday but it did not come up when I tried to start the system without unraid usb plugged in, tried charging the boot order and looking through the Bios management page but had no luck getting into it. Edit: For getting into the LSI BIOS should I be hitting Ctrl+C as soon as the system posts and start booting up? Obviously the HBA is installed and found by the system.

@JorgeB please see attached. tower-diagnostics-20201201-0756.zip

Thank you. So I plugged everything in and started the system. Unfortunately, I do not see the unassigned disks still, all the assigned disks still do get recognized. So the HBA card did not solve the issue, those 2 disks are connected to the HBA card. Also bigger problem is that I have a ton of missing disks now. I guess the way the card identifies the disk and how it was identified earlier with the SATA multiplier cards are different, please see the screenshot below. Unraid says they are wrong disks but they are the same. How do I fix this without loosing any data please? Thanks.

Hi @JorgeB - I ended up getting the 9300-16i. Had some questions before connecting and turning the system on. Does this card need a power connection from the PSU? Do I need to flash the FW or BIOS to put it in IT mode, or would it work out of the box? Anything else I need to keep in mind before installing and booting up Unraid? I plugged it into a free PCIe slot on the MB and connected all the SAS cables to the disks, but have not switched anything on yet, a little worried I might make a stupid mistake and fry something, because I know nothing about HBA cards. Thanks in advance. PS: Is this discontinued? Asking because I cannot find the 9300-16i on the Broadcom site, I do see a 9300-8i and a 9305-16i, was trying to find any drivers or FW upgrades needed, just in case.

Hello - As the topic suggests trying to see why the shfs task is taking up a lot of processing power, even without active writes happening on the system. below is a screenshot from glances and terminal showing the usage. I found this topic from 2017 (with 6.2.x), I don't have freeze-up issues currently as I upgraded to a much beefier processor and doubled the memory, but used to have those issues with my old 4 core xeon, but still this is a concern. Also what is that %CPU out of because my server load is not greater than 10-15% when this task shows up as 200% of CPU. I do have a mix of rfs and xfs disks in the array. Not sure if that is causing this? Thanks.

Perfect - thank you!

Thanks a ton. Dang these are not cheap! Hopefully there is something on sale this week or next. I would need 4 SAS to SAS connectors as well I am assuming. Also is there a preference where parity and cache are connected to between the MB ports and the card?

Thanks again @JorgeB and @dlandon I have 24 drive slots on the case and 8 SATA ports on the mother board, the Case has Six internal SFF-8087 Mini SAS connectors that support up to twenty-four 3.5″ or 2.5″ SATA (II or III) or SAS hard drives. Currently I am using SAS to 4xSATA reverse breakout cables to connect these drives. That said, any guidance on a better and more stable way to achieve this with an LSI HBA controller is welcome and appreciated, not sure as to which one I should get?

Thanks - but that is what I was trying to explain. Let us say the other HDD, the one that is not found, was on sds. This unassigned drive (SSD) is on sdl and is found. I tried switching the drive slots of the HDD and SSD (or any other drive on the array) and it gets found again and shows up as sds (for e.g.), and the other one which is now on sdl is still invisible. So I am not sure how one drive is not working on the same drive slot but another one is. How could that be a hardware problem?

I have a very weird issue with my server now - I cannot see either of my two unassigned HDD's, there is an unassigned SSD - which shows up fine. I did recently update my hardware, everything except for the disks pretty much was changed. So naturally I though it is a hardware related issue, but since then I have been able to pretty much rule out my SATA port multiplier cards or my NORCO 4224 SAS connectors and other hardware. I think the problem started after I updated the Unassigned Devices plugin yesterday at some point. I am thinking something changed after that. What I have tried so far in an effort to narrow down on the problem: SATA/SAS connectors and Hardware: I switched drive slots, cards and cables on those two and tried swapping with a device that Unraid does find, and those devices do show up without an issue, with a different device letter (sdX), but the unassigned devices, now connected via previously working hardware (SATA ports and cables) are still not found and does not show up. So in effect the assigned devices work on the same drive slots and other hardware without an issue. Unassigned does not seem to work on any. So doesn't look like it is a hardware issue to me, I might be wrong. I even tried switching the SATA port multiplier card to a different one and that also did not work. HDD's: One of the unassigned devices were present and detected before yesterday and was pre-cleared. So I am pretty sure that drive is a working drive. so not a drive issue either. The other one is a brand new disk I just added, will be checking that drive on a different computer soon to see if it is an issue with the drive. Tried switching to 6.9-beta35 but no luck there either. Has anyone encountered this before. Diagnostics is attached. All help appreciated. tower-diagnostics-20201126-1012.zip

So an update on this: Thanks @JorgeB - I did what you suggested and everything seems to be working from a docker perspective. But my VM's are not starting up now, not a big deal for me because I have a snapshot of my hassos VM saved up. What I did: Run CA Backup & Restore to backup appdata and and other files. Copy over systems and domain shares (they were set to Cache Prefer) manually to location on the array. Did not copy over the data since there was nothing valuable to me in cache at the time. Just some media files. Stop the array. For formatting the cache SSD - Changed the filesystem for the Cache Drive to xfs from btrfs, and clicked apply & done. I am not planning to use a Cache pool anytime soon, not sure if that corruption was any fault of the btrfs. (my knowledge on linux filesystems is very limited, so this is just google/unraid wiki based. Cache Drive showed up to be formatted - clicked checkbox and format. Once done, restarted the array. Restored appdata using the CA backup/restore Restarted the server as suggested by the plugin. Copied everything over other than the docker image. Re-enabled docker in settings and set the image size to 20G - thanks @trurl Rebuilt docker image from existing templates in my templates. All containers are now back up and running fine! Re-enabled VM service, with the copied over image and the VM's showed up. But they are not starting, so not sure what is wrong there, unsure if the filesystem change caused that? That's it now. Dockers are all back and shares are intact, so I'm happy. Will have to try fixing VM again later, any suggestions here would be appreciated.

That is interesting since I have it mapped to the system share which is set cache prefer, and there is plenty of space left on the cache drive. So not sure why there is another image on Disk15.

No - never filled. Docker is not currently running - so I couldn't tell you what the status is currently. I think it was a stupid mistake some years back when I changed the default size of the file to 100G, not understanding what I was doing. But never had it filled up.

Yes total of 4 VM's - only one that I do care about. My hassos VM, and maybe the Win 10 VM. The rest are rarely run, so no big deal if there are gone. I just copied over the domains and systems share contents to the array (share).

What do you mean by 'problems filling it'?

thanks @trurl . Was typing a reply to both of you. But here is the output of the ls command: root@Tower:~# ls -lah /mnt/disk15/system total 0 drwxrwxrwx 3 root root 21 Nov 7 13:15 ./ drwxrwxrwx 12 nobody users 201 Nov 23 00:17 ../ drwxrwxrwx 2 root root 25 Nov 7 13:15 libvirt/

Thank you @JorgeB and @trurl ! How do I achieve this. I am planning to manually cp over all the cache folders to a location on the array. Is there a faster or better way to do this? I have the appdata and USB backed up as recently as yesterday via the CA Backup/Restore plugin. so that should hopefully not be corrupt. How do I go about formatting an already assigned drive? Sorry for the questions, just don't want to do something I think is right and make this problem worse. Recreating the docker image and reducing size to 20G - do I just recreate a new image and reinstall all the dockers from my templates? The templates should still be available right?

Thanks got it. tower-diagnostics-20201123-1240.zip

Thanks @JorgeB. Trying to post it, it has been downloading for a long time (>20 min), not sure if something is wrong. Hopefully will be done soon. The funny thing is I haven't done anything to my cache drive recently. Did change the drive about 2-3 months back and everything has been working fine till now.

None of the docker containers were able to be accessed, and this just came to my notice, I believe it might have started sometime today morning. Everything was working fine about a couple of hours ago, I even updated Plex with the latest beta server version today morning, and have been getting pushbullet notifications from radarr and tautulli etc as recent as 45 minutes back. Now none of the containers can load because the docker image is inaccessible (read-only) it looks like, from what I can see in the logs. I tired stopped the docker service and tried to restart it but that fails, saying docker image location is read only - excerpt from the log below. No idea how and why the permissions got changed. I am on 6.8.3 (stable) Nov 23 11:29:42 Tower emhttpd: shcmd (1708): umount /var/lib/docker Nov 23 11:30:09 Tower login[15119]: ROOT LOGIN on '/dev/pts/0' Nov 23 11:34:46 Tower ool www[27234]: /usr/local/emhttp/plugins/dynamix/scripts/emcmd 'cmdStatus=Apply' Nov 23 11:34:46 Tower emhttpd: Starting services... Nov 23 11:34:46 Tower emhttpd: shcmd (1723): /etc/rc.d/rc.samba restart Nov 23 11:34:48 Tower root: Starting Samba: /usr/sbin/smbd -D Nov 23 11:34:48 Tower root: /usr/sbin/nmbd -D Nov 23 11:34:48 Tower root: /usr/sbin/wsdd Nov 23 11:34:48 Tower root: /usr/sbin/winbindd -D Nov 23 11:34:48 Tower emhttpd: shcmd (1736): /usr/local/sbin/mount_image '/mnt/user/system/docker.img' /var/lib/docker 100 Nov 23 11:34:48 Tower root: truncate: cannot open '/mnt/cache/system/docker.img' for writing: Read-only file system Nov 23 11:34:48 Tower kernel: BTRFS info (device loop2): using free space tree Nov 23 11:34:48 Tower kernel: BTRFS info (device loop2): has skinny extents Nov 23 11:34:48 Tower root: ERROR: unable to resize '/var/lib/docker': Read-only file system Nov 23 11:34:48 Tower root: Resize '/var/lib/docker' of 'max' Nov 23 11:34:48 Tower emhttpd: shcmd (1738): /etc/rc.d/rc.docker start Nov 23 11:34:48 Tower root: starting dockerd ... Nov 23 11:35:03 Tower emhttpd: shcmd (1740): umount /var/lib/docker Will post diagnostics soon. In the meanwhile can someone please provide some guidance as to why this happened and what caused this? Thanks.

Thanks, my bad I should have made it more clear. I can connect a monitor and get to it in close proximity to the server, but the question is, whether there is a way to connect remotely from another computer (not in the server room/closet) and still use the GPU passed through. Thought Splashtop would work for this (I might be wrong). But the bootloader requiring input is a stumbling block. Hope the question makes sense.

Great, that makes sense. Will pass through a keyboard and hit enter blindly on the bootloader. Will have to enable auto login as well I assume, and then onwards splash top should be able to use my main system (Win10) keyboard and mouse, right? Better solution - Is there anyway to pass an argument to the bootloader file to boot up into High Sierra automatically (there isn't another OS option) without prompting for user input?

@Zer0Nin3r Question on this. Is there a way to remotely access the VM (i.e. via Splashtop) if I am passing a discrete graphics card into the VM and not using VNC? I followed spaceinvaderone's video and set up a high sierra VM. The VM boots into the clover bootloader screen and it requires input, pressing enter at the screen to start the Mac bootup process. Not sure how to provide that input at the bootloader screen without VNC on unraid.

@iDashX Thank you for asking this. I understand this thread is almost a year old but wanted to reach out and see if this build is what you went with and how it worked out for you. Asking because, my use-case and specific needs are 99% similar to yours - Plex & Emby server on docker (need HW transcoding for both), Windows VM, MacOS VM (Catalina), HassOS VM and a bunch of dockers (mostly usenet and server monitoring related ones). Current server is a quad core (8 threads) and it is stretched pretty tight. The planned build is as below (pretty similar to what you have in the OP) - some of the parts are ones that I already have, and my existing case is a Norco RPC 4020. So just wanted some feedback on how this worked out for you, especially the CPU and the Board if you built it as planned above. All help appreciated. Thanks.

Thanks. Will do and keep this thread open in case some kind soul decides to comment and can provide some guidance.