caplam
Members
-
Joined
-
Last visited
Everything posted by caplam
-
i've this resut using stacking: For now it suits me.
-
i managed to get a result. It's a first shot but it seems to be almost what i'm looking for. On the screenshot you can see high writes on 16th and 17th (i received my new ssds the 15th). Then i replaced the btrfs pool by 2 xfs single ssd pools. You can see the result in the numbers. edit: now to see more data on the same graph i'd like to display the same info for 2 ssd side by side. If i display the same query for the other ssd. Both will recover each other. So i guess i have 2 options but don't know if it's possible. - displaying info in the same way but with 2 bars for a day but one slightly shifted horizontally (i have no idea how to do that) - displaying the same query for the 2 ssds but with transparency so you can see them both.
-
i imagine a bar graph. a graph for a week with a bar for each day a graph for a month with a bar for each day or could be another type of visualisation. What i want i to track anormal usage of ssd, especially high write rates like i had with my btrfs pool.
-
I have my monitoring dashboard based on Gilbn work. I'll probably replace it with uud when i have time. Until then i'd like to had a monitoring of data written to my pools (as i had big troubles with excessive writes on cache pool). I absolutlely don't know to write a query for that. I start with diskio write_bytes field but i don't know how to use it to have: the data written displayed in the same way as cost/ kwh in ups dashboard. I mean have a graph with bar for a week with the amount of data written each day. And the same with a mont and data written each week. Do you know how to do that; i'm lost with time interval, group by,... ? edit: this could also be a suggestion of evolution. I think it would be a great idea for monitoring ssd health. It could also be done with smartdata nandwritten attribute. edit2: finally got it installed (only the dashboard) and modified to use my databases which are separated (docker,apc,unraid). @falconexe: do you have a 4K screen ? 😁 I only have full hd screens and it's way too big at least for drives panels (smart, life, health) a quick suggestion : threshold used for disk space is not really confortable : the 49,9% is light yellow. With a darker yellow the text is much more visible. I don't know why but i had to prefix all paths with /rootfs.
-
I have a problem that i've not seen so far in the forum. In 6.8.3 i had an excessive write problem. It's known and related to partition btrfs. I upgraded to beta30 directly from 6.8.3 Yesterday i received new ssds so i setup a new pool (2 ssd) and make it my cache pool. It stores appdata, domains and system. I continue to have high writes rates on loop2 devices. https://forums.unraid.net/topic/97902-getting-rid-of-high-ssd-write-rates/ https://forums.unraid.net/bug-reports/prereleases/unraid-os-version-690-beta30-available-r1076/?do=findComment&comment=11066 So i stop docker service and restart it without loop device using the directory option. Now /var/lib/docker is mapped to a dedicated share. But i continue to have excessive writes here is the result of iotop -aoP on unraid server after 1 hour: Total DISK READ : 0.00 B/s | Total DISK WRITE : 4.19 M/s Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 7.88 M/s PID PRIO USER DISK READ DISK WRITE> SWAPIN IO COMMAND 28332 be/4 root 51.46 M 3.99 G 0.00 % 0.13 % qemu-system-x86_64 -name guest=wazo,debu~ny,resourcecontrol=deny -msg timestamp=on 27768 be/4 root 80.00 K 2.96 G 0.00 % 0.07 % qemu-system-x86_64 -name guest=Hermes,de~ny,resourcecontrol=deny -msg timestamp=on 24611 be/4 root 2.13 M 848.54 M 0.00 % 0.06 % shfs /mnt/user -disks 31 -o noatime,allow_other -o remember=330 19819 be/4 root 100.00 K 507.45 M 0.00 % 0.03 % qemu-system-x86_64 -name guest=PiHole,de~ny,resourcecontrol=deny -msg timestamp=on 21224 be/4 root 0.00 B 218.03 M 0.00 % 0.01 % [kworker/u65:10-btrfs-endio-write] 28870 be/4 root 0.00 B 169.11 M 0.00 % 0.01 % qemu-system-x86_64 -name guest=Apollon,d~ny,resourcecontrol=deny -msg timestamp=on 21422 be/4 root 0.00 B 159.13 M 0.00 % 0.00 % [kworker/u65:1-btrfs-endio-write] 27287 be/4 root 0.00 B 139.56 M 0.00 % 1.22 % dockerd -p /var/run/dockerd.pid --log-op~ --log-level=error --storage-driver=btrfs 15717 be/4 root 0.00 B 132.48 M 0.00 % 0.00 % [kworker/u65:2-btrfs-endio-write] 25364 be/4 root 0.00 B 130.80 M 0.00 % 0.01 % [kworker/u65:7-events_unbound] 10515 be/4 root 0.00 B 126.08 M 0.00 % 0.00 % [kworker/u65:9-btrfs-worker] 10708 be/4 root 0.00 B 97.09 M 0.00 % 0.00 % [kworker/u65:4-btrfs-endio-write] 10514 be/4 root 0.00 B 94.36 M 0.00 % 0.00 % [kworker/u65:0-btrfs-endio-write] 26862 be/4 root 0.00 B 68.48 M 0.00 % 0.00 % [kworker/u65:3-btrfs-endio-write] 22073 be/4 root 0.00 B 55.11 M 0.00 % 0.00 % [kworker/u66:7-btrfs-endio-write] 13555 be/4 root 0.00 B 52.02 M 0.00 % 0.00 % [kworker/u66:0-btrfs-endio-write] 13144 be/4 root 8.00 K 51.37 M 0.00 % 0.00 % [kworker/u66:14-btrfs-endio-write] 10269 be/4 root 0.00 B 50.30 M 0.00 % 0.00 % [kworker/u66:2-btrfs-endio-write] 25365 be/4 root 0.00 B 49.25 M 0.00 % 0.00 % [kworker/u66:5-btrfs-endio-write] 16626 be/4 root 0.00 B 48.81 M 0.00 % 0.00 % [kworker/u66:4-btrfs-endio-write] 3032 be/4 root 0.00 B 41.62 M 0.00 % 0.00 % [kworker/u66:3-btrfs-endio-write] 10709 be/4 root 0.00 B 40.86 M 0.00 % 0.00 % [kworker/u65:11-btrfs-endio-write] 10710 be/4 root 0.00 B 37.89 M 0.00 % 0.00 % [kworker/u65:12-btrfs-endio-write] 8224 be/4 root 0.00 B 30.77 M 0.00 % 0.00 % [kworker/u66:6-btrfs-endio-write] 2808 be/4 root 0.00 B 27.78 M 0.00 % 0.00 % [kworker/u66:1-btrfs-endio-write] 8142 be/4 root 0.00 B 10.25 M 0.00 % 0.01 % [kworker/u64:1-bond0] 3432 be/4 103 0.00 B 7.12 M 0.00 % 0.00 % postgres: 10/main: stats collector process 8848 be/4 nobody 8.00 K 2.38 M 0.00 % 99.99 % mono --debug Sonarr.exe -nobrowser -data=/config 26116 be/4 nobody 17.23 M 2.20 M 0.00 % 0.01 % mono --debug Radarr.exe -nobrowser -data=/config The first 2 line are 2 vms i can't post the same result for these commands as it was done in a ssh session in mremotng (no copy avaliable) but for the host hermes the amount of data written was around 10 times less and 20 times for the host wazo. It doesn't involve loop3 device. I don't know where it writes. Each guest has a single vdisk raw format stored in domains share using virtio driver. I don't really know where and how investigate.
-
I've not found an operationnal libvirt plugin for telegraf. This seems odd as libvirt is used by so much people. I've found pr and issues concerning such a plugin but so far no one managed to get it working.
-
I never tried to install telegraf on my vms as i would prefer to show host resources used by the wm.
-
Hi, very nice setup, use of regex is a big improvement. Do you plan to add a panel for VM (with the same kind of stats as odcker panel) ? My setup is similar but i didn't find a simple way to add vm stats. Mine is also based on gilbn dashboard (i also added disk serial as device tag).
-
wow, i don't know where i saw this but i'm using onlyoffice repository. Yesterday i had hard time trying to maake this work. Onlyoffice was not available (even locally) until i fixed the reverse proxy problem i had (deleted linuxserver/let's encrypt and reconfigured from scratch linuxserver/swag). Strange but it's now working
-
hi, i'm using this docker for nextcloud and another container for onlyoffice. The container i use seems to be not maintained anymore (siwat's repository). It's still working in a web session but i'd like to change to a more actual version. Do you have any suugestion for onlyoffice docker repository? If i could keep my onloffice appdata it would be convenient.
-
is it a sas drive? I think sas drive can not be spun down.
-
i spend my all day pulling some images to use locally. I'm quite a bit disappointed as very few are working out of the box. I modified live_endpoint in boot.cfg and that part is ok. I installed a linuxmint vm with an iso as the image pulled (squashfs) couldn't boot with error message rootfs not detected despite the squashfs file was present. My vm installed with lvm automatic partitioning (which is not convenient as /home is in the root partition). I needed to resize lvroot to make a lvhome. So i thought with all utilities on the menu i will find one to resize my lvroot. I was able to boot gparted but it can't resize lv. Kaperski live booted load files from server but stopped with displaying no network connection which is strange as it downloaded files from the server. Rescatux boot but stop at some point complaining about the lack of screen. System rescue cd stopped on error failed to mount /dev/loop0 I can boot debian live but the keyboard is not responsive i have to hit 2 or 3 times the keys, not very convenient when locales are not set correctly. When i try to reconfigure locale the booting process shows up as soon as i try to move cursor. I continue my tries but the learning curve will probably be too steep for the time i have.
-
thanks for your answer. Unfortunately i have a very weak connexion so boot from images stored on github is not an option for me. I have to store all images i want locally. I guess i will start with a vm to try. When i modify an entry in boot.cfg or in a submenu do i have to restart docker ?
-
I was just looking for some documentation about pxe booting as i'm fed up with usb key i always lose. Thanks for that nice docker, it looks awesome. For now i know nothing about pxe booting and how to use netboot.xyz. Docker is pretty easily setup but now i've to learn how to add iso that are not maintained remotely. I see that you can pull images to have it locally accessible but i don't know the difference between the different options. For example if i want to install a debian stable what version do i have to pull: squashfs, vmlinuz or initrd ? if i want to install windows using the provided menu, i guess i have to put an win iso somewhere but where ?
-
i have 7 folders. I see 6 on dashboard and 4 on docker page. attached console when browsing docker page.
-
One week offline due to isp failure. I finally managed to remove and reinstall the plugin. I think my server was in a weird state. I have to reboot to often to my taste due to problem with emhttp. It seems i have the same problem than before : i can add folders and edit them but not all folders appear. When i edit a folder i can see all dockers and the folder they belong to but on the docker page i can not see them all. edit: when i export folders i can see them all.
-
I can't also install it. I tried to remove another plugin with success (fix common problems) and i have been able to had a plugin too (controlir).
-
Now the add folder button has disappeared. It seems i cannot completly delete the plugin. I now have an error : plugin: removing: docker.folder.plg plugin: file doesn't exist or xml parse error And when i open the plugins page i see this (even if it has been deleted):
-
Great plugin. Unfortunately i have quite a mess. I created several folders but were not showing up, and dockers in these folders were not showing either. When creating a folder i have a deleted docker which shows up. I decided to restart from scratch by deleting plugin, but the add folder is still present. After reinstalling plugin i have 2 warnings when adding a folder: Warning: file_get_contents(/boot/config/plugins/docker.folder/folders.json): failed to open stream: No such file or directory in /usr/local/emhttp/plugins/docker.folder/include/import-export.php on line 2 Warning: Invalid argument supplied for foreach() in /usr/local/emhttp/plugins/docker.folder/include/import-export.php on line 10 edit: i deleted filles and folder in /boot/config/plugins and in /usr/local/emhtpp/plugins. No more add folder button but when i reinstall plugin i have the following error: plugin: installing: https://raw.githubusercontent.com/GuildDarts/unraid-plugin-docker.folder/master/plugins/docker.folder.plg plugin: downloading https://raw.githubusercontent.com/GuildDarts/unraid-plugin-docker.folder/master/plugins/docker.folder.plg plugin: downloading: https://raw.githubusercontent.com/GuildDarts/unraid-plugin-docker.folder/master/plugins/docker.folder.plg ... done plugin: file doesn't exist or xml parse error
-
Answer to myself: I rebooted with an efi shell on usb key. The efi shell had to be named bootx64.efi and placed in /EFI/boot on a FAT32 usb key. At the root directory you must place the bin file (name according to your card), the sas2flash.efi and the mptsas2.rom As my card was in P20 firmware i used the P20 efi installer. Be sure to note the sas address of the card before flashing. In my case the difficulty was to find a suitable shell efi file for my server (a hp Z620). I had also no idea on how to have an efi bootable usb key. Now it's done. I'm running P16 firmware. sas2flash -list LSI Corporation SAS2 Flash Utility Version 20.00.00.00 (2014.09.18) Copyright (c) 2008-2014 LSI Corporation. All rights reserved Adapter Selected is a LSI SAS: SAS2308_2(D1) Controller Number : 0 Controller : SAS2308_2(D1) PCI Address : 00:03:00:00 SAS Address : 500605b-0-098c-fb80 NVDATA Version (Default) : 10.00.00.04 NVDATA Version (Persistent) : 10.00.00.04 Firmware Product ID : 0x2214 (IT) Firmware Version : 16.00.00.00 NVDATA Vendor : LSI NVDATA Product ID : SAS9207-8e BIOS Version : 07.31.00.00 UEFI BSD Version : N/A FCODE Version : N/A Board Name : SAS9207-8e Board Assembly : H3-25427-02H Board Tracer Number : SV43732784 Finished Processing Commands Successfully. Exiting SAS2Flash. I can now trim my evo 860 unassigned ssd. fstrim -v /mnt/disks/Samsung_SSD_860_EVO_500GB_xxxxxxxxxxxxxx/ /mnt/disks/Samsung_SSD_860_EVO_500GB_xxxxxxxxxxxxxx/: 219.4 GiB (235542450176 bytes) trimmed Thank you @johnnie.black for P16 firmware tip.
-
Just a small bump for an advice. My hba is a 9207-8e : sas2flash -list LSI Corporation SAS2 Flash Utility Version 20.00.00.00 (2014.09.18) Copyright (c) 2008-2014 LSI Corporation. All rights reserved Adapter Selected is a LSI SAS: SAS2308_2(D1) Controller Number : 0 Controller : SAS2308_2(D1) PCI Address : 00:03:00:00 SAS Address : 500605b-0-098c-fb80 NVDATA Version (Default) : 14.01.00.06 NVDATA Version (Persistent) : 14.01.00.06 Firmware Product ID : 0x2214 (IT) Firmware Version : 20.00.07.00 NVDATA Vendor : LSI NVDATA Product ID : SAS9207-8e BIOS Version : 07.39.02.00 UEFI BSD Version : 07.27.01.01 FCODE Version : N/A Board Name : SAS9207-8e Board Assembly : H3-25427-02H Board Tracer Number : SV43732784 Finished Processing Commands Successfully. Exiting SAS2Flash. I downloaded packages from broadcom. Should i downgrade bios and/or uefi also ? What is the best way for downgrading ? Could it be done from unraid cli with array stopped ? edit: forgot to mention i want to downgrade to P16 to use 860 EVO ssd.
-
i may have a clue but still don't understand why it's happening. The disks listed above are in jbod sas enclosure (except the 3Tb one which is usb). Yesterday i had a fan problem on the main enclosure. I had to shutdown to see the fan and find a replacement. I didn't touch the external enclosure which stay powered (i don't even know if you can "reboot" the enclosure when the hba restart). So i unplugged and replugged disks which couldn't not be mounted and know i can mount them. I knew the enclosure has to be powered when the server boots but i didn't imagine i had to power cycle the enclosure when rebooting the server. If someone has the true explanation i would hear it. 😀
-
result is: ST3000DM001-1CH166_Z1F2CT9T/ WDC_WD40EFRX-68WT0N0_WD-WCC4E4AT7LRU/ these are the 2 automounted drives. edit: yesterday i was able to mount the other disks except for the 2 ntfs disks but the partitions were not ok. I also have a ext4 formatted disk i have not be able to mount at all. I'm told the superblock is not present. For this disk i'm currently running testdisk.
-
Hi, i have an issue. I'm unable to mount some drives. They are formatted as ext4. I've this error message: Adding disk '/dev/sdf1'... May 27 09:56:02 godzilla unassigned.devices: Mount drive command: /sbin/mount -t ext4 -o rw,auto,noatime,nodiratime,async,nodev,nosuid '/dev/sdf1' '/mnt/disks/series2' May 27 09:56:02 godzilla unassigned.devices: Mount of '/dev/sdf1' failed. Error message: mount: /mnt/disks/series2: /dev/sdf1 already mounted or mount point busy. May 27 09:56:02 godzilla unassigned.devices: Partition '1426-15266' could not be mounted. but the drive is not mounted. I have another drive formatted also in ext4 which is set to automount and is working fine. I tried to mount the drive in a terminal with the same result. godzilla-diagnostics-20200527-1101.zip
-
Hi, I have been using pi-hole for quite a while now. Since several weeks i have some troubles. My router is a unifi usg3. I have 4 uap ac access points. Some ios couldn't get an ip from pi-hole. I noticed in unifi dashboard many dhcp time out and dns time out. I disabled pi-hole dhcp and enable dhcp server in usg (dnsmasq). I have no more dhcp time out but still have dns time out. When running pi-hole diagnostics it says : *** [ DIAGNOSING ]: Networking [✗] No IPv4 address(es) found on the br0 interface. [✗] No IPv6 address(es) found on the br0 interface. [i] Default IPv4 gateway: 192.168.0.254 * Pinging 192.168.0.254... [✗] Gateway did not respond. (https://discourse.pi-hole.net/t/why-is-a-default-gateway-important-for-pi-hole/3546) when i ping pi-hole ip it answers. Do you have an idea of what's going on ?
