Can0n

Members
  • Posts

    613
  • Joined

  • Last visited

Posts posted by Can0n

  1. just tried to manually start mover and it just refreshes the page and never start. in the log it looks like it started but does not appear to be running.

    Download Cache is 2 spinner 4TB drives using ZFS and main array is XFS

    Sep 30 23:49:22 Thor emhttpd: shcmd (3809): /usr/local/sbin/mover &> /dev/null &
    Sep 30 23:49:27 Thor emhttpd: shcmd (3810): /usr/local/sbin/mover &> /dev/null &
    Sep 30 23:50:57 Thor emhttpd: shcmd (3811): /usr/local/sbin/mover &> /dev/null &
    Sep 30 23:51:17 Thor emhttpd: shcmd (3812): /usr/local/sbin/mover &> /dev/null &


    Diagnostics attached

    Any help is appreciated

    thor-diagnostics-20230930-2351.zip

  2. Simply changing docker to ipvlan did not fix the issue

     

    Stopped docker deleted docker.img

     

    Created new one reinstalled containers

     

    Problem appears to be resolved. 

     

    Interesting to note while docker was using macvlan and even after I changed it to ipvlan but it was still locking up my unifi 10GB switch would go offline and the unifi udmpro would too impacting my cameras but not my access points (all ubiquiti)

     

    Not a squak from any of the devices since fixing that docker networking had no idea it could bring my firewall and switches and other gear down.

  3. 10 hours ago, JorgeB said:

    Post the output of

    docker network ls

     

    There was a report before that one or more containers were still using macvlan after changing to ipvlan, but could never reproduce.

    Yeah very odd

    wonder if its a glitch in 6.12.3

    i deleted docker.img made a new one and deploying all my containers again using ipvlan i was using that previously with no issues i only went to macvlan so i could see my plex server in my unifi network devices list

    I digress.

  4. 3 hours ago, JorgeB said:
    Aug 14 17:43:44 Thor kernel: macvlan_broadcast+0x10a/0x150 [macvlan]
    Aug 14 17:43:44 Thor kernel: ? _raw_spin_unlock+0x14/0x29
    Aug 14 17:43:44 Thor kernel: macvlan_process_broadcast+0xbc/0x12f [macvlan]

    Switching to ipvlan should fix it (Settings -> Docker Settings -> Docker custom network type -> ipvlan (advanced view must be enabled, top right)).

    wierd i switched it after the first lock up on Sunday just verified it last night

    am i going to have to blow away docker and do it again as ipvlan?

  5. 5 minutes ago, Niklas said:

     

    Try switching from macvlan to ipvlan. Docker need to be stopped to be able to switch.

    I did switch back to ipvlan right after the first freeze, froze up two more times last night so switched it off for the night and booted it this morning no array started and it was fine started plex and it was fine started some more containers and it froze so its frozen twice today

    here is my post with screenshots and logs
     

     

  6. Hi Everyone I am in a bit of panic i am having a tons of stability issues with my server right now

    as of last night it seems it be very unstable freezing randomly after being stable for 25 days.

    i thought it might be my 5 year old USB so i popped it into my PC and it detected errors i repaired them and copied the data to a much newer usb. inserted and booted up with array stopped..transfered license over and leaft it with docker enabled, VM disabled and left all dockers stopped. Was stable all day while i worked so i fired up plex....stable for a few hours so started firing up other dockers

    i cant use diagnostics because it doesnt seem stable enough and its a hard freeze too so if any one has ideas i was able to get one screenshot with my phone as it froze once only i am suspecting a CPU or memory issue but the memtest+ is not working it just boots unraid

    it froze three times last night so i left the server off for the night, fired it up today left it with array unstarted until i remoted in from work and started it making sure all dockers stayed off.

    attached is the last screen on saw on the first of two freezes tonight. please help ! this server contains a lot of data i cant lose and im hoping its a simple fix. the Motherboard is an Asus with the latest bios and plugins and containers are all updated vm were disabled as well

    CPU is i7 10700k, 64 GB Corsair DDR4 ram stock speeds and asus PRIME Z590-V motherboard

    not thinking there is any damage to the data just possible RAM, CPU or pretty new motherboard

    PXL_20230815_030025910.jpg

  7. 8 hours ago, Iker said:

    As far as I know there is no built-in function to delete multiple datasets at the same level, however, with bash is possible, e.j:

     

    ls | grep -oE '\b[0-9a-f]{64}\b' | xargs -I{} echo {}

     

    You can replace echo with zfs destroy and add the pool

    its ok i got them all manually removed now im dealing with freezing on my server...time to hit up another menu to get help

    I get a CPU panic and it freezes right after

  8. 4 minutes ago, Niklas said:

     

    The script from sp1 has nothing to do with it. Docker does that when you use it with directory if the directory is on zfs. Looks like you maybe used "/mnt/cache" as destination? I could be very wrong here. Sleep time here but people knowing more will most certainly answer you better. 😊

     

    yeah script was never known by me when i played with docker directory

    but once i got docker work once converting to ZFS from BTRFS using the docker.img file i wanted to create datasets so found the script this is my docker setup since using the script

    image.thumb.png.ccf6219185f07f1ecf176c4237c2a7a9.png

  9. 4 minutes ago, Niklas said:

     

    Definitely from docker. 

    What did you set as directory when you tried it?

    I never ran the script when trying docker directory thats whats odd about it

    I hadn't looked at the datasets in a while server was up 25 days with no issues just noticed it today then my server started locking up so spent time diagnosing that and its running better now so thought id look into why and how these all showed up


     

  10. 38 minutes ago, Niklas said:

     

    You shoud be able to destroy the parent and it will take the datasets and snapshots with it.

    My docker share is on cache pool called "cache" (dataset is cache/docker) so I should be able to use "zfs destroy -r cache/docker" (i guess??)

    Edit: Depends on where you put the folder when messing with it? Hm.
    I have no container names there (except the datasets in appdata I created with SpaceInader1's script). The rest is that seemingly random stuff used by docker. 

    Look at "zfs list" in the terminal

     

     

    without wild cards its going to take a while

    looks like its all cache/randomstring
    and there is a lot more than in this screenshot possibly multiple hundreds not related to my correct datasets (appdata, domains, system, isos)
    image.thumb.png.ca17ef1a59ff4d3f9602147ca2af1ccc.png


    here is a smaller screenshot showing cache/domains

    it seems what ever happened created all these in the cache root so hopefully someone who knows ZFS better might be able to point me to a equivalent to ZFS Destroy -R cache/0* type command

  11. 1 minute ago, Niklas said:

     

    Do you mean you don't have the datasets created using SpaceInader1's script? Only that? I guess you'll have to destroy the datasets from when docker created them. Deleting the folder/share won't do it. But I'm fairly new to zfs myself. 

    there are hundreds i did use the script to create the ones via docker.img not sure when it would have run to create them when DockerDirectory was tested.

    no way to mass remove all but the ones i need (appdata and domains) I mean its very massive list

     

  12. 2 minutes ago, Niklas said:

     

    Looks like when you have docker set to directory and the dir is on zfs formatted drive.


    looks like the dockerdirectory dataset is still there from when i was playing around with ZFS and docker but im actually usign BTRFS file system for docker.img...i manually delete the docker directory but the ZFS master plugin still showing all the super long strings and not the actual docker container names like it used itimage.png.1ad728d90b34c120886350799ddce433.png

  13. Hello I just happened to notice today all my containers (which were converted to datasets using SpaceInader1's script) are listed completely scrambled and there are way more than there should be. advice/support please?


    image.thumb.png.1c5aa68903ebced6fb24c1b94872b88b.png

  14. On 7/14/2023 at 8:55 PM, ljm42 said:

    The 6.12.3 release includes a set of bug fixes for networking and Docker.  All users are encouraged to upgrade.

     

    Please refer also to the 6.12.0 Announcement post.

     

    Upgrade steps for this release

    1. As always, prior to upgrading, create a backup of your USB flash device:  "Main/Flash/Flash Device Settings" - click "Flash Backup".
    2. Update all of your plugins. This is critical for the NVIDIA and Realtek plugins in particular.
    3. If the system is currently running 6.12.0 - 6.12.2, we're going to suggest that you stop the array at this point. If it gets stuck on "Retry unmounting shares", open a web terminal and type:
      umount /var/lib/docker

      The array should now stop successfully (This issue is resolved with this release)

    4. Go to Tools -> Update OS. If the update doesn't show, click "Check for Updates"
    5. Wait for the update to download and install
    6. If you have any plugins that install 3rd party drivers (NVIDIA, Realtek, etc), wait for the notification that the new version of the driver has been downloaded. 
    7. Reboot

     

    This thread is perfect for quick questions or comments, but if you suspect there will be back and forth for your specific issue, please start a new topic. Be sure to include your diagnostics.zip.

     

     

    No, I'm sorry to say my Plex is still completely unstable after going to 6.12.3 and adding the extra parameters

     

     

    I had to restart it three times in a 20 minute span again

     

    I tried Docker directory and my reverse proxy failed to work. I tried an XFS docker image file and my reverse proxy failed to work. Went back to the BTRFS Docker image and everything fires up again, but I am afraid it's probably not going to be very stable again. I've already got a post on the bug reports section for 6.12.3 with my diagnostics and the Plex Docker log is useless. It doesn't say anything is wrong

  15. 10 hours ago, ljm42 said:

     

    Plex is mentioned specifically in the release notes (which I know you read : ) ) so if you continue to have issues add --no-healthcheck as mentioned there

     

     

    If you have a thread discussing this, be sure to add new diagnostics after upgrading to 6.12.3. If you don't have a thread, please create one specific to this issue.  It is very difficult to have a lot of back and forth in a release thread.

    No problem I added the --no-healthcheck andnits pretty stable so far *fingers crossed*

     

    For the mover yes I had a thread for 6.12.2 with diagnostics about mover being extremely slow from zfs->XFS and xfs->ZFS but write construct might fixed the speed issues.

     

    As for datasets etc and mover no worries when I get some time I'll runs some mover tests and post a new thread

  16. I see a new acknowledgment release note have been read 

     

    That's a great step. I've been seeing nothing but questions about Docker on reddit and when we see the specs I saw the issues listed in the release notes and how to fix them. People need to read more lol

    Screenshot_20230714-222134.png

    • Like 2
  17. I sure hope this updates the stability of some of my containers on ZFS

     

    Been having a lot of problems especially with Plex (using official container) and I have a lot of friends and family that use it. It's been going down several times a day where we started the container is necessary

     

     

    Mover has a lot of problems on 6.12.2 as well, especially when trying to move shares from a ZFS pool to the array using xfs it will never finish completely because it can't delete the data sets from ZFS

     

     

    • Like 1
  18. Hello @jbrodriguez

    love the unbalance plugin however I am seeing one issue

    one of my cache pools is now showing up

    I have 2 party, 22 array  disks, 1 ZFS pool with two 1TB SSD's and the pool not showing is a second ZFS pool with two 4TB spinners in ZFS it is also reading the size of the ZFS SSD's incorrectly as 690GB in size

    the pool is called download-cache so not sure if there is a character limit for it to display or what the issues is and wondering if you could take a look

    missing download-cache in plugin.png