Bovin
Members
-
Joined
-
Last visited
Everything posted by Bovin
-
+1, need partitions, only few GBs is needed.
-
Thanks for comments. After blanking rewrites, the issue gone.
-
cache mover want to cache the root. Feb 7 07:32:03 bowen-lab root: cache-mover: reg: update access time: /mnt/cache/media/tvshows/PAW Patrol/E1.mp4 Feb 7 07:32:04 bowen-lab root: cache-mover: msm: /usr/local/emhttp/plugins/cache-mover/scripts/cache_mover1: line 98: /bin/dirname: Argument list too long Feb 7 07:32:04 bowen-lab root: cache-mover: msm: /usr/local/emhttp/plugins/cache-mover/scripts/cache_mover1: line 99: /bin/dirname: Argument list too long Feb 7 07:34:37 bowen-lab root: cache-mover: msm: rsync: [generator] symlink "/proc/.self.0" -> "1163594" failed: No such file or directory (2) Feb 7 07:34:37 bowen-lab root: cache-mover: msm: rsync: [generator] symlink "/proc/.thread-self.0" -> "1163594/task/1163594" failed: No such file or directory (2) Feb 7 07:34:37 bowen-lab root: cache-mover: msm: file has vanished: "/proc/10/exe" Feb 7 07:34:37 bowen-lab root: cache-mover: msm: file has vanished: "/proc/10/task/10/exe" Feb 7 07:34:37 bowen-lab root: cache-mover: msm: directory has vanished: "/proc/10313/task/1167662" Feb 7 07:34:37 bowen-lab root: cache-mover: msm: rsync: [generator] recv_generator: mkdir "/proc/10313/task/1167662" failed: No such file or directory (2) Feb 7 07:34:37 bowen-lab root: cache-mover: msm: *** Skipping any contents from this failed directory *** <snip> Feb 7 07:34:39 bowen-lab root: cache-mover: msm: rsync: [sender] readdir("/sys/kernel/slab"): Input/output error (5) Feb 7 07:35:10 bowen-lab root: cache-mover: msm: Feb 7 07:35:10 bowen-lab root: cache-mover: msm: Number of files: 3,555,045 (reg: 2,915,832, dir: 409,571, link: 229,217, dev: 300, special: 125) Feb 7 07:35:10 bowen-lab root: cache-mover: msm: Number of created files: 2 (dir: 2) Feb 7 07:35:10 bowen-lab root: cache-mover: msm: Number of deleted files: 0 Feb 7 07:35:10 bowen-lab root: cache-mover: msm: Number of regular files transfe My setup: Media Server Rewrites: /mnt/user/media:/mnt/user/media Media Server Mode: Multiple Docker Map: /mnt/user/media:/mnt/user/media
-
unraid version: 7.2.0 beta 3. Unraid Connect: 2025.09.30.2123 My WAN IP is dynamic, it changes weekly. Connect plug show the old FQDN WAN IP, so I cannot remote control from outside.
-
Do you use the zfs pool or zfs formatted disk in array? If you use zfs disk in array, then it works the same with xfs format. Target Pool is cache. But I need a option to define the source pool/disk. From my understanding, current script only check /mnt/disk*.
-
alturismo Supporting ZFS shouldn’t be too complicated. ZFS pools work the same way as cache pools, except that their names can be customized. Other than that, there are no differences. Would it be possible to add support for ZFS pools in the next beta release? In my unraid, only one zfs pool. Name is zfs. User can add more zfs pools with different name. ls -la /mnt drwxrwxrwx 1 root root 98 Jun 5 17:06 cache/ drwxrwxrwx 1 root root 98 Jun 5 17:06 user/ drwxrwxrwx 6 root root 6 May 16 15:36 zfs/
-
Good to hear it is on the todo list. I'm glad to be a beta tester to experience it for the first time
-
Any update for ZFS pool support? I hit some clean up issue when using my modified script.
-
logs.json Hit the same issue. I am not able to login/resign again.
-
Hit the same issue.
-
@alturismo Updated: My setting: /mnt/zfs/media/Movies /mnt/user/media/Movies #primary storage on cache pool, secondary storage on zfs pool. docker map as below, so I set it rewrite_source="/data:/mnt/user/media" /data/tvshows:/mnt/user/media/Shows/ /data/movies:/mnt/user/media/Movies/ /data/music:/mnt/user/media/Musics/ 1. csrf_token issue resolved. I removed Mover Tuning Ignore List filepath and keep it empty, it is not correct. Just keep default setting. 2. /mnt/disk* issue resolved. I checked usr/local/emhttp/plugins/cache-mover/scripts/cache_mover1 for media only mode. line 91, /mnt/disk* is hard code. Manually change to /mnt/zfs, then move to cache successful. CACHE MOVER LOG Apr 8 17:30:03 Bovin-lab root: cache-mover: msm: find: ‘/mnt/disk*’: No such file or directory >>>Since using zfs pool, so no any disks. Apr 8 17:30:03 Bovin-lab root: cache-mover: msm: not matching Movies|Shows, breaking here [unresolved issue]3. During steam switched, I saw below syslog, it seems still have some issue. Apr 8 22:26:40 Bovin-lab root: cache-mover: msm: /mnt/cache/media/tvshows/The.Kite.S01.2160p.iQIYI.WEB-DL.AAC2.0.H.265-MWeb/The.Kite.S01E36.2160p.iQIYI.WEB-DL.AAC2.0.H.265-MWeb.mkv Apr 8 22:26:42 Bovin-lab root: cache-mover: msm: ready to switch live Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: -: No such file or directory.>>>>> Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: (gdb) Attaching to process 6625 Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [New LWP 586165] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [New LWP 514185] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [New LWP 12552] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [New LWP 12512] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [New LWP 9471] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [New LWP 7318] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [New LWP 6628] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [New LWP 6627] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [Thread debugging using libthread_db enabled] Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: Using host libthread_db library "/lib64/libthread_db.so.1". Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: 0x000014a20ee5298e in __syscall_cancel_arch () from /lib64/libc.so.6 Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: (gdb) $1 = 22 Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: (gdb) $2 = 23 Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: (gdb) $3 = 0 Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: (gdb) Detaching from program: /usr/libexec/unraid/shfs, process 6625 Apr 8 22:26:44 Bovin-lab root: cache-mover: msm: [Inferior 1 (process 6625) detached] Apr 8 22:28:15 Bovin-lab emhttpd: spinning down /dev/sdb
-
[Cache-mover] Thanks for creating this plugin, it is very useful. After I setting and apply, I got below error on the plugin. I am not able to edit or change anything. Apr 8 16:18:11 Bovin-lab webGUI: error: /update.php - missing csrf_token Would you help on this? I am using user share and a media folder. primary storage is cache, secondary is zfs pool. It is the same as stand array method, so do not need mergerfs. Right? cachemoversettings
-
Good idea !!
-
Thanks for help. How to find which plugin causes this? Attachment is diagnostics file after boot up. bovin-lab-diagnostics-20241117-2240.zip
-
rc. local: Installing /boot/extra packages rc. local: Installing plugins Is it related to github download? How to skip Internet download during boot up
-
I inserted a new disk, then created a new ZFS pool. When I formatted the new disk, then unraid stucking here. ug 30 21:41:20 Bovin-lab nginx: 2024/08/30 21:41:20 [alert] 140175#140175: *107055 open socket #27 left in connection 15 Aug 30 21:41:20 Bovin-lab nginx: 2024/08/30 21:41:20 [alert] 140175#140175: *107057 open socket #28 left in connection 16 Aug 30 21:41:20 Bovin-lab nginx: 2024/08/30 21:41:20 [alert] 140175#140175: *107093 open socket #19 left in connection 18 Aug 30 21:41:20 Bovin-lab nginx: 2024/08/30 21:41:20 [alert] 140175#140175: *107045 open socket #20 left in connection 21 Aug 30 21:41:20 Bovin-lab nginx: 2024/08/30 21:41:20 [alert] 140175#140175: aborting Aug 30 21:41:22 Bovin-lab kernel: mdcmd (40): nocheck pause Aug 30 21:41:24 Bovin-lab emhttpd: creating volume: entertain (zfs) Aug 30 21:41:24 Bovin-lab emhttpd: writing GPT on disk (sde), with partition 1 byte offset 32KiB, erased: 0 Aug 30 21:41:24 Bovin-lab emhttpd: shcmd (9988): sgdisk -Z /dev/sde Aug 30 21:41:26 Bovin-lab root: Creating new GPT entries in memory. Aug 30 21:41:26 Bovin-lab root: GPT data structures destroyed! You may now partition the disk using fdisk or Aug 30 21:41:26 Bovin-lab root: other utilities. Aug 30 21:41:26 Bovin-lab emhttpd: shcmd (9989): sgdisk -o -a 8 -n 1:32K:0 /dev/sde Aug 30 21:41:27 Bovin-lab root: Creating new GPT entries in memory. Aug 30 21:41:27 Bovin-lab root: The operation has completed successfully. Aug 30 21:41:27 Bovin-lab kernel: sde: sde1 Aug 30 21:41:28 Bovin-lab emhttpd: re-reading (sde) partition table Aug 30 21:41:28 Bovin-lab kernel: sde: sde1 Aug 30 21:41:28 Bovin-lab emhttpd: shcmd (9990): udevadm settle Aug 30 21:41:28 Bovin-lab kernel: sde: sde1 Aug 30 21:41:28 Bovin-lab emhttpd: shcmd (9991): /sbin/wipefs -af /dev/sde1 Aug 30 21:41:28 Bovin-lab emhttpd: error: mkmbr, 2298: Is a directory (21): open: /dev/ Aug 30 21:41:28 Bovin-lab emhttpd: shcmd (9992): udevadm settle Aug 30 21:41:28 Bovin-lab kernel: emhttpd[447788]: segfault at 628 ip 0000000000412f62 sp 00001481d95ffb30 error 4 in emhttpd[404000+1a7000] likely on CPU 3 (core 1, socket 0) Aug 30 21:41:28 Bovin-lab kernel: Code: 00 ba 5c 38 5b 00 be e8 dd 5a 00 bf 03 00 00 00 b8 00 00 00 00 e8 3e 12 ff ff c7 45 fc ff ff ff ff e9 f1 06 00 00 48 8b 45 f0 <48> 8b 90 28 06 00 00 48 8b 4d e8 8b 45 dc 48 89 ce 89 c7 e8 06 14 Unable to stop array.
-
This works. Thank you. I tried manually add /boot/config/modprobe.d/zfs.conf, but it is missing after reboot.
-
Is it possible to map a ZFS pool to docker container? Currently, I found only ZFS dataset can map to a docker container, it is not convenience. Unraid 7.0 beta 2, Docker runs on a xfs cache pool. Any difference if docker runs on ZFS pool directly?
-
Thanks for comments.
-
I using it from 6.9, then upgrade, upgrade, upgrade. Now it is 7.0 beta2. I would like to move to ZFS without array. Any profits to do fresh install unraid?
-
Aug 16 09:53:15 Bovin-lab kernel: ------------[ cut here ]------------ Aug 16 09:53:15 Bovin-lab kernel: Can't encode file handler for inotify: 255 Aug 16 09:53:15 Bovin-lab kernel: WARNING: CPU: 3 PID: 2666767 at fs/notify/fdinfo.c:55 show_mark_fhandle+0x79/0xe8 Aug 16 09:53:15 Bovin-lab kernel: Modules linked in: xt_nat xt_tcpudp veth xt_conntrack nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype br_netfilter xt_MASQUERADE ip6table_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 md_mod zfs(PO) spl(O) ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs af_packet 8021q garp mrp bridge stp llc bonding tls intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel i915 kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 aesni_intel crypto_simd cryptd iosf_mbi drm_buddy ttm mei_pxp mei_hdcp i2c_algo_bit rapl intel_cstate drm_display_helper mei_me intel_uncore nvme input_leds drm_kms_helper e1000e nvme_core joydev led_class ahci mei i2c_i801 drm i2c_smbus libahci video wmi backlight intel_gtt agpgart i2c_core button acpi_pad Aug 16 09:53:15 Bovin-lab kernel: CPU: 3 PID: 2666767 Comm: lsof Tainted: P U O 6.8.12-Unraid #3 Aug 16 09:53:15 Bovin-lab kernel: Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./H310CM-ITX/ac, BIOS P4.10 05/14/2019 Aug 16 09:53:15 Bovin-lab kernel: RIP: 0010:show_mark_fhandle+0x79/0xe8 Aug 16 09:53:15 Bovin-lab kernel: Code: ff 00 00 00 89 c1 74 04 85 c0 79 22 80 3d 0a 40 2c 01 00 75 5e 89 ce 48 c7 c7 4b 4a 27 82 c6 05 f8 3f 2c 01 01 e8 23 28 d8 ff <0f> 0b eb 45 89 44 24 0c 8b 44 24 04 48 89 ef 31 db 48 c7 c6 89 4a Aug 16 09:53:15 Bovin-lab kernel: RSP: 0018:ffffc90007bd7c30 EFLAGS: 00010282 Aug 16 09:53:15 Bovin-lab kernel: RAX: 0000000000000000 RBX: ffff888130afb680 RCX: 0000000000000027 Aug 16 09:53:15 Bovin-lab kernel: RDX: 0000000082440510 RSI: ffffffff82258ed4 RDI: 00000000ffffffff Aug 16 09:53:15 Bovin-lab kernel: RBP: ffff888107bcd708 R08: 0000000000000000 R09: ffffffff82440510 Aug 16 09:53:15 Bovin-lab kernel: R10: 00007fffffffffff R11: 0000000000000000 R12: ffff888107bcd708 Aug 16 09:53:15 Bovin-lab kernel: R13: ffff888107bcd708 R14: ffffffff812f1e37 R15: ffff888100259278 Aug 16 09:53:15 Bovin-lab kernel: FS: 000014693a1c8f00(0000) GS:ffff888856380000(0000) knlGS:0000000000000000 Aug 16 09:53:15 Bovin-lab kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 16 09:53:15 Bovin-lab kernel: CR2: 0000000000483aa0 CR3: 000000022a7c8001 CR4: 00000000003706f0 Aug 16 09:53:15 Bovin-lab kernel: Call Trace: Aug 16 09:53:15 Bovin-lab kernel: <TASK> Aug 16 09:53:15 Bovin-lab kernel: ? __warn+0x99/0x11a Aug 16 09:53:15 Bovin-lab kernel: ? report_bug+0xdb/0x155 Aug 16 09:53:15 Bovin-lab kernel: ? show_mark_fhandle+0x79/0xe8 Aug 16 09:53:15 Bovin-lab kernel: ? handle_bug+0x3c/0x63 Aug 16 09:53:15 Bovin-lab kernel: ? exc_invalid_op+0x13/0x60 Aug 16 09:53:15 Bovin-lab kernel: ? asm_exc_invalid_op+0x16/0x20 Aug 16 09:53:15 Bovin-lab kernel: ? __pfx_inotify_fdinfo+0x10/0x10 Aug 16 09:53:15 Bovin-lab kernel: ? show_mark_fhandle+0x79/0xe8 Aug 16 09:53:15 Bovin-lab kernel: ? __pfx_inotify_fdinfo+0x10/0x10 Aug 16 09:53:15 Bovin-lab kernel: ? seq_vprintf+0x33/0x49 Aug 16 09:53:15 Bovin-lab kernel: ? seq_printf+0x53/0x6e Aug 16 09:53:15 Bovin-lab kernel: ? preempt_latency_start+0x2b/0x46 Aug 16 09:53:15 Bovin-lab kernel: inotify_fdinfo+0x83/0xaa Aug 16 09:53:15 Bovin-lab kernel: show_fdinfo.isra.0+0x63/0xab Aug 16 09:53:15 Bovin-lab kernel: seq_show+0x151/0x172 Aug 16 09:53:15 Bovin-lab kernel: seq_read_iter+0x16e/0x353 Aug 16 09:53:15 Bovin-lab kernel: ? do_filp_open+0x8e/0xb8 Aug 16 09:53:15 Bovin-lab kernel: seq_read+0xe2/0x109 Aug 16 09:53:15 Bovin-lab kernel: vfs_read+0xa3/0x197 Aug 16 09:53:15 Bovin-lab kernel: ? __do_sys_newfstat+0x35/0x5c Aug 16 09:53:15 Bovin-lab kernel: ksys_read+0x76/0xc2 Aug 16 09:53:15 Bovin-lab kernel: do_syscall_64+0x6c/0xdc Aug 16 09:53:15 Bovin-lab kernel: entry_SYSCALL_64_after_hwframe+0x78/0x80 Aug 16 09:53:15 Bovin-lab kernel: RIP: 0033:0x14693a4575cd Aug 16 09:53:15 Bovin-lab kernel: Code: 41 48 0e 00 f7 d8 64 89 02 b8 ff ff ff ff eb bb 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 80 3d 59 cc 0e 00 00 74 17 31 c0 0f 05 <48> 3d 00 f0 ff ff 77 5b c3 66 2e 0f 1f 84 00 00 00 00 00 48 83 ec Aug 16 09:53:15 Bovin-lab kernel: RSP: 002b:00007ffc3c82f1e8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 Aug 16 09:53:15 Bovin-lab kernel: RAX: ffffffffffffffda RBX: 000000000043f600 RCX: 000014693a4575cd Aug 16 09:53:15 Bovin-lab kernel: RDX: 0000000000000400 RSI: 0000000000446de0 RDI: 0000000000000007 Aug 16 09:53:15 Bovin-lab kernel: RBP: 000014693a53b230 R08: 0000000000000001 R09: 0000000000000000 Aug 16 09:53:15 Bovin-lab kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 000014693a53b0e0 Aug 16 09:53:15 Bovin-lab kernel: R13: 0000000000001000 R14: 0000000000000000 R15: 000000000043f600 Aug 16 09:53:15 Bovin-lab kernel: </TASK> Aug 16 09:53:15 Bovin-lab kernel: ---[ end trace 0000000000000000 ]--- Aug 16 09:54:35 Bovin-lab kernel: docker0: port 2(vethf82f4a3) entered disabled state Aug 16 09:54:35 Bovin-lab kernel: vethc6875ef: renamed from eth0 Aug 16 09:54:35 Bovin-lab kernel: docker0: port 2(vethf82f4a3) entered disabled state Aug 16 09:54:35 Bovin-lab kernel: vethf82f4a3 (unregistering): left allmulticast mode Aug 16 09:54:35 Bovin-lab kernel: vethf82f4a3 (unregistering): left promiscuous mode Aug 16 09:54:35 Bovin-lab kernel: docker0: port 2(vethf82f4a3) entered disabled state Aug 16 09:54:35 Bovin-lab kernel: docker0: port 2(vethbd9784b) entered blocking state Aug 16 09:54:35 Bovin-lab kernel: docker0: port 2(vethbd9784b) entered disabled state Aug 16 09:54:35 Bovin-lab kernel: vethbd9784b: entered allmulticast mode Aug 16 09:54:35 Bovin-lab kernel: vethbd9784b: entered promiscuous mode Aug 16 09:54:37 Bovin-lab kernel: eth0: renamed from veth3b56d5f Aug 16 09:54:37 Bovin-lab kernel: docker0: port 2(vethbd9784b) entered blocking state Aug 16 09:54:37 Bovin-lab kernel: docker0: port 2(vethbd9784b) entered forwarding state
-
After upgrade from 6.11.X to 6.12.X, the disk spin up more frequently. I enable monitor, but I did not find any record during disk spin up timestamp. Any suggestion?
-
Hi JorgeB, Thanks for reply. How to avoid hit this? I would like to upgrade again. Should I try a fresh install?
-
The problem is isolated to btrfs superblock broken. Fix this by use backup superblock. But I am afraid that I hit this again if upgrade to 6.10.2 root@Bovin-lab:/mnt# btrfs check /dev/nvme0n1p1 Opening filesystem to check... No valid Btrfs found on /dev/nvme0n1p1 ERROR: cannot open file system root@Bovin-lab:/mnt# btrfs check -s 1 /dev/nvme0n1p1 using SB copy 1, bytenr 67108864 Opening filesystem to check... Checking filesystem on /dev/nvme0n1p1 UUID: 1e4f3935-8a24-49dd-9fea-6b7a7d4b2fac [1/7] checking root items [2/7] checking extents [3/7] checking free space tree ^[[B[4/7] checking fs roots [5/7] checking only csums items (without verifying data) [6/7] checking root refs [7/7] checking quota groups skipped (not enabled on this FS) found 29662449664 bytes used, no error found total csum bytes: 28911732 total tree bytes: 56836096 total fs tree bytes: 15187968 total extent tree bytes: 7110656 btree space waste bytes: 9062485 file data blocks allocated: 311883104256 referenced 28859248640 root@Bovin-lab:/mnt# btrfs-select-super -s 1 /dev/nvme0n1p1 >>>>>>>>>before overwrite, confirm backup superblock is good. using SB copy 1, bytenr 67108864
-
I rolled back to 6.10-RC3 by replace all files from backup to flash, but he problem is persisted.
