Interstellar Posted September 12, 2023 Share Posted September 12, 2023 Finally getting round to re-upgrading to 6.12 from 6.11.5 with the ZFS plugin. I've got a very basic ZFS disk: sdh 8:112 0 12.7T 0 disk ├─sdh1 8:113 0 12.7T 0 part └─sdh9 8:121 0 8M 0 part I start with it not mounted after a reboot: zpool status no pools available But I am struggling to import, followed a few guides with no success even though half way through the mount it is actually mounted and I can see the data. Sep 12 22:28:54 TOWER emhttpd: mounting /mnt/master Sep 12 22:28:54 TOWER emhttpd: shcmd (630): mkdir -p /mnt/master Sep 12 22:28:54 TOWER emhttpd: shcmd (631): mount -t xfs -o noatime,nouuid /dev/sdh1 /mnt/master Sep 12 22:28:54 TOWER root: mount: /mnt/master: wrong fs type, bad option, bad superblock on /dev/sdh1, missing codepage or helper program, or other error. Sep 12 22:28:54 TOWER kernel: XFS (sdh1): Invalid superblock magic number Sep 12 22:28:54 TOWER root: dmesg(1) may have more information after failed mount system call. Sep 12 22:28:54 TOWER emhttpd: shcmd (631): exit status: 32 Sep 12 22:28:54 TOWER emhttpd: /mnt/master: no btrfs or device /dev/sdh1 is not single Sep 12 22:28:54 TOWER emhttpd: /usr/sbin/zpool import -d /dev/sdh1 2>&1 Sep 12 22:28:54 TOWER emhttpd: pool: master Sep 12 22:28:54 TOWER emhttpd: id: 735173779397214344 Sep 12 22:28:54 TOWER emhttpd: shcmd (632): /usr/sbin/zpool import -N -o autoexpand=on -d /dev/sdh1 735173779397214344 master Sep 12 22:28:57 TOWER emhttpd: /usr/sbin/zpool status -PL master 2>&1 Sep 12 22:28:57 TOWER emhttpd: pool: master Sep 12 22:28:57 TOWER emhttpd: state: ONLINE Sep 12 22:28:57 TOWER emhttpd: config: Sep 12 22:28:57 TOWER emhttpd: NAME STATE READ WRITE CKSUM Sep 12 22:28:57 TOWER emhttpd: master ONLINE 0 0 0 Sep 12 22:28:57 TOWER emhttpd: /dev/sdh1 ONLINE 0 0 0 Sep 12 22:28:57 TOWER emhttpd: errors: No known data errors Sep 12 22:28:57 TOWER emhttpd: shcmd (633): /usr/sbin/zfs set mountpoint=/mnt/master master Sep 12 22:30:14 TOWER emhttpd: shcmd (636): /usr/sbin/zfs set atime=off master Sep 12 22:30:14 TOWER emhttpd: shcmd (637): /usr/sbin/zfs mount master Sep 12 22:30:14 TOWER root: cannot mount 'master': filesystem already mounted Sep 12 22:31:31 TOWER emhttpd: shcmd (637): exit status: 1 Sep 12 22:31:31 TOWER emhttpd: master: mount error: 1 Sep 12 22:31:31 TOWER emhttpd: shcmd (641): /usr/sbin/zpool export master Sep 12 22:32:48 TOWER emhttpd: shcmd (645): mount -t reiserfs -o noatime,user_xattr,acl /dev/sdh1 /mnt/master Sep 12 22:32:48 TOWER kernel: REISERFS warning (device sdh1): sh-2021 reiserfs_fill_super: can not find reiserfs on sdh1 Sep 12 22:32:48 TOWER root: mount: /mnt/master: wrong fs type, bad option, bad superblock on /dev/sdh1, missing codepage or helper program, or other error. Sep 12 22:32:48 TOWER root: dmesg(1) may have more information after failed mount system call. Sep 12 22:32:48 TOWER emhttpd: shcmd (645): exit status: 32 Sep 12 22:32:48 TOWER emhttpd: /mnt/master mount error: Unsupported or no file system Sep 12 22:32:48 TOWER emhttpd: shcmd (646): rmdir /mnt/master Sep 12 22:32:49 TOWER emhttpd: shcmd (647): /usr/sbin/zfs mount -a What is going on? Quote Link to comment
JorgeB Posted September 13, 2023 Share Posted September 13, 2023 10 hours ago, Interstellar said: What is going on? Good question, strange one. 10 hours ago, Interstellar said: Sep 12 22:30:14 TOWER root: cannot mount 'master': filesystem already mounted Post the output of zfs list and zfs mount Quote Link to comment
Interstellar Posted September 13, 2023 Author Share Posted September 13, 2023 zfs list: no datasets available zfs mount: blank Insightful 😄 Quote Link to comment
JorgeB Posted September 14, 2023 Share Posted September 14, 2023 And zfs get all master Quote Link to comment
Interstellar Posted September 14, 2023 Author Share Posted September 14, 2023 (edited) Cannot open master dataset does not exist. Something has occurred to me and that is the disk in 6.11.5 automatically mounted at boot (even before array start) is there a ZFS flag that I may have set and forgot that automatically mounts disks and when 6.12 imports it that flag mounts it? Edited September 14, 2023 by Interstellar Quote Link to comment
JorgeB Posted September 14, 2023 Share Posted September 14, 2023 38 minutes ago, Interstellar said: Cannot open master dataset does not exist. Forgot that the pool needs to be imported first for that to work, does a manual pool import work? zpool import master if it does then zfs get all master Quote Link to comment
Interstellar Posted September 14, 2023 Author Share Posted September 14, 2023 (edited) Took a while (disk spinning up I think) NAME PROPERTY VALUE SOURCE master type filesystem - master creation Mon Jul 24 19:08 2023 - master used 9.07T - master available 3.52T - master referenced 104K - master compressratio 1.01x - master mounted yes - master quota none default master reservation none default master recordsize 128K default master mountpoint /mnt/master local master sharenfs on local master checksum on default master compression lz4 local master atime off local master devices on default master exec on default master setuid on default master readonly off default master zoned off default master snapdir hidden default master aclmode discard default master aclinherit restricted default master createtxg 1 - master canmount on default master xattr on default master copies 1 default master version 5 - master utf8only off - master normalization none - master casesensitivity sensitive - master vscan off default master nbmand off default master sharesmb off default master refquota none default master refreservation none default master guid 5678621045851606521 - master primarycache all default master secondarycache all default master usedbysnapshots 0B - master usedbydataset 104K - master usedbychildren 9.07T - master usedbyrefreservation 0B - master logbias latency default master objsetid 54 - master dedup off default master mlslabel none default master sync disabled local master dnodesize legacy default master refcompressratio 1.00x - master written 104K - master logicalused 9.23T - master logicalreferenced 46K - master volmode default default master filesystem_limit none default master snapshot_limit none default master filesystem_count none default master snapshot_count none default master snapdev hidden default master acltype off default master context none default master fscontext none default master defcontext none default master rootcontext none default master relatime off default master redundant_metadata all default master overlay on default master encryption off default master keylocation none default master keyformat none default master pbkdf2iters 0 default master special_small_blocks 0 default Disk is now mounted and data is visible. Edited September 14, 2023 by Interstellar Quote Link to comment
JorgeB Posted September 14, 2023 Share Posted September 14, 2023 23 minutes ago, Interstellar said: master sharenfs on IIRC this setting is incompatible with Unraid, type zfs set sharenfs=off master then zpool export master now start (or re-start) the array to see if Unraid can mount it, if still not post new diags. Quote Link to comment
Interstellar Posted September 14, 2023 Author Share Posted September 14, 2023 (edited) Progress! Thanks - we're now mounted and working, but the startup of the array is so long that I'm getting GUI timeout errors.. Sep 14 12:37:02 TOWER emhttpd: /usr/sbin/zpool import -d /dev/sdh1 2>&1 Sep 14 12:37:03 TOWER emhttpd: pool: master Sep 14 12:37:03 TOWER emhttpd: id: 735173779397214344 Sep 14 12:37:03 TOWER emhttpd: shcmd (634497): /usr/sbin/zpool import -N -o autoexpand=on -d /dev/sdh1 735173779397214344 master Sep 14 12:37:05 TOWER emhttpd: /usr/sbin/zpool status -PL master 2>&1 Sep 14 12:37:05 TOWER emhttpd: pool: master Sep 14 12:37:05 TOWER emhttpd: state: ONLINE Sep 14 12:37:05 TOWER emhttpd: config: Sep 14 12:37:05 TOWER emhttpd: NAME STATE READ WRITE CKSUM Sep 14 12:37:05 TOWER emhttpd: master ONLINE 0 0 0 Sep 14 12:37:05 TOWER emhttpd: /dev/sdh1 ONLINE 0 0 0 Sep 14 12:37:05 TOWER emhttpd: errors: No known data errors Sep 14 12:37:05 TOWER emhttpd: shcmd (634498): /usr/sbin/zfs set mountpoint=/mnt/master master Sep 14 12:37:05 TOWER emhttpd: shcmd (634499): /usr/sbin/zfs set atime=off master Sep 14 12:37:05 TOWER emhttpd: shcmd (634500): /usr/sbin/zfs mount master Sep 14 12:39:01 TOWER emhttpd: shcmd (634505): /usr/sbin/zpool set autotrim=off master Sep 14 12:39:01 TOWER emhttpd: shcmd (634506): /usr/sbin/zfs set compression=off master Sep 14 12:39:01 TOWER emhttpd: shcmd (634507): /usr/sbin/zfs mount -a Sep 14 12:39:58 TOWER nginx: 2023/09/14 12:39:58 [error] 12456#12456: *255109 upstream timed out (110: Connection timed out) while reading upstream, client: 10.10.1.110, server: , request: "POST /update.htm HTTP/1.1", upstream: "http://unix:/var/run/emhttpd.socket:/update.htm", host: "TOWER.local", referrer: "http://TOWER.local/Main" Sep 14 12:40:57 TOWER emhttpd: shcmd (634512): sync Sep 14 12:40:57 TOWER emhttpd: shcmd (634513): mkdir /mnt/user0 Sep 14 12:40:57 TOWER emhttpd: shcmd (634514): /usr/local/bin/shfs /mnt/user0 -disks 14 -o default_permissions,allow_other,noatime Sep 14 12:40:57 TOWER shfs: FUSE library version 3.12.0 Sep 14 12:40:57 TOWER emhttpd: shcmd (634515): mkdir /mnt/user Sep 14 12:40:57 TOWER emhttpd: shcmd (634516): /usr/local/bin/shfs /mnt/user -disks 15 -o default_permissions,allow_other,noatime -o remember=0 Used to take about 2 minutes from the start button to having internet (Opnsense VM) running again, now it takes the best part of 10m. That section above is 3 minutes on its own. Why has adding the ZFS disk slowed the process down so much? Edit: Problem two is now I've got two NFS shares I cannot get rid of which is preventing me mounting the folders rather than the top level master drive. I think its because there are spaces? Export list for TOWER: /mnt/master/Working * <--- Not in /etc/exports /mnt/master/Mac (everyone) <--- Not in /etc/exports /mnt/user/Working-Data ....<IPs>.... /mnt/master ....<IPs>.... /mnt/cache ....<IPs>.... /mnt/disk1 ...<IPs>.... zfs get sharenfs NAME PROPERTY VALUE SOURCE master sharenfs off local master/Mac HD 2 sharenfs off inherited from master master/Mac HD 3 sharenfs off inherited from master master/Working Files sharenfs off inherited from master Edit 2: Edited: nano /etc/exports.d/zfs.exports and removed all the entries. Ran exportfs -r, and the entries are gone. But: rpc.mountd[31793]: request to export directory /mnt/master/Mac HD 2 below nearest filesystem /mnt/master ?? Edited September 14, 2023 by Interstellar Quote Link to comment
JorgeB Posted September 14, 2023 Share Posted September 14, 2023 Reboot, start array, post the diags (after array start) and the output of: zfs list and zfs mount Quote Link to comment
Interstellar Posted September 21, 2023 Author Share Posted September 21, 2023 (edited) Restarted... As requested: zfs list NAME USED AVAIL REFER MOUNTPOINT master 9.11T 3.48T 104K /mnt/master master/Mac HD 2 3.94T 3.48T 3.94T /mnt/master/Mac HD 2 master/Mac HD 3 5.09T 3.48T 5.09T /mnt/master/Mac HD 3 master/Working Files 76.8G 3.48T 76.8G /mnt/master/Working Files zfs mount master /mnt/master master/Mac HD 3 /mnt/master/Mac HD 3 master/Working Files /mnt/master/Working Files master/Mac HD 2 /mnt/master/Mac HD 2 showmount -e Export list for TOWER-NAS: /mnt/master <IP list> /mnt/cache <IP list> /mnt/disk1 <IP list> Trying to mount via the command that worked in 6.11.5: mount -t nfs TOWER-NAS.local:"/mnt/master/Mac HD 2" "/Volumes/Mac HD 2" rpc.mountd[12392]: authenticated mount request from IP:870 for /mnt/master/Mac HD 3 (/mnt/master) rpc.mountd[12392]: request to export directory /mnt/master/Mac HD 3 below nearest filesystem /mnt/master Master is setup as Private and: <IP>(sec=sys,rw,anongid=100,anonuid=99,all_squash) Thanks Edited September 21, 2023 by Interstellar Quote Link to comment
JorgeB Posted September 21, 2023 Share Posted September 21, 2023 Missed that the issue now was with nfs, I'm really not familiar with nfs, @dlandonis this something you can help with? Quote Link to comment
dlandon Posted September 21, 2023 Share Posted September 21, 2023 Post diagnostics. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.