nars Posted March 24, 2013 Share Posted March 24, 2013 Seems to be: ------------------------------------ cat /etc/unraid-version = version=5.0-rc12a cat /etc/slackware-version = Slackware 13.1.0 cat /proc/version = Linux version 3.4.36-unRAID (root@Develop) (gcc version 4.4.4 (GCC) ) #1 SMP Wed Mar 20 12:54:40 PDT 2013 ------------------------------------ Sorry if its a stupid question, Isnt Slackware 13.1.0 based on Linux 2.6.29 kernel and GCC 4.3.3, is mixing Slack, Kernel, GCC supported? GCC on slackware 13.1 is 4.4.4, guess Tom only updated kernel, for some good reason... Link to comment
madburg Posted March 24, 2013 Share Posted March 24, 2013 Mar 24 17:14:13 PNTower shfs/user: shfs_mkdir: create_path: /mnt/cache/Kids Movies Kids Movies/Cat in the Hat Up & Away (2011)/.AppleDouble /mnt/disk12/Kids Movies ( Exec format error Don't know if it is the name of the directory or what...? Link to comment
madburg Posted March 24, 2013 Share Posted March 24, 2013 Running mover after that shsf error. Good by 'user0' Mar 24 17:14:13 Tower shfs/user: shfs_mkdir: create_path: /mnt/cache/Kids Movies Kids Movies/Cat in the Hat Up & Away (2011)/.AppleDouble /mnt/disk12/Kids Movies ( Exec format error Mar 24 17:20:37 Tower emhttp: shcmd (230): /usr/local/sbin/mover |& logger & Mar 24 17:20:37 Tower logger: mover started Mar 24 17:20:37 Tower logger: skipping Backup/ Mar 24 17:20:37 Tower logger: skipping Handbrake/ Mar 24 17:20:37 Tower logger: moving Kids Movies/ Mar 24 17:20:37 Tower logger: ./Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu.mkv Mar 24 17:20:37 Tower logger: .d..t...... ./ Mar 24 17:20:37 Tower logger: rsync: get_xattr_names: llistxattr("Kids Movies",1024) failed: Software caused connection abort (103) Mar 24 17:20:37 Tower logger: .d..t.....x Kids Movies/ Mar 24 17:20:37 Tower logger: rsync: get_acl: sys_acl_get_file(Kids Movies, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: rsync: failed to set times on "/mnt/user0/Kids Movies": Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: cd+++++++++ Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/ Mar 24 17:20:37 Tower logger: rsync: recv_generator: mkdir "/mnt/user0/Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu" failed: Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: *** Skipping any contents from this failed directory *** Mar 24 17:20:37 Tower logger: rsync: get_acl: sys_acl_get_file(Kids Movies, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: rsync: get_xattr_names: llistxattr("Kids Movies",1024) failed: Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: rsync: failed to set times on "/mnt/user0/Kids Movies": Transport endpoint is not connected (107) Mar 24 17:20:37 Tower kernel: shfs[6005]: segfault at 8000000 ip b749768c sp b73ef008 error 4 in libc-2.11.1.so[b7421000+15c000] Mar 24 17:20:37 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Mar 24 17:20:37 Tower logger: ./Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess III The Mystery of the Enchanted Kingdom (1998) 1080i HDTV DD5 1 MPEG2 TrollHD.nzb.gz Mar 24 17:20:37 Tower logger: rsync: change_dir#1 "/mnt/user0/" failed: Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: rsync error: errors selecting input/output files, dirs (code 3) at main.c(535) [Receiver=3.0.7] Mar 24 17:20:37 Tower logger: rsync: connection unexpectedly closed (9 bytes received so far) [sender] Mar 24 17:20:37 Tower logger: rsync error: error in rsync protocol data stream (code 12) at io.c(601) [sender=3.0.7] Mar 24 17:20:37 Tower logger: skipping NZBDrop/ Mar 24 17:20:37 Tower logger: skipping Test Movies/ Mar 24 17:20:37 Tower logger: skipping iDownloads/ Mar 24 17:20:37 Tower logger: mover finished This can also be found here by others http://lime-technology.com/forum/index.php?topic=20477.15 Link to comment
WeeboTech Posted March 24, 2013 Share Posted March 24, 2013 Seems to be: ------------------------------------ cat /etc/unraid-version = version=5.0-rc12a cat /etc/slackware-version = Slackware 13.1.0 cat /proc/version = Linux version 3.4.36-unRAID (root@Develop) (gcc version 4.4.4 (GCC) ) #1 SMP Wed Mar 20 12:54:40 PDT 2013 ------------------------------------ Sorry if its a stupid question, Isnt Slackware 13.1.0 based on Linux 2.6.29 kernel and GCC 4.3.3, is mixing Slack, Kernel, GCC supported? GCC on slackware 13.1 is 4.4.4, guess Tom only updated kernel, for some good reason... Thanks Guys. Link to comment
BRiT Posted March 24, 2013 Share Posted March 24, 2013 Also be sure to upgrade FUSE to 2.9.2 (unRAID 5.0rc12) instead of the default version included in Slackware (2.8.5 ?). Link to comment
madburg Posted March 24, 2013 Share Posted March 24, 2013 Reboot from my last mover crash. Changed mover (usr\local\sbin\mover) parameters for fuse to -v from -s and rsync add triple -vvv Re-ran mover: Mar 24 18:11:36 Tower emhttp: shcmd (159): chmod 777 '/mnt/cache' Mar 24 18:11:36 Tower emhttp: shcmd (160): chown nobody:users '/mnt/cache' Mar 24 18:11:37 Tower emhttp: shcmd (161): mkdir /mnt/user0 Mar 24 18:11:37 Tower emhttp: shcmd (162): /usr/local/sbin/shfs /mnt/user0 -disks 16777214 -o noatime,big_writes,allow_other,use_ino Mar 24 18:11:37 Tower emhttp: shcmd (163): mkdir /mnt/user Mar 24 18:11:37 Tower emhttp: shcmd (164): /usr/local/sbin/shfs /mnt/user -disks 16777215 2000000 -o noatime,big_writes,allow_other,use_ino Mar 24 18:11:37 Tower emhttp: shcmd (165): crontab -c /etc/cron.d - <<< "# Generated mover schedule: 40 3 * * * /usr/local/sbin/mover |& logger" Mar 24 18:11:37 Tower emhttp: shcmd (166): /usr/local/sbin/emhttp_event disks_mounted Mar 24 18:11:37 Tower emhttp_event: disks_mounted Mar 24 18:11:37 Tower emhttp: shcmd (167): :>/etc/samba/smb-shares.conf Mar 24 18:11:38 Tower emhttp: Restart SMB... Mar 24 18:11:38 Tower emhttp: shcmd (168): killall -HUP smbd Mar 24 18:11:38 Tower emhttp: shcmd (169): ps axc | grep -q rpc.mountd Mar 24 18:11:38 Tower emhttp: _shcmd: shcmd (169): exit status: 1 Mar 24 18:11:38 Tower emhttp: shcmd (170): /usr/local/sbin/emhttp_event svcs_restarted Mar 24 18:11:38 Tower emhttp_event: svcs_restarted Mar 24 18:11:58 Tower emhttp: shcmd (171): /usr/local/sbin/mover |& logger & Mar 24 18:11:58 Tower logger: mover started Mar 24 18:11:58 Tower logger: skipping Backup/ Mar 24 18:11:58 Tower logger: skipping Handbrake/ Mar 24 18:11:58 Tower logger: moving Kids Movies/ Mar 24 18:11:59 Tower logger: ./Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu.mkv Mar 24 18:11:59 Tower logger: building file list ... Mar 24 18:11:59 Tower logger: [sender] make_file(.,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu.mkv,*,0) Mar 24 18:11:59 Tower logger: done Mar 24 18:11:59 Tower logger: send_file_list done Mar 24 18:11:59 Tower logger: send_files starting Mar 24 18:11:59 Tower logger: server_recv(2) starting pid=3593 Mar 24 18:11:59 Tower logger: received 5 names Mar 24 18:11:59 Tower logger: recv_file_list done Mar 24 18:11:59 Tower logger: get_local_name count=5 /mnt/user0/ Mar 24 18:11:59 Tower logger: generator starting pid=3593 Mar 24 18:11:59 Tower logger: delta-transmission disabled for local transfer or --whole-file Mar 24 18:11:59 Tower logger: recv_generator(.,0) Mar 24 18:11:59 Tower logger: send_files(0, .) Mar 24 18:11:59 Tower logger: .d ./ Mar 24 18:11:59 Tower logger: recv_generator(Kids Movies,1) Mar 24 18:11:59 Tower logger: rsync: get_xattr_names: llistxattr("Kids Movies",1024) failed: Software caused connection abort (103) Mar 24 18:11:59 Tower logger: recv_files(5) starting Mar 24 18:11:59 Tower logger: send_files(1, Kids Movies) Mar 24 18:11:59 Tower logger: .d..t.....x Kids Movies/ Mar 24 18:11:59 Tower logger: rsync: get_acl: sys_acl_get_file(Kids Movies, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: set modtime of Kids Movies to (1364159688) Sun Mar 24 17:14:48 2013 Mar 24 18:11:59 Tower logger: rsync: failed to set times on "/mnt/user0/Kids Movies": Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: recv_generator(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu,2) Mar 24 18:11:59 Tower logger: send_files(2, Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu) Mar 24 18:11:59 Tower logger: cd+++++++++ Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/ Mar 24 18:11:59 Tower logger: rsync: recv_generator: mkdir "/mnt/user0/Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu" failed: Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: *** Skipping any contents from this failed directory *** Mar 24 18:11:59 Tower logger: recv_generator(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble,3) Mar 24 18:11:59 Tower logger: recv_generator(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu.mkv,4) Mar 24 18:11:59 Tower logger: send_files phase=1 Mar 24 18:11:59 Tower logger: generate_files phase=1 Mar 24 18:11:59 Tower logger: recv_files(.) Mar 24 18:11:59 Tower logger: recv_files(Kids Movies) Mar 24 18:11:59 Tower logger: rsync: get_acl: sys_acl_get_file(Kids Movies, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: rsync: get_xattr_names: llistxattr("Kids Movies",1024) failed: Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: set modtime of Kids Movies to (1364159688) Sun Mar 24 17:14:48 2013 Mar 24 18:11:59 Tower logger: rsync: failed to set times on "/mnt/user0/Kids Movies": Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: recv_files(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu) Mar 24 18:11:59 Tower logger: recv_files phase=1 Mar 24 18:11:59 Tower logger: generate_files phase=2 Mar 24 18:11:59 Tower logger: send_files phase=2 Mar 24 18:11:59 Tower logger: send files finished Mar 24 18:11:59 Tower logger: total: matches=0 hash_hits=0 false_alarms=0 data=0 Mar 24 18:11:59 Tower logger: recv_files phase=2 Mar 24 18:11:59 Tower logger: generate_files phase=3 Mar 24 18:11:59 Tower logger: recv_files finished Mar 24 18:11:59 Tower logger: set modtime of Kids Movies to (1364159688) Sun Mar 24 17:14:48 2013 Mar 24 18:11:59 Tower logger: generate_files finished Mar 24 18:11:59 Tower kernel: shfs[3437]: segfault at 8000000 ip b74ee68c sp b7446008 error 4 in libc-2.11.1.so[b7478000+15c000] Mar 24 18:11:59 Tower logger: Mar 24 18:11:59 Tower logger: sent 295 bytes received 22 bytes 634.00 bytes/sec Mar 24 18:11:59 Tower logger: total size is 741 speedup is 2.34 Mar 24 18:11:59 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Mar 24 18:11:59 Tower logger: [sender] _exit_cleanup(code=0, file=main.c, line=1042): about to call exit(23) Mar 24 18:11:59 Tower logger: ./Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess III The Mystery of the Enchanted Kingdom (1998) 1080i HDTV DD5 1 MPEG2 TrollHD.nzb.gz Mar 24 18:11:59 Tower logger: building file list ... Mar 24 18:11:59 Tower logger: [sender] make_file(.,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess III The Mystery of the Enchanted Kingdom (1998) 1080i HDTV DD5 1 MPEG2 TrollHD.nzb.gz,*,0) Mar 24 18:11:59 Tower logger: done Mar 24 18:11:59 Tower logger: send_file_list done Mar 24 18:11:59 Tower logger: send_files starting Mar 24 18:11:59 Tower logger: server_recv(2) starting pid=3597 Mar 24 18:11:59 Tower logger: received 5 names Mar 24 18:11:59 Tower logger: recv_file_list done Mar 24 18:11:59 Tower logger: get_local_name count=5 /mnt/user0/ Mar 24 18:11:59 Tower logger: rsync: change_dir#1 "/mnt/user0/" failed: Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: rsync error: errors selecting input/output files, dirs (code 3) at main.c(535) [Receiver=3.0.7] Mar 24 18:11:59 Tower logger: [Receiver] _exit_cleanup(code=3, file=main.c, line=535): about to call exit(3) Mar 24 18:11:59 Tower logger: rsync: connection unexpectedly closed (9 bytes received so far) [sender] Mar 24 18:11:59 Tower logger: rsync error: error in rsync protocol data stream (code 12) at io.c(601) [sender=3.0.7] Mar 24 18:11:59 Tower logger: [sender] _exit_cleanup(code=12, file=io.c, line=601): about to call exit(12) Mar 24 18:11:59 Tower logger: ./Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess III The Mystery of the Enchanted Kingdom (1998) 1080i HDTV DD5.1 MPEG2-TrollHD.txt Mar 24 18:11:59 Tower logger: building file list ... Mar 24 18:11:59 Tower logger: [sender] make_file(.,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess III The Mystery of the Enchanted Kingdom (1998) 1080i HDTV DD5.1 MPEG2-TrollHD.txt,*,0) Mar 24 18:11:59 Tower logger: done Mar 24 18:11:59 Tower logger: send_file_list done Mar 24 18:11:59 Tower logger: send_files starting Mar 24 18:11:59 Tower logger: server_recv(2) starting pid=3600 Mar 24 18:11:59 Tower logger: received 5 names Mar 24 18:11:59 Tower logger: recv_file_list done Mar 24 18:11:59 Tower logger: get_local_name count=5 /mnt/user0/ Mar 24 18:11:59 Tower logger: rsync: change_dir#1 "/mnt/user0/" failed: Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: rsync error: errors selecting input/output files, dirs (code 3) at main.c(535) [Receiver=3.0.7] Mar 24 18:11:59 Tower logger: [Receiver] _exit_cleanup(code=3, file=main.c, line=535): about to call exit(3) Mar 24 18:11:59 Tower logger: rsync: connection unexpectedly closed (9 bytes received so far) [sender] Mar 24 18:11:59 Tower logger: rsync error: error in rsync protocol data stream (code 12) at io.c(601) [sender=3.0.7] Mar 24 18:11:59 Tower logger: [sender] _exit_cleanup(code=12, file=io.c, line=601): about to call exit(12) Mar 24 18:11:59 Tower logger: ./Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/.Parent Mar 24 18:11:59 Tower logger: building file list ... Mar 24 18:11:59 Tower logger: [sender] make_file(.,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble,*,2) Mar 24 18:11:59 Tower logger: [sender] make_file(Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/.Parent,*,0) Mar 24 18:11:59 Tower logger: done Mar 24 18:11:59 Tower logger: send_file_list done Mar 24 18:11:59 Tower logger: send_files starting Mar 24 18:11:59 Tower logger: server_recv(2) starting pid=3603 Mar 24 18:11:59 Tower logger: received 5 names Mar 24 18:11:59 Tower logger: recv_file_list done Mar 24 18:11:59 Tower logger: get_local_name count=5 /mnt/user0/ Mar 24 18:11:59 Tower logger: rsync: change_dir#1 "/mnt/user0/" failed: Transport endpoint is not connected (107) Mar 24 18:11:59 Tower logger: rsync error: errors selecting input/output files, dirs (code 3) at main.c(535) [Receiver=3.0.7] Mar 24 18:11:59 Tower logger: [Receiver] _exit_cleanup(code=3, file=main.c, line=535): about to call exit(3) Mar 24 18:11:59 Tower logger: rsync: connection unexpectedly closed (9 bytes received so far) [sender] Mar 24 18:11:59 Tower logger: rsync error: error in rsync protocol data stream (code 12) at io.c(601) [sender=3.0.7] Mar 24 18:11:59 Tower logger: [sender] _exit_cleanup(code=12, file=io.c, line=601): about to call exit(12) To me it seems its strictly rsync based, as after this line its all down hill (Mar 24 18:11:59 Tower logger: rsync: get_xattr_names: llistxattr("Kids Movies",1024) failed: Software caused connection abort (103)) Stupid question time again, is rsync depended on fuser? Another great thread on this subject: http://lime-technology.com/forum/index.php?topic=20321.45 Any access via SMB after a mover crash causes a kernel panic (so that explains why sometime it kernel panic'ed for me and other times not. As when mover crash for some test I would just stop the array and reboot, no kernal panic. If after mover crashes I open say \\tower\flash then kernel panic). Link to comment
madburg Posted March 24, 2013 Share Posted March 24, 2013 Per that article (http://lime-technology.com/forum/index.php?topic=20321.45) it got me thinking about the so call 'corrupt' user share. So what I did is create an mirror image of the "Kids Movies" share, with same setting and just called it "Kids Movies2" Cut and pasted that folder mover was crashing on from "Kids Movies" into "Kids Movies2" executed mover, see attachment (syslog) Succeeded. So Now I will be using rsync to move everything from "Kids Movies" to "Kids Movies2", then delete the "Kid Movies Share and see what happens with mover against this new share with same dir/files in it. If this resolves it, outside of the tons of beta/RC upgrades on the same box I have no idea how a share gets 'corrupted' or what test can be perform that shows a status off such an unRAID share. Comparing the 2 share's .cfg files shows no difference between the two. Anyone know/can share the rsync commandline that moves and preserves all the directory and files date/times stamps, etc...? RC12aMoverKM2success.txt Link to comment
TheDragon Posted March 24, 2013 Share Posted March 24, 2013 Reboot after mover crash. I have asked this before, no answer from Tom, The question was why are there so many reads and several writes to each and every disk in the array when you first start the array including the parity drive, when no clients are attached. THis reading and writing last for about 10-15 mins. Any and every reboot of unRAID. I'm pretty sure I've seen the same behaviour in previous RC's - not related to mover crashing though. Is this not expected behaviour for unRAID? I'm not home at the moment, but can test and confirm when I return if it would help. Sent from my Nexus 7 using Tapatalk HD Are you referring to the reads and writes upon array start up? If so I investigated and noticed that if SMB is enabled and AFP is disabled this does not occur. If SMB is enabled AND AFP is enabled it does occur. I can say I'm not using AFP, I've upgraded to RC12a, disabled all addons and rebooted. These figures don't continue to increase for as long as you described (10-15 mins), but they do increase after the array is started and stop soon after. In my case the number of writes on array startup is 15 on each data disk (total of 4 data disks), and 60 on parity. I've browsed the disks but cannot find any files with a modified time that matches the array start time, or even comes close. The number of reads on array startup for each disk varies between 22-119, with no obvious correlation to amount of data on each disk. Is this normal? I do have a screenshot and syslog saved in case they are in any way helpful. Link to comment
madburg Posted March 24, 2013 Share Posted March 24, 2013 @jack0w, yes I believe I covered that later on, while testing further. With AFP disabled "writes on array startup is 15 on each data disk" is what I saw as well. With AFP enabled is where I am see the numerous reads and extra writes. I will re-check this behavior after I finish dealing with this 'corrupted' share and see if this behavior via AFP remains the same. Thanks. Link to comment
Joe L. Posted March 24, 2013 Share Posted March 24, 2013 Running mover after that shsf error. Good by 'user0' Mar 24 17:14:13 Tower shfs/user: shfs_mkdir: create_path: /mnt/cache/Kids Movies Kids Movies/Cat in the Hat Up & Away (2011)/.AppleDouble /mnt/disk12/Kids Movies ( Exec format error Mar 24 17:20:37 Tower emhttp: shcmd (230): /usr/local/sbin/mover |& logger & Mar 24 17:20:37 Tower logger: mover started Mar 24 17:20:37 Tower logger: skipping Backup/ Mar 24 17:20:37 Tower logger: skipping Handbrake/ Mar 24 17:20:37 Tower logger: moving Kids Movies/ Mar 24 17:20:37 Tower logger: ./Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu.mkv Mar 24 17:20:37 Tower logger: .d..t...... ./ Mar 24 17:20:37 Tower logger: rsync: get_xattr_names: llistxattr("Kids Movies",1024) failed: Software caused connection abort (103) Mar 24 17:20:37 Tower logger: .d..t.....x Kids Movies/ Mar 24 17:20:37 Tower logger: rsync: get_acl: sys_acl_get_file(Kids Movies, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: rsync: failed to set times on "/mnt/user0/Kids Movies": Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: cd+++++++++ Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/ Mar 24 17:20:37 Tower logger: rsync: recv_generator: mkdir "/mnt/user0/Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu" failed: Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: *** Skipping any contents from this failed directory *** Mar 24 17:20:37 Tower logger: rsync: get_acl: sys_acl_get_file(Kids Movies, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: rsync: get_xattr_names: llistxattr("Kids Movies",1024) failed: Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: rsync: failed to set times on "/mnt/user0/Kids Movies": Transport endpoint is not connected (107) Mar 24 17:20:37 Tower kernel: shfs[6005]: segfault at 8000000 ip b749768c sp b73ef008 error 4 in libc-2.11.1.so[b7421000+15c000] Mar 24 17:20:37 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Mar 24 17:20:37 Tower logger: ./Kids Movies/The Swan Princess The Mystery of the Enchanted Kingdom (1998) BRu/.AppleDouble/The Swan Princess III The Mystery of the Enchanted Kingdom (1998) 1080i HDTV DD5 1 MPEG2 TrollHD.nzb.gz Mar 24 17:20:37 Tower logger: rsync: change_dir#1 "/mnt/user0/" failed: Transport endpoint is not connected (107) Mar 24 17:20:37 Tower logger: rsync error: errors selecting input/output files, dirs (code 3) at main.c(535) [Receiver=3.0.7] Mar 24 17:20:37 Tower logger: rsync: connection unexpectedly closed (9 bytes received so far) [sender] Mar 24 17:20:37 Tower logger: rsync error: error in rsync protocol data stream (code 12) at io.c(601) [sender=3.0.7] Mar 24 17:20:37 Tower logger: skipping NZBDrop/ Mar 24 17:20:37 Tower logger: skipping Test Movies/ Mar 24 17:20:37 Tower logger: skipping iDownloads/ Mar 24 17:20:37 Tower logger: mover finished This can also be found here by others http://lime-technology.com/forum/index.php?topic=20477.15 could it be that the shfs is being handed un-quoted arguments, and the parens "(" ")" interpreted by the shell are causing it to attempt to access directories that do not exist. Link to comment
madburg Posted March 25, 2013 Share Posted March 25, 2013 @Joe L., doubt it as when I created the new share and moved that same folder into the new share and executed mover, it moved... I have been running some rsync test against the original share to copy out of it and if I have "X" in ther sync command line its craps out just the same Link to comment
TheDragon Posted March 25, 2013 Share Posted March 25, 2013 @Joe L., doubt it as when I created the new share and moved that same folder into the new share and executed mover, it moved... I have been running some rsync test against the original share to copy out of it and if I have "X" in ther sync command line its craps out just the same Not permissions related is it? Maybe worth trying newperms script, if you haven't already. Link to comment
speeding_ant Posted March 25, 2013 Share Posted March 25, 2013 No - that particular issue isn't permissions related. Link to comment
madburg Posted March 25, 2013 Share Posted March 25, 2013 I have run new permssions three times on 12a, very first when I first upgrade to 12a before doing anything else. I cant believe I need to move this much amount of data from the old share to the new. There has got to be a way to fix this eXtended attributes issue on the old share. That is were rsync bombs out. extended attributes (abbreviated xattr) when enabled in the kernel configuration. ReiserFS allow attributes of arbitrary size. There is some ongoing work[2] to support extended attributes over NFSv3. Wondering if the people having NFS issues are tied to these extended permissions (or corruption of them). Link to comment
Joe L. Posted March 25, 2013 Share Posted March 25, 2013 @Joe L., doubt it as when I created the new share and moved that same folder into the new share and executed mover, it moved... I have been running some rsync test against the original share to copy out of it and if I have "X" in ther sync command line its craps out just the same No problem... Just noticed the parens in the file names. They drive shell scripts crazy if not quoted or escaped properly. The issue then is the "shfs" user-share file system crashed... (and all the endpoint not connected messages are the result) I know Tom has been working towards figuring out why. Joe L. Link to comment
madburg Posted March 25, 2013 Share Posted March 25, 2013 Well I think I found the issue root@Tower:~# getfattr -d /mnt/user0/Documentaries getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Documentaries user.org.netatalk.supports-eas.1U3PyH=0seWVzAA== user.org.netatalk.supports-eas.bab06k=0seWVzAA== user.org.netatalk.supports-eas.cOvpBK=0seWVzAA== user.org.netatalk.supports-eas.q7E8CQ=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Home\ Movies getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Home\040Movies user.org.netatalk.supports-eas.5GAwmo=0seWVzAA== user.org.netatalk.supports-eas.6fbVNL=0seWVzAA== user.org.netatalk.supports-eas.CTSIWs=0seWVzAA== user.org.netatalk.supports-eas.DJ9beT=0seWVzAA== user.org.netatalk.supports-eas.GhTnTI=0seWVzAA== user.org.netatalk.supports-eas.LF5g06=0seWVzAA== user.org.netatalk.supports-eas.MwbD3J=0seWVzAA== user.org.netatalk.supports-eas.PwUMUR=0seWVzAA== user.org.netatalk.supports-eas.SH4WGJ=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Horror\ Movies getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Horror\040Movies user.org.netatalk.supports-eas.BBgOib=0seWVzAA== user.org.netatalk.supports-eas.H1m0jR=0seWVzAA== user.org.netatalk.supports-eas.NRKC8z=0seWVzAA== user.org.netatalk.supports-eas.QE6DJH=0seWVzAA== user.org.netatalk.supports-eas.agG26z=0seWVzAA== user.org.netatalk.supports-eas.b7x5gi=0seWVzAA== user.org.netatalk.supports-eas.hp68cn=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Kids\ Movies getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Kids\040Movies user.org.netatalk.supports-eas.1lYmFn=0seWVzAA== user.org.netatalk.supports-eas.2G0LtB=0seWVzAA== /mnt/user0/Kids\040Movies: user.org.netatalk.supports-eas.2eXc9S: Exec format er user.org.netatalk.supports-eas.3cWvbo=0seWVzAA== user.org.netatalk.supports-eas.4d0pQc=0seWVzAA== user.org.netatalk.supports-eas.4yUysY=0seWVzAA== user.org.netatalk.supports-eas.CQKb8r=0seWVzAA== user.org.netatalk.supports-eas.DSqUE9=0seWVzAA== user.org.netatalk.supports-eas.G6QpQd=0seWVzAA== user.org.netatalk.supports-eas.G8IFuQ=0seWVzAA== user.org.netatalk.supports-eas.JvUNKy=0seWVzAA== user.org.netatalk.supports-eas.Lf03uH=0seWVzAA== user.org.netatalk.supports-eas.MnOQnl=0seWVzAA== user.org.netatalk.supports-eas.ORWar2=0seWVzAA== user.org.netatalk.supports-eas.PFnyL0=0seWVzAA== user.org.netatalk.supports-eas.PHBHdt=0seWVzAA== user.org.netatalk.supports-eas.PKXuF2=0seWVzAA== user.org.netatalk.supports-eas.TKqhUX=0seWVzAA== user.org.netatalk.supports-eas.V8vUUd=0seWVzAA== user.org.netatalk.supports-eas.WA3IkU=0seWVzAA== /mnt/user0/Kids\040Movies: user.org.netatalk.supports-eas.XD8uuv: Exec format er user.org.netatalk.supports-eas.Z1wg1K=0seWVzAA== user.org.netatalk.supports-eas.Z2atwa=0seWVzAA== user.org.netatalk.supports-eas.ZRVkqs=0seWVzAA== user.org.netatalk.supports-eas.aSeCbl=0seWVzAA== user.org.netatalk.supports-eas.baF7s9=0seWVzAA== user.org.netatalk.supports-eas.cS24zT=0seWVzAA== user.org.netatalk.supports-eas.cuoI0T=0seWVzAA== user.org.netatalk.supports-eas.dRNVmH=0seWVzAA== user.org.netatalk.supports-eas.dW8lyA=0seWVzAA== user.org.netatalk.supports-eas.f9npDQ=0seWVzAA== user.org.netatalk.supports-eas.hNAMPC=0seWVzAA== user.org.netatalk.supports-eas.hSX6nP=0seWVzAA== user.org.netatalk.supports-eas.hbUwmb=0seWVzAA== user.org.netatalk.supports-eas.hbdFBB=0seWVzAA== user.org.netatalk.supports-eas.jzzIOS=0seWVzAA== user.org.netatalk.supports-eas.kOmlFV=0seWVzAA== user.org.netatalk.supports-eas.lucZkJ=0seWVzAA== user.org.netatalk.supports-eas.ohTT5x=0seWVzAA== user.org.netatalk.supports-eas.pTdfMh=0seWVzAA== user.org.netatalk.supports-eas.sKbGjg=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Kids\ Movies2 root@Tower:~# getfattr -d /mnt/user0/Kids\ TV\ Shows getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Kids\040TV\040Shows user.org.netatalk.supports-eas.5vUc2Y=0seWVzAA== user.org.netatalk.supports-eas.Bxg6jq=0seWVzAA== user.org.netatalk.supports-eas.DHEa1w=0seWVzAA== user.org.netatalk.supports-eas.cxofgx=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Kung\ Fu\ Movies/ getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Kung\040Fu\040Movies/ user.org.netatalk.supports-eas.1G35pp=0seWVzAA== user.org.netatalk.supports-eas.Bik49N=0seWVzAA== user.org.netatalk.supports-eas.CaBvhf=0seWVzAA== user.org.netatalk.supports-eas.FWt4mp=0seWVzAA== user.org.netatalk.supports-eas.JJ4ai6=0seWVzAA== user.org.netatalk.supports-eas.L39jdu=0seWVzAA== user.org.netatalk.supports-eas.McOdSC=0seWVzAA== user.org.netatalk.supports-eas.kKFj80=0seWVzAA== user.org.netatalk.supports-eas.lBLTTD=0seWVzAA== user.org.netatalk.supports-eas.mYd1Ek=0seWVzAA== user.org.netatalk.supports-eas.xJBFQQ=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Learning getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Learning user.org.netatalk.supports-eas.0b4g6E=0seWVzAA== user.org.netatalk.supports-eas.bAnwOz=0seWVzAA== user.org.netatalk.supports-eas.eZIdyp=0seWVzAA== user.org.netatalk.supports-eas.jCMprr=0seWVzAA== user.org.netatalk.supports-eas.oqeLAU=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Movies getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Movies user.org.netatalk.supports-eas.4EtKbM=0seWVzAA== user.org.netatalk.supports-eas.NcmpFy=0seWVzAA== user.org.netatalk.supports-eas.YcVowX=0seWVzAA== user.org.netatalk.supports-eas.ZJoM42=0seWVzAA== user.org.netatalk.supports-eas.maKXc7=0seWVzAA== user.org.netatalk.supports-eas.nNyusZ=0seWVzAA== user.org.netatalk.supports-eas.txW9Be=0seWVzAA== user.org.netatalk.supports-eas.w59xIQ=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Photos/ getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Photos/ user.org.netatalk.supports-eas.3uibPm=0seWVzAA== user.org.netatalk.supports-eas.FZ5XAj=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/Pictures\ Source/ getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Pictures\040Source/ user.org.netatalk.supports-eas.6m8Cgz=0seWVzAA== user.org.netatalk.supports-eas.BWXu3Y=0seWVzAA== user.org.netatalk.supports-eas.CI6WH4=0seWVzAA== user.org.netatalk.supports-eas.n3SQNQ=0seWVzAA== root@Tower:~# getfattr -d /mnt/user0/TV\ Shows/ root@Tower:~# getfattr -d /mnt/user0/Xmas\ Movies /mnt/user0/Xmas\040Movies: user.org.netatalk.supports-eas.Hfmy79: Exec format er getfattr: Removing leading '/' from absolute path names # file: mnt/user0/Xmas\040Movies user.org.netatalk.supports-eas.TfZ0kq=0seWVzAA== user.org.netatalk.supports-eas.ZgFwEy=0seWVzAA== /mnt/user0/Xmas\040Movies: user.org.netatalk.supports-eas.qb6OV5: Exec format er So as you can see I have issues/errors on 2 shares with extended attributes. Bet the mover/rsync is chocking on those! Some shares have no extended attributes. This is just checking the top level shares. So my guess is between unRAID beta's/RC and trying to get AFP working is how this happened. Anything like apple/dropbox, etc. can use/write extended attributes so this is not just AFP based. So it would seem that if I can figure out a way to wipe these extended attributes (including the ones with errors) and be able to start fresh, would be the way to go and then monitor if and when these extend attributes get written. Ex. is unRAID AFP demon/DB writing them, is my mac plex server writing them. What is the behaviour with or without nocnidcache being set.... Anyone want to take a stab on how to recursively run this against all dir/files? to see if there are any other errors further down the tree. Link to comment
speeding_ant Posted March 25, 2013 Share Posted March 25, 2013 So that's a problematic extended attribute, or just extended attributes in general? xattr -c will remove all extended attributes from a file, but this isn't an ideal solution. Link to comment
madburg Posted March 25, 2013 Share Posted March 25, 2013 So that's a problematic extended attribute, or just extended attributes in general? xattr -c will remove all extended attributes from a file, but this isn't an ideal solution. To me it seems like a problematic extended attribute(s) (in my case 4 in total; 2 on each share). Not sure if each of those lines represents an extended attribute of a file below the top root, or what i believe, which is each of those extended attributes is for the top level directory. 'xattr' command not found :'( I have been searching for the command to remove but doesn't seem like unRAID has one... Would you mind checking your top-level shares and see what if any count you have? Link to comment
mejutty Posted March 25, 2013 Share Posted March 25, 2013 Hey Jowi from this "Guess what. I've installed SimpleFeatures again (1.0.5) and the parity speed goes down to about 90 - 100MB/s... if you actually watch it IN simplefeatures gui. Once you close the simplefeatures webpage, and go back to unmenu, you will see the parity speed increase to 150MB/s again... Using the latest SimpleFeatures (1.0.11) is even worse, it basically stops the parity check with speeds from 20-30MB/s, which is unworkable." When you did the last test with latest Simplefeatures did speeds go back up to full speed when you checked via unmenu?? ie is it only present when looking via the simple features web interface?? Link to comment
speeding_ant Posted March 25, 2013 Share Posted March 25, 2013 Hey Jowi from this "Guess what. I've installed SimpleFeatures again (1.0.5) and the parity speed goes down to about 90 - 100MB/s... if you actually watch it IN simplefeatures gui. Once you close the simplefeatures webpage, and go back to unmenu, you will see the parity speed increase to 150MB/s again... Using the latest SimpleFeatures (1.0.11) is even worse, it basically stops the parity check with speeds from 20-30MB/s, which is unworkable." When you did the last test with latest Simplefeatures did speeds go back up to full speed when you checked via unmenu?? ie is it only present when looking via the simple features web interface?? Only while the gui is open, the parity check speeds go back up once you exit the GUI. I believe we have found the cause, will be providing a fix soon. Link to comment
NAS Posted March 25, 2013 Share Posted March 25, 2013 Only while the gui is open, the parity check speeds go back up once you exit the GUI. I believe we have found the cause, will be providing a fix soon. Nice work. Many people will be very happy if this is fixed. Link to comment
dikkiedirk Posted March 25, 2013 Share Posted March 25, 2013 Sorry to barge in like this. Have been reading many threads regarding RCs. This time I didn't however. I am now on RC11. Is there any benefit in upgrading to RC12 or RC12a? What is changed from RC11 to RC12 and from RC12 to RC12a? As I am on a X9SCM-F mainboard, is the slow write issue solved? Are parity checks up to speed again like in Beta12a? Link to comment
PeterB Posted March 25, 2013 Share Posted March 25, 2013 What is changed from RC11 to RC12 and from RC12 to RC12a? Release notes are linked from the first post. As I am on a X9SCM-F mainboard, is the slow write issue solved? Are parity checks up to speed again like in Beta12a? No - Tom is still trying to reproduce the problem - has ordered X9SCM and Xeon for this purpose. Link to comment
NAS Posted March 25, 2013 Share Posted March 25, 2013 Sorry to barge in like this. Have been reading many threads regarding RCs. This time I didn't however. I am now on RC11. Is there any benefit in upgrading to RC12 or RC12a? What is changed from RC11 to RC12 and from RC12 to RC12a? As I am on a X9SCM-F mainboard, is the slow write issue solved? Are parity checks up to speed again like in Beta12a? As a general rule of thumb if you decided to join a testing cycle you should keep up to date with latest unless there is a specific reason you cannot. This is not an unRAID thing but a general tester thing. Link to comment
Recommended Posts