I just migrated to 6.2, and am experiencing some very strange behavior. I will watch Sonarr download a show, and place it in /mnt/cache/media/tv/showname/season2/shownameS##E##.mkv as expected. Then the mover runs. I will sit there refreshing midnite commander, watch /mnt/user0/media/tv/showname/season2/SownameS##E##.mkv and the split second the file finished, it deletes. As if it was never there. One by one I'll watch entire season file by file start to be copied to the array and then disappears! I've lost seasons of my shows ! This is horrid! What is the problem with 6.2?

tower-diagnostics-20160929-0216.zip

Are there any errors showing in your syslog?

 

As you are the 1st person to report such a problem and there have been many people running the 6.2 betas/RC with no problems for many months before the 6.2 release it would suggest that there is something special about your configuration.    I would therefore suggest that you post your diagnostics file (Tools/Diagnostics) to allow your problem to be investigated.

 

My syslog is attached. I don't mean to come off as as an asshole, but this is seriously a huge problem, and I'm not a novice user. Any help would no doubt help me and the tons of NZBGeek users that I have helped migrate to unRAID. Any help would be appreciated for sure.

The files download to the cache drive. I can view them from there, When the mover is invoked, I watch them hit the array (/mnt/user0) and the moment the copy finishes, they disappear.

The mover is destroying all files as they move to the array and I and a ton of other users, who rely on my for their unRAID advice are having the exact same issue. Please, please help. We don't want to move from unraid, but something with the mover is destroying everything the moment it finishes copying. I have been with unraid since 4.5, and I don't wish to move, but this is a huge problem. I can't continue to work this way, and I've tried everything I know to do. It's not sonarr, I've stopped it. It's not any other docker or program because I've stopped all of them as well. When the mover moves, the moment the file copy is complete, the files vanish. I am imploring anyone for help.

 

Thanks you in advance, I've had great experience with unraid for years, but deleting my media is not acceptable. Please help

It's the new piracy protection built into unraid.... 

Is this really how you are going to treat a long time user? This is not me being a n00b, I'm asking for help for me me and a lot of others.

picture one is the download in Sab

picture 2 is from midnite commander showing the file in /mnt/cache/media/tv/showname/file.mkv

picture 3 is it showing in /mnt/user/media/media/tv/showname.mkv as it exists on the cache drive  as a symlink

picture 4 is showing the partial file as it is copied to the array to /mnt/user0

picture 5 shows it completely vanished and not found anywhere

please note the file times

 

5th picture, after unraid deleted my media

Thanks saarg, you've done a lot of good work for unRAID, but I don't believe being a smartass is part of helping. I really believed and hyped this OS up to all my friends. To be made fun of actually kind of hurts so thanks for that. Glad you're doing well and feel so superior as to basically spit on someone having an issue. Thanks for all your benevolent work.

 

You know, I've always tried to do my best to help others or make them aware of issues or help people. not belittle them. So saarg, thanks for making me feel so inferior I appreciate it very much. I thought this was a community. I'm glad you feel so superior as to make others feel stupid. If these are the types of people that are going to try to "help" then I don't think this is the place for geeks to be. I'd like an apology, at the least.

 

 

Looking in the syslog there are errors showing that there are problems setting extended attributes on the files that are being copied from your BTRFS formatted cache disk to your ReiserFS formatted data disks.

 

As an experiment can you see if you have the same problem moving files which use one of your XFS formatted data disks.

 

The mover script is just a shell script, so if you are an experienced Linux user you could try manually running the commands in it to help narrow down the problem.

I just migrated to 6.2, and am experiencing some very strange behavior. I will watch Sonarr download a show, and place it in /mnt/cache/media/tv/showname/season2/shownameS##E##.mkv as expected. Then the mover runs. I will sit there refreshing midnite commander, watch /mnt/user0/media/tv/showname/season2/SownameS##E##.mkv and the split second the file finished, it deletes. As if it was never there. One by one I'll watch entire season file by file start to be copied to the array and then disappears! I've lost seasons of my shows ! This is horrid! What is the problem with 6.2? Why can I not keep any media after the mover runs? Why is this happening?! I am losing media in droves and this is not acceptable! What is going on?! Please help! Deleting media?! This is supposed to be a distro that helps media collection and I've always been an advocate of unRAID, and this is completely and totally unacceptable. This is deleting things as they are moved?! This is atrocious. I need a remedy to this as soon as someone can help please.

 

***ALL USERS WHO CARE ABOUT THEIR COLLECTIONS, UN-MONITOR EVERYTHING YOU HAVE! YOU CAN LOSE EVERYTHING! THIS IS HORRID TO BE RELEASED AS STABLE!

 

EDIT: since upgrading requires all dockers to be replaces, I'm not going to downgrade again. unRAID said this was stable. This is completely unprofessional. I have encouraged more than 100 people to BUY licenses and now I am the one who is paying the price as I have lost their trust. I would like an answer to this yesterday. I was always a huge proponent of unRAID and now I am LOSING MY MEDIA COLLECTION due to your failures. What is the solution to this other than downgrading or moving to another OS?

 

 

I would be asking if anyone else is experiencing the issues you are having before making stupid statements like this....

 

 

Sparlyballs, at least I can get a civil comment. Thanks, and I have, and can't find any. I'm looking for help. And I have at least 8 geek users with the same issue, they just aren't active on the forum I am for them. So I don't mean to sound stupid, but this isn't just me. Search the forums fot this and you find nothing, so no I didn't just fly off the handle, I worry about the users I HAVE HELPED to move to unRAID and you're being pompous and shitty. I don't think calling people stupid may be the best way to go about it, but you do you. You've written more dockers and I respect you, it sucks to be belittled for having an issue and trying to warn others who are having the same that don't post to be called stupid. We're not all coders and docker creators. I appreciate the work you do, but please dont call me stupid for having a legit problem. I'm asking for help, and if there aren't a laundry list of issues with 6.2 then call me crazy. I LOVE unRAID, I'm just having this issue which I need help with, and I'm not stupid. Thanks again for all your hard work and courtesy

wow, remotevisitor with an actual helpful comment. THANK YOU. I will try that now.

Thanks a ton "Hero Members" your berating and trash talk was very helpful in solving my issue. These are "hero members"? Writing code helps a lot of people. Why don't you stick to that instead of berating people who have issues instead? Or *GASP* actually offer some help instead of being so shitty? I had a legit issue, which is not not just mine. So saying "do not upgrade" I do not think is in the slightest uncalled for. Why would you do this? Would you like for me to get a bunch of paid members to bring up the same issue? Would you then not berate and belittle me? I tried to be civil and you're being all high and mighty. This is a community no? Stop with this nonsense and help or shut up.

I notice that you mention that the file being copied from the cache drive is a symlink on the cache drive.  Can you give an example of the path of the symlink in case that helps shed any light on your problem.

 

Does this problem only occurring for the files created by Sab?

I am trying a manual file copy to an XFS disk now. I'll see if the problem persists. If it does not, I would suspect an issue with my system in general, or an issue with BTRFS to resierfs in 6.2. Yes these files are create by SAB, but everything seems fine. When they reside on the cache drive I can watch them, as they are moved to the array I watch the copy complete and then the files just disappear.

I will report back to you, a "regular" and "non hero" and obviously not so pompous and shitty person that you actually want to help. And I appreciate it very much

Manually copying the file to /mnt/disk6 (an XFS disk) the issue is fine. So it seems that there is some issue with 6.2 copying from BTRFS to an ResierFS disk. Where did you find this in the logfiles? Also, thanks to all the "hero users" who made fun of me and told me it was my issue and not unRAID's, because it seems it sure may be. I can swap drives and reformat everything to XFS. But according to all the "hero members' that was unnecessary. What can I do outside of reformatting to XFS to fix this issue do you think?

 

thanks again for all your hero member support

I am trying a manual file copy to an XFS disk now. I'll see if the problem persists. If it does not, I would suspect an issue with my system in general, or an issue with BTRFS to resierfs in 6.2. Yes these files are create by SAB, but everything seems fine. When they reside on the cache drive I can watch them, as they are moved to the array I watch the copy complete and then the files just disappear.

I will report back to you, a "regular" and "non hero" and obviously not so pompous and shitty person that you actually want to help. And I appreciate it very much

 

you really are an obnoxious jumped up little whiny brat.

Sparkly i have the utmost respect for you, and you've done nothing but call me "stupid" "whiny" and a "brat". Why? This is not my issue it is an unRAID issue. Why are you so quick to judge me?! I wrote a KVM mythbuntu how to and gave you the UTMOST props for doing a docker for it! And now I have a legit issue and you call me a whiny brat? Why? Shoot I even changed the thread title to "issue with BTRFS to ResierFS". What's your problem? You and saarg have both been quite rude, and in no way tried to help in the slightest. Write code, stop trying to help people in the forums if this is how you'll treat them. Again, a legit problem and I am being chastised for it. Why?

Everyone calm down, Mike, I think Saarg was just giving a one liner, no harm meant and whilst I may have put things in a different way than Sparklyballs your orginal post was rather sensationalist,

 

EDIT: OK I hadn't seen the latest round of posts, Jesus, both of you calm down, it's only a computer.... 

 

Having said all that, I understand you're stressed and feeling like you're shouldering a lot of responsibility for others you have converted to Unraid, but as a friend, these are all grown people and responsible for their own choices and decisions so I don't think you should burden yourself too much with that and worry more about getting your own system up and running.  Never good to assume that everyone has identical problems before we've got conclusive proof and all that. 

 

Also, it's worth encouraging these users to post on here for several reasons, one IF this is a widespread problem, then multiple reports will help narrow it down and nail the issue.  Secondly, they should be responsible for their own systems, if anything were to happen to you (God forbid) then they need to stand on their own two feet.  Thirdly, IF your issues aren't related then it's just delaying getting to the bottom of their issue.  Lastly, unless they're paying you for support it ain't your job. (Granted I spend a lot of time helping around here for not a penny, so I get that one is a little "pot calling the kettle black" 

 

Anyway, moving on, I'd echo what remotevisor has said after looking at your syslogs, data loss like this I haven't seen during any of the beta testing for unraid and practically living on this forum as I do, I also haven't noticed any other reports like this. 

 

ReiserFS has been known to cause some problems on V6 in general and people have found converting their disks to XFS helpful, btrfs personally I don't believe is quite ready for prime time myself, and it's one of the main reasons I'm not running a cache pool, and the only place I use it is within my docker.img and that's only because that's the only way to use docker.img.

 

So, I think we've established beyond reasonable doubt that this isn't a widespread issue, so it's probably worthwhile examining things on your setup a little more and trying to get to the bottom of things, like remotevisor says, it would be interesting to know if files not created via sabnzbd are affected and also I couldn't find the bit where you mentioned symlinks at all that remotevisor mentioned.

 

Some things in your syslog that I found

 

Not sure how relevant this is, but someone else reading the thread may be able to give an expert opinion.

Sep 29 01:05:29 Tower kernel: ata7.00: exception Emask 0x10 SAct 0x0 SErr 0x400000 action 0x6 frozen
Sep 29 01:05:29 Tower kernel: ata7.00: irq_stat 0x48000001, interface fatal error
Sep 29 01:05:29 Tower kernel: ata7: SError: { Handshk }
Sep 29 01:05:29 Tower kernel: ata7.00: failed command: WRITE DMA EXT
Sep 29 01:05:29 Tower kernel: ata7.00: cmd 35/00:40:28:57:ab/00:05:ae:00:00/e0 tag 4 dma 688128 out
Sep 29 01:05:29 Tower kernel:         res 51/84:81:e7:58:ab/00:03:ae:00:00/e0 Emask 0x10 (ATA bus error)
Sep 29 01:05:29 Tower kernel: ata7.00: status: { DRDY ERR }
Sep 29 01:05:29 Tower kernel: ata7.00: error: { ICRC ABRT }
Sep 29 01:05:29 Tower kernel: ata7: hard resetting link
Sep 29 01:05:30 Tower kernel: ata7: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
Sep 29 01:05:30 Tower kernel: ata7.00: configured for UDMA/133
Sep 29 01:05:30 Tower kernel: ata7: EH complete
Sep 29 01:05:30 Tower kernel: ata7.00: exception Emask 0x10 SAct 0x0 SErr 0x400000 action 0x6 frozen
Sep 29 01:05:30 Tower kernel: ata7.00: irq_stat 0x48000001, interface fatal error
Sep 29 01:05:30 Tower kernel: ata7: SError: { Handshk }
Sep 29 01:05:30 Tower kernel: ata7.00: failed command: WRITE DMA EXT
Sep 29 01:05:30 Tower kernel: ata7.00: cmd 35/00:d0:30:5f:ab/00:04:ae:00:00/e0 tag 21 dma 630784 out
Sep 29 01:05:30 Tower kernel:         res 51/84:71:8f:5f:ab/00:04:ae:00:00/e0 Emask 0x10 (ATA bus error)
Sep 29 01:05:30 Tower kernel: ata7.00: status: { DRDY ERR }
Sep 29 01:05:30 Tower kernel: ata7.00: error: { ICRC ABRT }
Sep 29 01:05:30 Tower kernel: ata7: hard resetting link
Sep 29 01:05:30 Tower kernel: ata7: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
Sep 29 01:05:30 Tower kernel: ata7.00: configured for UDMA/133
Sep 29 01:05:30 Tower kernel: ata7: EH complete
Sep 29 01:05:30 Tower kernel: ata7.00: exception Emask 0x10 SAct 0x0 SErr 0x400000 action 0x6 frozen
Sep 29 01:05:30 Tower kernel: ata7.00: irq_stat 0x48000001, interface fatal error
Sep 29 01:05:30 Tower kernel: ata7: SError: { Handshk }
Sep 29 01:05:30 Tower kernel: ata7.00: failed command: WRITE DMA EXT
Sep 29 01:05:30 Tower kernel: ata7.00: cmd 35/00:d0:30:5f:ab/00:04:ae:00:00/e0 tag 23 dma 630784 out
Sep 29 01:05:30 Tower kernel:         res 51/84:91:6f:60:ab/00:03:ae:00:00/e0 Emask 0x10 (ATA bus error)
Sep 29 01:05:30 Tower kernel: ata7.00: status: { DRDY ERR }
Sep 29 01:05:30 Tower kernel: ata7.00: error: { ICRC ABRT }
Sep 29 01:05:30 Tower kernel: ata7: hard resetting link
Sep 29 01:05:31 Tower kernel: ata7: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
Sep 29 01:05:31 Tower kernel: ata7.00: configured for UDMA/133
Sep 29 01:05:31 Tower kernel: ata7: EH complete
Sep 29 01:05:31 Tower kernel: ata7.00: limiting speed to UDMA/100:PIO4
Sep 29 01:05:31 Tower kernel: ata7.00: exception Emask 0x10 SAct 0x0 SErr 0x400000 action 0x6 frozen
Sep 29 01:05:31 Tower kernel: ata7.00: irq_stat 0x48000001, interface fatal error
Sep 29 01:05:31 Tower kernel: ata7: SError: { Handshk }
Sep 29 01:05:31 Tower kernel: ata7.00: failed command: WRITE DMA EXT
Sep 29 01:05:31 Tower kernel: ata7.00: cmd 35/00:28:08:64:ab/00:03:ae:00:00/e0 tag 27 dma 413696 out
Sep 29 01:05:31 Tower kernel:         res 51/84:99:97:65:ab/00:01:ae:00:00/e0 Emask 0x10 (ATA bus error)
Sep 29 01:05:31 Tower kernel: ata7.00: status: { DRDY ERR }
Sep 29 01:05:31 Tower kernel: ata7.00: error: { ICRC ABRT }
Sep 29 01:05:31 Tower kernel: ata7: hard resetting link
Sep 29 01:05:31 Tower kernel: ata7: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
Sep 29 01:05:31 Tower kernel: ata7.00: configured for UDMA/100
Sep 29 01:05:31 Tower kernel: ata7: EH complete

 

And these are the pertinent ones in terms of mover, and I suspect the cause of your issue.  Again, posting them here may help an expert give a bit more information.

Sep 29 01:20:30 Tower root: mover started
Sep 29 01:20:30 Tower root: moving "m..a" to array
Sep 29 01:20:30 Tower shfs/user0: err: shfs_setxattr: lsetxattr: system.posix_acl_access /mnt/disk1/media (22) Invalid argument
Sep 29 01:20:30 Tower shfs/user0: err: shfs_setxattr: lsetxattr: system.posix_acl_access /mnt/disk1/media/TV Shows (22) Invalid argument
Sep 29 01:20:30 Tower shfs/user0: err: shfs_setxattr: lsetxattr: system.posix_acl_access /mnt/disk1/media/TV Shows/The Strain (22) Invalid argument
Sep 29 01:20:30 Tower shfs/user0: err: shfs_setxattr: lsetxattr: system.posix_acl_access /mnt/disk1/media/TV Shows/The Strain/Season 3 (22) Invalid argument
Sep 29 01:20:30 Tower root: rsync: set_acl: sys_acl_set_file(media, ACL_TYPE_ACCESS): Invalid argument (22)
Sep 29 01:20:30 Tower root: rsync: set_acl: sys_acl_set_file(media/TV Shows, ACL_TYPE_ACCESS): Invalid argument (22)
Sep 29 01:20:30 Tower root: rsync: set_acl: sys_acl_set_file(media/TV Shows/The Strain, ACL_TYPE_ACCESS): Invalid argument (22)
Sep 29 01:20:30 Tower root: rsync: set_acl: sys_acl_set_file(media/TV Shows/The Strain/Season 3, ACL_TYPE_ACCESS): Invalid argument (22)
Sep 29 01:20:30 Tower root: .d.......a. media/
Sep 29 01:20:30 Tower root: .d..t....a. media/TV Shows/
Sep 29 01:20:30 Tower root: .d.......a. media/TV Shows/The Strain/
Sep 29 01:20:30 Tower root: .d.......a. media/TV Shows/The Strain/Season 3/
Sep 29 01:20:30 Tower root: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1178) [sender=3.1.2]
Sep 29 01:20:30 Tower move: cmd: Success

 

It'll be interesting to find out what the root cause is.

thank god for a sane person. thank you very much. I appreciate the help sincerely. I do agree that they should post themselves, but as I do what I do as an indexer mod, I kind of do shoulder some amount of burden to them and I'm happy to do it. I like helping people. I sit in out chat and help people day in and out. I have never, ever, treated someone like this, even a total n00b. Again, I appreciate the ACTUAL help and guidance. Thank you very much

Sparkly i have the utmost respect for you, and you've done nothing but call me "stupid" "whiny" and a "brat". Why? This is not my issue it is an unRAID issue. Why are you so quick to judge me?! I wrote a KVM mythbuntu how to and gave you the UTMOST props for doing a docker for it! And now I have a legit issue and you call me a whiny brat? Why? Shoot I even changed the thread title to "issue with BTRFS to ResierFS". What's your problem? You and saarg have both been quite rude, and in no way tried to help in the slightest. Write code, stop trying to help people in the forums if this is how you'll treat them. Again, a legit problem and I am being chastised for it. Why?

 

I said your original statement was stupid and i stand by that. Because you have an issue does not mean everyone does, and is certainly not grounds to say nobody should upgrade to 6.2. I gave you advice by telling you to ask if anyone else had the problems you are describing but you instead chose to focus on one word, which you then took out of context and went on some verbal tirade like some pissy 5 year old.

I will agree my original post title was extreme and written in haste. I apologize for this, hence I've changed the title. Please stop with the insults and "pissy 5 year old" nonsense. I would say that anyone calling someone that, would look at themselves for the same behavior. Thanks again.

I will create some non SAB related files and report back copying them both to reiserfs and XFS FSs, and in the meantime I think I'll just make the leap to all XFS array. Apologies to anyone I offended, and I would advise anyone reacting in childish fashion and name calling to do the same.

 

and as I said, I don't just post without searching. I found no one with this issue before I posted. So telling me to ask if someone else has had this issue is the same as searching the forums for it no? Come on! Community right? My post title was over reactive, I've changed it. Let's all act as adults shall we?

 

Good evening