Albin

February 7, 2013

I have a test tower, that was running, and had an IP address. I now do not have an IP address.

To boot to the URAID flash drive I use a CD with "Plop Boot Manager" on it which works great. (the bios for this tower does not seem to support USB booting)

I do not have PLOP installed to any part of any drive (it is on a CD, so I have my bios to boot to a CD then when PLOP comes up I tell it to boot to the USB) (Eventually I would like to see if I can install PLOP to a drive outside the array so this process is more automated)

Please keep in mind, I had 5.0-rc8 working on this machine.

Just so you have the whole story: I have a separate test tower for installing other linux distros. This other machine can not boot to USB either, so one day I grabbed the plop cd from the dell and used it in the other test system. The next day I (by accident )grabbed the wrong cd (the one with the a linux distro on it) and put it in the dell tower. On the next reboot ( I was upgrading from rc8 to rc11), the distro started installing on to the test unraid system. (I am not concerned about the system or the data, but do want to continue to use this system as a test system). (so PLOP is great, but it does mean your system is at risk if you do something stupid like I did... all the better reason to get plop to a hard drive outside the unraid array, and disable booting from a cd)

I did a backup of the flash when going from rc8 to rc11 just before this happened. Once I realized what happened I stopped the install, pulled the cd and put the proper cd in (PLOP).

UNRAID did boot, but I had no access to the system through //tower/ or the IP address

I did a

ifconfg

and there was no IP address

I thought that maybe the UNRAID files were corrupt, so I restored to the backup, but still no IP address

I tried 4.7 and not IP address

I tried disabling the on board ethernet, and installing a ide card linksys lne100tx version 4.1, and no IP address

I did a fresh install to a different usb drive rc8 and no IP address

I disconnected all the clobbered hard drives and booted ... no IP address

I connected 1 fresh hard drive (no others connected) no ..... IP address

I tested and tried two different cables

I tested and tried two different wall outlets (Ethernet outlets)

I am attaching the syslog from my 4.7 (built in ethernet) attempt and my rc8 attempt (I also tried rc11 but did not get a syslog), also attaching 4.7 with ide card.

I did notice that ETH0 is showing in the 4.7 syslog but not in the rc8 syslog.... not sure what that means.

Also noticed that when using the on board ethernet, I am getting an "EEPROM Corrupted" (not getting this when using an IDE card with the on board disabled)

I did notice that when I was powerdown the server, I saw "mount can't find / in /etc/fstab or /etc/mtab" on the screen (not sure if that is part of the problem or a separate problem)

Thanks for any help with this.

Albin

syslog-4-7.txt

syslog-rc8.txt

syslog-4-7-ide-card.txt

February 6, 2013

Can someone move this Topic and related replies to:

Lime Technology - unRAID Server Community » General » General Support

With a Subject of: "Understanding Permissions and Using Windows Credentials to Log into Network Shares" (or some appropriate subject) Thanks

All users are intended to have read access to a Secure share. This is the difference between Secure and Private. The system is working correctly. Examine the share setup.

Sorry about that I incorrectly assumed what public, secure, private stood for. I found the following which straightened me out:

Public means that no user account is needed on the server for someone to access the share. This means you won't see the login box pop up when accessing the share. It also means that anyone can read/write/create/delete any file or directory on the share. This is the default setting when a new share is created. This is also the default setting if a share is created by creating it on a disk share. When a file is created it will be be owned on the linux-side by the 'nobody' user of the users group (uid/gid = 99/100).

Secure means that no user account is necessary on the server in order to access the share, and no login box will pop up. But in this mode you can select users than can have read/write access to the share, all other users will have read-only access. Since no login box will appear, in order to get this to work, this must be true:

- Whatever username you used to log in to your windows PC must also be a user name on the server. The 'case' of the user name does not matter (actually you must enter all lower-case on server side).

- The password you set on the server must match exactly the password used for your windows logon. The password IS case-sensitive.

Private means that you specify the exact set of users that can either have readonly or read/write access to the share. If you try to connect to the server you may or may not get a login box. If the username/password of your windows login matches one of the usernames defined on the server side, and that username has either readonly or read/write access (ie, not 'no access), then no login box will appear and you will be be logged into the share with the access rights specified. But if either your windows username is unknown on the server, or your windows password does not match, then windows will present a login box prompting for a username/password. Using this box you can then login to the share using one of the other username/passwords on the server.

Note that once you login to the server using some other username than your windows username, windows will use that username to access all shares on the server.

It appears that I do not have to enter log in credentials if my User Name and password that I use for logging into windows vista match the user name and password for an existing user on the unraid network shares.

I am interested in using this feature. I adjust my Vista user name from "Firstname Lastname" to "firstnamelastname" (I guess I could have used "firstname_lastname" or some other combo. The password stayed the same. To make sure windows was not logged into any network share I did the following:

1. Creating a Fresh Windows Connection

net use * /delete

2. Rebooted Unraid

3. Rebooted Windows

4. logged into windows "firstnamelastname" "password"

I expected that I could browse to the network share and gain access to a private share that "firstnamelastname" has read/write access to, but I was prompted for a user name and password. Before putting in credentials I went to a command window and did :

net use

and got the following response:

New connections will not be remembered.
There are no entries in the list.

Just to clarify:

I am trying to gain access to Network Share \\tower2\CDMedia

Network share Export is set to "YES"

Network share is set to Private

USER firstnamelastname has read/write access

Results for telnet session:

Type (replacing 'Media' with the share name--Capitalization is IMPORTANT): ls -al ../mnt/user/Media

ls -al ../mnt/user/CDMedia

Tower2 login: root
Linux 3.4.26-unRAID.

root@Tower2:~# ls -al ../mnt/user/CDMedia

total 3047

drwxrwxrwx 1 nobody users 112 2013-02-06 08:44 ./

drwxrwxrwx 1 nobody users 80 2013-02-06 03:40 ../

-rw-rw-rw- 1 nobody users 6148 2010-01-15 16:23 .DS_Store

-rw-rw-rw- 1 nobody users 3104804 2005-12-22 11:15 _7A_00220.jpg

root@Tower2:~#

(currently only two files in this test directory)

Am I missing a step? What else is needed to get my windows Vista credentials to work for my unraid user credentials?

Thanks

Albin

February 5, 2013

I was not going to place this in this topic, but after working through it, I feel it may very well be version related. Could be that it is something that many are already aware of, but I could not find it laid out like this.

I am running 5.0-rc11 and the "new permissions" utility was completed.

Note: I have another tower on the same network running 4.7 (not sure if this plays into things, but felt I should mention it seeing that I access that tower from my windows computer with different user credentials)

General Topic (Public users have read access to secure shares, and users with read/write access, can't write to secure shares, but can read and write to private shares)

I am struggling to access Exported Shares set to "YES" that have Security Set to "Secure".

Seems I have read/write access to public shares. (public share are working properly)

As I am trouble shooting I am changing the password of a user, or changing a user from read only to read/write on a particular share, I am wondering if each one of these changes should be instant, or do I need to reboot UnRAID between each change, or do I need to reboot windows (the computer associated with the edited user settings), or do I need to do both, or is there some other less time consuming option (stopping and restarting the array, or stopping and starting some service on windows). (I answer this question below)

Test-1

changing a share from secure to public, and then (no reboots) trying to change the name of a file in the share from my computer did not work. I get the "Destination Folder Access Denied" / "You need permission to perform this action" (options "try again" "cancel"). (I am accessing these through \\tower\folder\file and not as a mapped network drive )

Test-2

changed a different network share to public, then went to settings>share settings and changes "Enable User Shares:" to "NO" and then applied this setting, then changed "Enable User Shares:" back to "YES" and then applied this setting. I then went to the share \\tower\folder2\file and I had read/write access.

So simply turning off the shares and then turning it back on seems to help with getting the changes to take effect.

Test-3

(note: I just rebooted my computer, I have not reconnected to any network drives, and there are no user credentials stored in the user credentials (except for windows live, which I have read you can delete it but it will just keep coming back, unles you uninstall windows live)

I can browse to a network share that is set to secure, and see the files and folders of that share even though I have not entered any credentials.

(I would think that if I have not logged in as a user I should not have read access to a network share that is set to secure

Test-4

changed a network share from secure to private (all users were set to "No Access") (disabled and then renabled shares to get the settings to take effect), then

browse to the network share, and I could not see or gain access to the share (this is what I would expect to happen)

Test-5

changed a network share from secure to private (set one user to read/write access) (disabled and then renabled shares to get the settings to take effect), then browse to the network share, and I could not see or gain access to the share, but I could read and write to the network share after entering the proper user credentials. (this is what I would expect to happen)

Conclusion:

Public Shares seem to work correctly

Secure Shares do not seem to be working correctly (public users have read access)

Private Shares seem to work correctly

Related links / Topics that may help others:

Create a file in the 'config' directory on your flash called 'smb-extra.conf'. Inside this file, put this line:

acl check permissions = No

Then Stop array and Start array. Now let me know if this problem persists.

I am entering the user with the the following guidelines:

User names can not contain capital letters. Here are the rules:

- First character of a username must be a lower-case letter, or the underscore '_' character.

- Subsequent characters of a username may be lower-case letters, underscore, or dash '-' character.

- The very last character of a username is permitted to be a dollar sign '$'

- Maximum total length is 32 characters

Put another way (straight from the code of 'useradd' linux utility):

User/group names must match [a-z_][a-z0-9_-]*[$]

Thanks

Albin

February 4, 2013

you need to run

reiserfsck --rebuild-tree /dev/md1

as it suggests to fix the corruption.

You may need to run the permissions script once more afterwords, as the first could not traverse the full file system because of the corruption.

Joe, Thanks for confirming the steps on this. I did run

reiserfsck --rebuild-tree /dev/md1

Last few lines of out put:

Flushing..finished

Objects without names 810

Dirs linked to /lost+found: 12

Dirs without stat data found 1

Files linked to /lost+found 798

Pass 4 - finished done 1, 0 /sec

Deleted unreachable items 1

Flushing..finished

Syncing..finished

###########

reiserfsck finished at Mon Feb 4 10:04:43 2013

Full copy attached

I see where it suggest replacing the bad drive. Is it safe to assume that md1 always equals data disk1 in the array or that

data disk1=/dev/md1 (the disk I need to swap out)

data disk2=/dev/md2

data disk3=/dev/md3

data disk4=/dev/md4

data disk5=/dev/md5

What would parity be /dev/???

What woud the Cache drive be /dev/???

I am running the "New Permissions" Utility now, then I will start a Parity-Check, and after knowing pariity is valid I will power down backup 'config/super.dat' and 'config/disk.cfg, replace the drive, reboot, and then rebuild the new drive.

Thanks

Albin

reiserfsck_rebuildtree_logfile.txt

February 3, 2013

I did back up the flash drive, so I just restored config/super.dat and now all the drives are green balled, and I am getting "configuration valid"

I originally went from 4.7 to 5.0-beta12a a long time back, and had some issues with permissions. With this upgrade, I did not see specific instructions for going from 5.0-beta12a to 5.0-rc11, so I thought I may need to get rid of the Super.dat file and doing so might in someway help with my permissions issue (I am only guessing at that though).

Should I keep the old super.dat (the one I restored) or should I remove it and do a "start" with out the super.dat file? I will hold off on starting the array, until I hear back.

Thanks for your input on this

Albin

Keep it like it is. Your configuration is valid. When you removed super.dat before you made it forget all about your configuration and so it saw everything as new disks. Now you are back to normal.

There is a link in the first post of this thread with the release notes. See the section labeled

All previous 5.0-beta and 5.0-rc versions including 5.0-rc8a

Specifically, you need to run the the New Permissions Utility. It will take a while. Don't close the browser window until it completes.

I did run the New Permissions utility when I went from 4.7 to 5.0-beta12 but it seemed to hang. I started the array and ran the "New Permissions" Utility again, and it seems it did not hang this time.

/usr/local/sbin/newperms
processing /mnt/cache
... chmod -R u-x,go-rwx,go+u,ugo+X /mnt/cache
... chown -R nobody:users /mnt/cache
... sync
processing /mnt/disk1
... chmod -R u-x,go-rwx,go+u,ugo+X /mnt/disk1
... chown -R nobody:users /mnt/disk1
... sync
processing /mnt/disk2
... chmod -R u-x,go-rwx,go+u,ugo+X /mnt/disk2
... chown -R nobody:users /mnt/disk2
... sync
processing /mnt/disk3
... chmod -R u-x,go-rwx,go+u,ugo+X /mnt/disk3
... chown -R nobody:users /mnt/disk3
... sync
processing /mnt/disk4
... chmod -R u-x,go-rwx,go+u,ugo+X /mnt/disk4
... chown -R nobody:users /mnt/disk4
... sync
completed, elapsed time: 02:19:39

but I am seeing some REISERFS errors showing in the syslog. I really do not know what they mean. Not sure what device MD1 is.

Feb 2 23:17:42 Tower2 kernel: REISERFS warning: reiserfs-5083 is_leaf: wrong item type for item *3.5*[609350 612214 0x1 UNKNOWN], item_len 480, item_location 3356, free_space(entry_count) 65535
Feb 2 23:17:42 Tower2 kernel: REISERFS error (device md1): vs-5150 search_by_key: invalid format found in block 234783706. Fsck?

I found a thread with a similar issues:

http://lime-technology.com/wiki/index.php?title=Check_Disk_Filesystems

Seeing this seems to be unrelated to the version I am running and not related to permissions I started a new topic under General support and posted my reserfsck logfile there and here.

Location of new topic:

http://lime-technology.com/forum/index.php?topic=25740.0

I am not sure if there are any other items in the syslog that I need be concerned about so I will still post the syslogs.

I have attached a syslog snap shot prior to running new permissions, and a syslog snap shot after the new permissions finished.

Albin

syslog_pre_permissions.txt

syslog_post_permissions.txt

reiserfsck_logfile.txt

February 3, 2013

I am getting a REISERFS error, in my syslog.

Similar to this post: http://lime-technology.com/forum/index.php?topic=6264.msg60817#msg60817

see attached and below log:

Feb 2 23:17:42 Tower2 kernel: REISERFS warning: reiserfs-5083 is_leaf: wrong item type for item *3.5*[609350 612214 0x1 UNKNOWN], item_len 480, item_location 3356, free_space(entry_count) 65535
Feb 2 23:17:42 Tower2 kernel: REISERFS error (device md1): vs-5150 search_by_key: invalid format found in block 234783706. Fsck?

So I took Joe L. suggestion and went to: (thanks Joe)

http://lime-technology.com/wiki/index.php?title=Check_Disk_Filesystems

So I put unraid into Maintanance Mode and then putty'ed in and ran

reiserfsck --check /dev/md1  [answer with the word Yes when prompted, do not type yes or YES, but Yes (capital Y and lower case es)]

The last two lines of the reiserfsck were:

Fatal corruptions were found, Semantic pass skipped

9 found corruptions can be fixed only when running with --rebuild-tree

I do not think this is a related issue but just wanted to be sure to mention I just upgraded to 5.0-rc11 and ran "New Permisions"

I have attached a syslog snap shot prior to running new permissions, and a syslog snap shot after the new permissions finished. I also attached the Reiserfsk logfile

Thanks for some expert help on this.... surely do not want to do the wrong thing here.

Albin

reiserfsck_logfile.txt

syslog_pre_permissions.txt

syslog_post_permissions.txt

February 3, 2013

I did not know that Unraid had a NPT server. Just synced my PC to my unraid server using its IP address. I hard code the IP in unraid as I noticed in the past that it appears to stop/start the SMB share when renewing the IP address.

I did not try using the hard assigned IP address of my tower. Glad to know that is an option. I think I will keep mine pointed to tower opposed to the ip address. I do not see changing the IP address, but I think there is a greater chance of me changing the IP address than there is a chance of me changing the server name.

I just set "tower" to point to:

0.us.pool.ntp.org

1.us.pool.ntp.org

2.us.pool.ntp.org

And set "tower2" to point to:

tower

1.us.pool.ntp.org (I am guessing these are helpful if "tower" is down)

2.us.pool.ntp.org (I am guessing these are helpful if "tower" is down)

And My laptop points to: tower

(I adjusted windows to check the server every 12 hours (instead of every 7 days))

I found this link to be helpful with making the adjustments:

http://www.cumps.be/nl/blog/read/howto-set-up-ntp-on-windows-vista

Begin EDIT:

I originally used the above link to point to 4 peers. I could only see one peer when doing:

w32tm /query /peers

after doing some of the setup work, and struggling to see all the peers, I tried:

net stop w32time
net start w32time

and then all the peers were showing.

End EDIT

Does anyone know how often the Unraid server is set to fetch the time and date? Is there instructions on adjusting this setting?

Albin

February 3, 2013

I did the following for this upgrade (after first backing up the flash drive)

Copied the files bzimage and bzroot from the zip file to the root of your flash device

Deleted config/passwd

Deleted config/shadow

Deleted config/smbpasswd

Delete the file config/super.dat

Booted up server .....

You didn't need to delete 'super.dat', but no mater. If you are certain parity is assigned correctly click 'Start'.

Since the flash drive was backed up, Albin should be able to re-instate the super.dat file.

I did back up the flash drive, so I just restored config/super.dat and now all the drives are green balled, and I am getting "configuration valid"

I originally went from 4.7 to 5.0-beta12a a long time back, and had some issues with permissions. With this upgrade, I did not see specific instructions for going from 5.0-beta12a to 5.0-rc11, so I thought I may need to get rid of the Super.dat file and doing so might in someway help with my permissions issue (I am only guessing at that though).

Should I keep the old super.dat (the one I restored) or should I remove it and do a "start" with out the super.dat file? I will hold off on starting the array, until I hear back.

Thanks for your input on this

Albin

February 3, 2013

I did the following for this upgrade (after first backing up the flash drive)

Copied the files bzimage and bzroot from the zip file to the root of your flash device

Deleted config/passwd

Deleted config/shadow

Deleted config/smbpasswd

Delete the file config/super.dat

Booted up server

re-assign hard drives to their correct device location

The cache disk was already assigned to its correct location

I am not seeing "Stopped Configuration Valid" but rather "Stopped. Initial configuration"

I do not see "MBR: error", or "MBR: unknown"

I have attached a syslog

I am getting Blue Balls next to each of the devices (except for cache and flash... they are green)

Do I need to check the box "Parity is Valid" and then click "START" next to "Start will record all disk information, bring the array on-line, and start Parity-Sync (if parity is present). The array is immediately available, but is unprotected until Parity-Sync completes."?

I did not click on "Identify"

tower2_syslog.txt

February 3, 2013

...

You mentioned that you are using DeltaCopy but not the way I am trying to use it. Do you mind explaining how you are using DeltaCopy?

...

By the way do you have a link to a lime-tech post explaining how to point a windows machine to the UNraid servers NTP / time to fetch the date and time?

...

I am only using it to do scheduled backups. I know I could have used something else for this but I wanted to play around with rsync in unRAID. I am also using rsync on unRAID to produce monthly backups of critical files to ntfs-3g mounted esata for storage offsite.

I don't remember having to do anything on unRAID to enable ntpd. I just tell my windows machines to get the time from my unRAID server like this:

I think deltacopy will be a good solution for the backups.

I did try entering the server name tower2 for my windows machine to fetch the time. It worked on the new version of unraid, but when trying to fetch the time from my 4.7 version unraid (server name tower ), I got an error from windows. (so it works with the newer version anyway... not sure if there is a setting for 4.7 to make it work, but I do not need it to sync with that one.)

Thanks again,

Albin

February 2, 2013

In DeltaCopy, select the profile and then go to the options tab. You probably have "Remove deleted files from server" checked. This will make it delete any files that don't exist on the pc. Uncheck this box.

If you right-click on a profile you can "Display run command". This will show you the exact rsync command that is used based on the options you have selected. You can also put additional options in the "Additional parameters" box on the options tab.

You may have to do a little research and try some things out to get the rsync just like you need it. I am not using it the way you want so I may not be much help.

Also, what I do for NTP is let unRAID get the time from the internet and then make everything on my local network get the time from my unRAID so there is less delay in getting everything else in synch.

Thanks for the suggestion.

It looks like deltaCopy will work fine for me if I have one client and Unraid as the server.

I do not think it will do 2 clients and Unraid as the Server (maybe if I was a programmer I could do it.... I am not a programmer)

If I uncheck "Remove deleted files from Server", I am guessing that would keep all files on the server are on Client 1 or Client 2.

Let say that client 1, and Client 2 have files 1, 2, 3, 4 and the server has 1,2,3,4, If I delete file 1 from Client 2 with "Remove deleted files from Server" unchecked, then I would end up with Client 1 and the server having files 1,2,3,4 and client 2 having 2,3,4

Now if Client 1 changes file 2, (now 2rev1) (and then did a sync), Client 1 would have 1,2rev1,3,4 the server would have 1,2rev1,3,4, but Client 2 would have 2 (original),3,4. At this point if I do a sync on client 2, file 2rev1 would be over written and replaced with 2 (original), so the server would now have files 1,2 (original),3,4, going back to client 1 and doing a sync would over right 2 (original) with 2 rev1 on the server.

Basically Client 1 and Client 2 are not working together together to have the same files (with the settings I currently have they will continue to fight over what version of file 2 will reside on the server). I am guessing that Client 1 does not know that client 2 even exists and vice versa, so they are just doing what they are told, and that is to make sure that the files on the server are the same as the ones on self, and do not remove deleted files from server) (I am sure there is a more technical way to explain this, but this is more the layman's terms for what the end result seems to be. Again, I understand rsync is powerful, but I do not have the knowledge to tackle writing the additional scripts, or parameters to make sure that client 1, client 2, and the server are all mirror each other.

I did notice a nice feature where rysnc / deltacopy adjust the permissions of the files on the server in such a way that it seems you can not browse to the network share and delete or change files there. This is nice seeing it would force the use to make changes to the files on the client and then sync the changes to the unraid server.

I did look at the "Additional Parameters" for deltacopy. DeltaCopy's site pointed me to a samba site

http://www.samba.org/ftp/rsync/rsync.html

There is a lot of stuff there to explain rsync and all the different commands that can be used.

You mentioned that you are using DeltaCopy but not the way I am trying to use it. Do you mind explaining how you are using DeltaCopy?

I did see that there is another product (other than deltacopy) that synametrics offers called Syncrify

http://web.synametrics.com/SyncrifyVsDeltaCopy.htm

http://web.synametrics.com/SyncrifyInstallationLinux.htm

It looks like it can be installed on FreeNAS

http://web.synametrics.com/syncrifyfreenas.htm

I see RussellinSacto started a post on this product back in 2011 and ProStuff1 said he would look at some, but I do not see where any more post were made to indicate there was any more progress:

http://lime-technology.com/forum/index.php?topic=13728.msg130496#msg130496

Syncrify seems to be more suited for what I am looking for. Has anyone looked at getting Syncrify server on an unraid system. Is it possible?

Trurl

By the way do you have a link to a lime-tech post explaining how to point a windows machine to the UNraid servers NTP / time to fetch the date and time?

Thanks

Albin

January 30, 2013

It should work. Make sure all of the machines are using the same NTP source. You'll have to test to determine the best rsync settings for your requirements.

I really never thought to look at that and honestly I had to look up what NTP Source was "Network Time Protocol"

I really have not messed with that much, other than trying to using this to set the time on my routers.

I went to the Unraid time settings to see what time zone I am using and I am using (UTC-05:00) eastern Time (US & Canada) and the current date and time look fine, but the "Use NTP" option is set to "NO"

I set the "Use NTP" to "Yes", and set "NTP Server 1" to: 0.us.pool.ntp.org

I then set the computers NTP Servers to: 0.us.pool.ntp.org

(right clicked on the clock and clicked "adjust date/time", then picked the "Internet time" TAB and clicked change settings)

I need to do this son my other unraid server, I think the time is off on that one. Thanks for the tip

I then tried to force a sync, (right clicked the deltacopy profile name and clicked "run now"). Syncing this way give you a line by line view of what deltacopy is doing.

I was getting a no such directory error.

I deleted the profile, then recreated the profile and syncing started to semi work.

I say semi because if I create a file (file1) on computer1, and then run a sync on computer1, the file is copied to the network share, but if I go to computer2 and run a sync, it deletes the file netwrok shares copy of file1 I just created. If I then create a file (file2) on computer2 and sync, the file2 shows on network share. At this point if I go to computer1 and run a sync, file2 is deleted and file1 is recopied to the network share.

Are the above symptoms due to improper steps to setting up deltacopy. Do I need to set up the folder on each computer, leave them empty, then setup the deltacopy profiles, and then run a sync at both locations prior to putting any files in either place?

Thanks for any help on this. Looks like I am one step close and I am excited that this is something that could work.

Thanks

Albin

January 30, 2013

I just started using Rsync and Deltacopy to sync files between my laptop and a network share on my unraid server.

http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145 '>http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145 ( Thanks WeeboTech and Tibbar )

http://lime-technology.com/forum/index.php?topic=25619.0 ( Thanks Trurl )

I wanted to know a little more about how this syncing works:

I am syncing \\tower\Backup to D:\Backup

If I create a file in D:\Backup it is appearing in \\tower\Backup which is great.

My question is do most people using this only edit files at D:\Backup or is it ok to edit the file at \\tower\Backup ?

As a test I created a test file in D:\Backup and then attempted to delete the file by browsing to \\tower\Backup to delete it. I got a message saying I needed permission to do this. Is this rsync stopping me from deleting the file?

I also was wondering if I can have Computer-1, computer-2, and Computer-3 successfully syncing to \\tower\Backup

I would like to have deltacopy on all three computers with the ability to add and edit files at each location, and have the ability to add a forth computer at a latter date and have all the past files propagate at the new location.

Is the above possible?

First when you setup deltacopy it seems if you want to sync a folder from your computer to the server you have to use the "Add Folder" option. (You can't just specify a folder), Meaning deltacopy will create a folder on the server when you say "add folder" so instead of all your files ending up at \\tower\Backup they will end up at \\tower\Backup\UnraidBackup ("UnraidBackup" is the name of the folder created with deltacopy when using "add folder"

With that said I tried to add a second computer and use the same name on the second computer (each computer has a folder called UnraidBackup if the names are different like "UnraidBackup1"and "UnraidBackup2" then you end up with:

\\tower\Backup\UnraidBackup1

\\tower\Backup\UnraidBackup2

and no files from computer 1 will end up at computer 2 or vice versa.

Is there another way to approach this with deltacopy or do I need to use, unison to make this work?

http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145

I am trying to make this work a little like dropbox, but locally, meaning I am not going from computer1 to cloud, then to computer2 (I just want to go from computer1 to server, to computer2 ) just want a solution without the cloud having to be involved.

Thanks for any help on this.

Albin

January 30, 2013

TRURL,

Thanks for your help. After going through all your suggestions in your last post and working on the reply during each step, it now works. I figured I would still post the entire thing with my step by step replies, in hopes it will help someone else.

My unRAID is named unSERVER. When I do:
rsync rsync://unSERVER
I get a listing of the stuff I configured in /etc/rsyncd.conf

I get the following:

Tower3 login: root

Linux 3.4.11-unRAID.

root@Tower3:~# rsync rsync://Tower3

rsync: failed to connect to Tower3: Connection refused (111)

rsync error: error in socket IO (code 10) at clientserver.c(122) [Receiver=3.0.7

I'm not real good with linux but I think the script in S20-init.rsyncd is checking for an rsync entry in /etc/inetd.conf and if it doesn't exist it appends:
rsync   stream  tcp     nowait  root    /usr/sbin/tcpd  /usr/bin/rsync --daemon

Here is the code in my S20-init.rsyncd file:

#!/bin/bash

if ! grep ^rsync /etc/inetd.conf > /dev/null ; then
cat <<-EOF >> /etc/inetd.conf
rsync   stream  tcp     nowait  root    /usr/sbin/tcpd  /usr/bin/rsync --daemon
EOF
read PID < /var/run/inetd.pid
kill -1 ${PID}
fi

cp /boot/Custom/etc/rsyncd.conf /etc/rsyncd.conf

Do you see anything I need to change?

to it, and if I do:
cat /etc/inetd.conf

Here is the results of me doing:

cat /etc/inetd.conf

root@Tower3:~# cat /etc/inetd.conf
# See "man 8 inetd" for more information.
#
# If you make changes to this file, either reboot your machine or send the
# inetd a HUP signal:
# Do a "ps x" as root and look up the pid of inetd. Then do a
# "kill -HUP <pid of inetd>".
# The inetd will re-read this file whenever it gets that signal.
#
# <service_name> <sock_type> <proto> <flags> <user> <server_path> <args>
#
# The first 4 services are really only used for debugging purposes, so
# we comment them out since they can otherwise be used for some nasty
# denial-of-service attacks.  If you need them, uncomment them.
# echo          stream  tcp     nowait  root    internal
# echo          dgram   udp     wait    root    internal
# discard       stream  tcp     nowait  root    internal
# discard       dgram   udp     wait    root    internal
# daytime       stream  tcp     nowait  root    internal
# daytime       dgram   udp     wait    root    internal
# chargen       stream  tcp     nowait  root    internal
# chargen       dgram   udp     wait    root    internal
time            stream  tcp     nowait  root    internal
time            dgram   udp     wait    root    internal
#
# These are standard services:
#
# Very Secure File Transfer Protocol (FTP) server.
ftp     stream  tcp     nowait  root    /usr/sbin/tcpd  vsftpd
#
# Professional File Transfer Protocol (FTP) server.
#ftp     stream  tcp     nowait  root    /usr/sbin/tcpd  proftpd
#
# Telnet server:
telnet  stream  tcp     nowait  root    /usr/sbin/tcpd  in.telnetd
#
# The comsat daemon notifies the user of new mail when biff is set to y:
#comsat        dgram   udp     wait    root    /usr/sbin/tcpd  in.comsat
#
# Shell, login, exec and talk are BSD protocols
#
#shell  stream  tcp     nowait  root    /usr/sbin/tcpd  in.rshd -L
#login  stream  tcp     nowait  root    /usr/sbin/tcpd  in.rlogind
# exec  stream  tcp     nowait  root    /usr/sbin/tcpd  in.rexecd
# talk  dgram   udp     wait    root    /usr/sbin/tcpd  in.talkd
#ntalk  dgram   udp     wait    root    /usr/sbin/tcpd  in.talkd
#
# To use the talk daemons from KDE, comment the talk and ntalk lines above
# and uncomment the ones below:
# talk    dgram   udp     wait    root    /usr/sbin/tcpd  /usr/bin/kotalkd
# ntalk   dgram   udp     wait    root    /usr/sbin/tcpd  /usr/bin/ktalkd
#
# Kerberos authenticated services
#
# klogin        stream  tcp     nowait  root    /usr/sbin/tcpd  rlogind -k
# eklogin       stream  tcp     nowait  root    /usr/sbin/tcpd  rlogind -k -x
# kshell        stream  tcp     nowait  root    /usr/sbin/tcpd  rshd -k
#
# Services run ONLY on the Kerberos server
#
# krbupdate     stream  tcp     nowait  root    /usr/sbin/tcpd  registerd
# kpasswd       stream  tcp     nowait  root    /usr/sbin/tcpd  kpasswdd
#
# POP and IMAP mail servers
#
# Post Office Protocol version 3 (POP3) server:
#pop3    stream  tcp     nowait  root    /usr/sbin/tcpd  /usr/sbin/popa3d
# Internet Message Access Protocol (IMAP) server:
#imap2   stream  tcp     nowait  root    /usr/sbin/tcpd  imapd
#
# The Internet Unix to Unix copy (UUCP) service:
# uucp  stream  tcp     nowait  uucp    /usr/sbin/tcpd  /usr/lib/uucp/uucico   -                                                                              l
#
# Tftp service is provided primarily for booting.  Most sites
# run this only on machines acting as "boot servers."
# tftp  dgram   udp     wait    root    /usr/sbin/in.tftpd  in.tftpd -s /tftpboo                                                                              t -r blksize
#
# Internet Bootstrap Protocol (BOOTP) server:
# bootps        dgram   udp     wait    root    /usr/sbin/bootpd        bootpd
#
# Finger, systat and netstat give out user information which may be
# valuable to potential "system crackers."  Many sites choose to disable
# some or all of these services to improve security.
# Try "telnet localhost systat" and "telnet localhost netstat" to see that
# information yourself!
#finger stream  tcp     nowait  nobody  /usr/sbin/tcpd  in.fingerd -u
# systat        stream  tcp     nowait  nobody  /usr/sbin/tcpd  /bin/ps -auwwx
# netstat       stream  tcp     nowait  root    /usr/sbin/tcpd  /bin/netstat   -                                                                              a
#
# Ident service is used for net authentication
#auth   stream  tcp     wait    root    /usr/sbin/in.identd     in.identd
#
# These are to start Samba, an smb server that can export filesystems to
# Pathworks, Lanmanager for DOS, Windows for Workgroups, Windows95, Lanmanager
# for Windows, Lanmanager for OS/2, Windows NT, etc.
# If you're running smbd and nmbd as daemons in /etc/rc.d/rc.samba, then you
# shouldn't uncomment these lines.
#netbios-ssn    stream  tcp     nowait  root    /usr/sbin/smbd  smbd
#netbios-ns     dgram   udp     wait    root    /usr/sbin/nmbd  nmbd
#
#Samba Web Administration Tool:
#swat           stream  tcp     nowait.400 root /usr/sbin/swat  swat
#
# Sun-RPC based services.
# <service name/version><sock_type><rpc/prot><flags><user><server><args>
# rstatd/1-3    dgram   rpc/udp wait    root    /usr/sbin/tcpd  rpc.rstatd
# rusersd/2-3   dgram   rpc/udp wait    root    /usr/sbin/tcpd  rpc.rusersd
# walld/1       dgram   rpc/udp wait    root    /usr/sbin/tcpd  rpc.rwalld
#
# End of inetd.conf.
root@Tower3:~#

I can see that line at the end so you might check that and also:
cat /etc/rsyncd.conf
to make sure it has what you intend in it as well.

Here is what I got when doing:

cat /etc/rsyncd.conf

root@Tower3:~# cat /etc/rsyncd.conf

cat: /etc/rsyncd.conf: No such file or directory

OK I am sure that I copied the file using Midnight Commander http://lime-technology.com/wiki/index.php/UnRAID_Add_Ons#mc_.28Midnight_Commander_file_manager_-_version_2010-02-06_.29

I am not sure why after coping it over from /boot/Custom/etc/ that it was not there after a reboot.

7. Copied the rsyncd.conf from /boot/Custom/etc/rsyncd.conf to /etc/Custom/etc/rsyncd.conf
To do this I Telnet http://lime-technology.com/wiki/index.php/Telnet in to the server via putty

After entering my login credentials I typed MC for midnight commander and navigated to /etc in the left pane and /boot/Custom/etc in the right pane, then clicked on the rsyncd.conf file and hit copy.

...

Is the path in step 7 above that I made bold really what you used or is that just a typo? The correct path should be the same as the cp command in the code in step 5:

/etc/rsyncd.conf

I did check this after you brought it to my attention, and I am sure I did not create a folder called Custom under /etc/, so there is no path called /etc/Custom/etc/ and no file seeing there is no path.

I telneted back in through putty, and entered MC to get to Midnight Commander screen.

Before copying the file over I went in (using the edit feature in MC) and check all the files I created or edited

These files:

/boot/Custom/etc/rc.d/S20-init.rsyncd

/boot/Custom/etc/rsyncd.conf

/boot/config/go

When looking at them I saw the following at the end of every line ^M

I removed the 2 spaces prior to the ^M and I removed the ^M for each line in each file.

Only a few lines in my "go" file had this. one was a comment line so I am guessing that had no impact, but I think the other line was /usr/local/sbin/emhttp &

which would right where I needed to do a carriage return to start the newly created line for /boot/Custom/etc/rc.d/S20-int.rsyncd

So those " ^M " are all removed

With the ^M remvoed from the files I copied rsyncd.conf from /boot/Custom/etc/ to /etc/

One other thing I noticed in your original post, in some places you have "Custom" in the path and some places just "custom". Linux is case-sensitive so make sure you are using the same case everywhere.

I went through and fixed all these locations, so any place where I had "custom" I changed it to "Custom"

You were very helpful. Thanks so much.

I will have to say I fixed the upper / lower case issue for "custom" / "Custom" first, then I removed the ^M from the files, then copied the rsyncd.conf file to /etc/. I think I did a reboot in between step one and 2 but I am not sure. I know I did a reboot after all three.

So what I do not know is if one of the above, a combination of the above, or all of the above were the problems. Needless to say you helped me check all the write areas, and I now I get the following when doing

rsync rsync://tower3

root@Tower3:/boot/config# rsync rsync://tower3

backup Backup

or doing

rsync rsync://192.168.2.132

root@Tower3:/boot/config# rsync rsync://192.168.2.132

backup Backup

DeltaCopy now fetches the virtual directory "backup" with either a server name tower3 or 192.168.2.132

Now I need to spend some time figuring out DeltaCopy's options, and start syncing files.

I will go back and fix any other errors in my original post and mark it as solved

Thanks again,

Albin

January 30, 2013

Some of the errors I mention are when I telnet in. I do not see how those errors could be firewall related. I did turn off the firewall and tried detacopy with the firewall off. I got the same error / message

I think I had a firewall entry because I was also playing around with rsync going the other way, hence an entry for DeltaCopy Server, but there shouldn't need to be one for the client since it is outgoing.

My unRAID is named unSERVER. When I do:
rsync rsync://unSERVER
I get a listing of the stuff I configured in /etc/rsyncd.conf

I'm not real good with linux but I think the script in S20-init.rsyncd is checking for an rsync entry in /etc/inetd.conf and if it doesn't exist it appends:
rsync   stream  tcp     nowait  root    /usr/sbin/tcpd  /usr/bin/rsync --daemon
to it, and if I do:
cat /etc/inetd.conf
I can see that line at the end so you might check that and also:
cat /etc/rsyncd.conf
to make sure it has what you intend in it as well.

One other thing I noticed in your original post, in some places you have "Custom" in the path and some places just "custom". Linux is case-sensitive so make sure you are using the same case everywhere.

Thanks for check this over. I am going to go back through this tomorrow and try what you suggested. I think I have some "Custom" / "custom" errors

Thanks

Albin

January 30, 2013

Maybe it's being blocked by your windows firewall. I don't have Vista anymore but in my Window 7 Firewall I have an entry for DeltaCopy server:

Some of the errors I mention are when I telnet in. I do not see how those errors could be firewall related. I did turn off the firewall and tried detacopy with the firewall off. I got the same error / message

Thanks

Albin

January 29, 2013

I had this working on 5rc8a and it has continued to work on all my upgrades since. I have DeltaCopy (Win7) doing a sync of three different folders, each on their own schedule.
5. Creadted file in sub-folder "rc.d" file name S20-init.rsyncd

code placed in file
#!/bin/bash

if ! grep ^rsync /etc/inetd.conf > /dev/null ; then
cat <<-EOF >> /etc/inetd.conf
rsync   stream  tcp     nowait  root    /usr/sbin/tcpd  /usr/bin/rsync --daemon
EOF
read PID < /var/run/inetd.pid
kill -1 ${PID}
fi

cp /boot/custom/etc/rsyncd.conf /etc/rsyncd.conf
...

7. Copied the rsyncd.conf from /boot/Custom/etc/rsyncd.conf to /etc/Custom/etc/rsyncd.conf

To do this I Telnet http://lime-technology.com/wiki/index.php/Telnet in to the server via putty

After entering my login credentials I typed MC for midnight commander and navigated to /etc in the left pane and /boot/Custom/etc in the right pane, then clicked on the rsyncd.conf file and hit copy.

...
Is the path in step 7 above that I made bold really what you used or is that just a typo? The correct path should be the same as the cp command in the code in step 5:

/etc/rsyncd.conf

Also, what editor did you use to create these files? You must be sure to use an editor that can save text in Unix-compatible form; i.e., with LF for newline instead of CR/LF as is done by Windows.

Search for notepad++ if you don't have an editor that will do this.

Thanks for your reply.

/etc/Custom/etc/rsyncd.conf was typo when creating the post (sorry about that)

I used /etc/rsyncd.conf

I will correct the post

The editor I use is notepad++ (I think I started using notepad++ when I started using Unraid for the first time)

I think I answered all your questions.

Thanks

Albin

January 29, 2013

UnRaid version: 5.0-rc8a

DeltaCopy Version 1.4 (installed on Windows Vista Home Premium SP3)

(I could use unison if that would be easier) http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145

I have been wanting to sync files between my server and my laptop and attempted to follow WeeboTech and Tibbar "How to" to get this working. http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145

I figured I would layout all the steps that I went through which came from the "How to" (Thanks WeeboTech and Tibbar)

Maybe I missed one of the steps or did not do one of the steps properly.

Steps already completed:

Short description of the steps:

Created the following folders and files

/boot/Custom (Folder)

/boot/Custom/etc (Folder)

/boot/Custom/etc/rc.d (Folder)

/boot/Custom/etc/rsyncd.conf (File)(see below for code inserted in filed)

/boot/Custom/etc/rc.d/S20-init.rsyncd (File)(see below for code inserted in filed)

Edited "GO" Script (see below for code)

Copied the rsyncd.conf from /boot/Custom/etc/rsyncd.conf to /etc/rsyncd.conf

Created a network share called "Backup"

Rebooted the Unraid Server

Installed DeltaCopy and attempted to fetch the directory names (this failed)

Detailed Steps (long version of the steps):

1. Created folder called "Custom" on Flash Drive

full path = /boot/Custom

full path if flash drive is mounted to windows= /Custom

2. Created sub folder called "etc"

full path = /boot/Custom/etc

full path if flash drive is mounted to windows= /Custom/etc

3. Created sub folder called "rc.d"

full path = /boot/Custom/etc/rc.d

full path if flash drive is mounted to windows= /Custom/etc/rc.d

4. Created file in sub-folder "etc" file name "rsyncd.conf"

full path = /boot/Custom/etc/rsyncd.conf

full path if flash drive is mounted to windows= /Custom/etc/rsyncd.conf

Code in file called rsyncd.conf

gid = root 
uid = root 
use chroot = 4 
max connections = 4 
pid file = /var/run/rsyncd.pid 
timeout = 600

[backup]  
path = /mnt/disk1/Backup 
comment = Backup 
read only = FALSE  
list = yes

*I noticed the code is pointing to a disk then a folder and under stand that I could use /mnt/Backup seeing I did create a network share called Backup. I currently left this the way it is, and I am assuming it should work, but maybe I am assuming wrong?

5. Creadted file in sub-folder "rc.d" file name S20-init.rsyncd

code placed in file

#!/bin/bash

if ! grep ^rsync /etc/inetd.conf > /dev/null ; then
cat <<-EOF >> /etc/inetd.conf
rsync   stream  tcp     nowait  root    /usr/sbin/tcpd  /usr/bin/rsync --daemon
EOF
read PID < /var/run/inetd.pid
kill -1 ${PID}
fi

cp /boot/custom/etc/rsyncd.conf /etc/rsyncd.conf

6. Edited the file called "GO" located in /boot/config

full path = /boot/config/go

full path if flash drive is mounted to windows= /config/go

Code added as last line in the "GO" file

/boot/custom/etc/rc.d/S20-init.rsyncd

7. Copied the rsyncd.conf from /boot/Custom/etc/rsyncd.conf to /etc/rsyncd.conf

To do this I Telnet http://lime-technology.com/wiki/index.php/Telnet in to the server via putty

After entering my login credentials I typed MC for midnight commander and navigated to /etc in the left pane and /boot/Custom/etc in the right pane, then clicked on the rsyncd.conf file and hit copy.

8. I created a network share called Backup (currently export is set to "YES" and security is set to "PUBLIC")

9. Downloaded and installed DeltaCopy to windows vista

10 ran deltacopy client

used the "add New Profile" icon

profile name "Backup"

Server IP/HOST Name: 192.168.2.132 (also tried Tower3) This would be Tower for most users)

Virtual Directory Name, I do not think you type anything here, you want to click the browse icon and let deltacopy fetch the available virtual directories.

This is where I am getting stuck. I am getting the following error from deltacopy:

Unable to fetch directory names. rsync: failed to connect to tower3: Connection refused (111)

Separately:

I also tried the following from a Telnet prompt: (NOTE I tried Tower3 and 192.168.2.132)

This was from WeeboTech http://lime-technology.com/forum/index.php?topic=2165.15

Tower3 login: root

Linux 3.4.11-unRAID.

root@Tower3:~# whereis rsync

rsync: /usr/bin/rsync /usr/bin/X11/rsync

root@Tower3:~# ls -l /usr/bin/rsync

-rwxr-xr-x 1 root root 361352 2010-02-28 20:38 /usr/bin/rsync*

root@Tower3:~# /usr/bin/rsync rsync://tower3

rsync: failed to connect to tower3: Connection refused (111)

rsync error: error in socket IO (code 10) at clientserver.c(122) [Receiver=3.0.7]

echo $PATH

root@Tower3:~# echo $PATH

/usr/local/sbin:/usr/sbin:/sbin:./:/usr/local/bin:/usr/bin:/bin:/usr/kerberos/bin:/usr/kerberos/sbin

root@Tower3:~# /usr/bin/rsync rsync://192.168.2.132/

rsync: failed to connect to 192.168.2.132: Connection refused (111)

rsync error: error in socket IO (code 10) at clientserver.c(122) [Receiver=3.0.7]

Did I miss a step? Do I have the code / scripts in the files wrong? I do not think it is a permissions issue seeing the security is set to public. Is it a problem with the unraid version I am using?

I attached my sys log. I do see where there is a line in the syslog that says:

get_config_idx: fopen /boot/config/shares/Backup.cfg: No such file or directory - assigning defaults

Do I need Backup.cfg for this to work, or is this a separate issue?

Thanks for any help on this.

Albin

System_Log.txt

User Customizations · January 17, 2013

I can't remember if I discovered that I had a bad memory stick before or after I ran the preclear. Could this would have caused bad results (if the bad stick was still in the machine)? Regardless, I am waiting for the new memory sticks to arrive, and then I am going to run the test again. Should I run the test with all the drives connected to the same slots, and review the results (maybe there is a chance the results would be different.... I am not sure how memory is allocated during the testing prior.... maybe sdd got allocated bad sections of memory? I am Totally guessing on this). Then if I get similar results to those posted, I could switch the drives around (different slots), and see what type of results I get.

I don't see any connection with memory here. I'll just add though that if I have any suspicions at all about the memory of a computer, then I consider that computer to be completely unusable! Period. When you get the new memory sticks, test them with memtest overnight, until you are completely confident in them.

By the way all the drives are connected to on board SATA slots. My first thought is that they should all have similar band widths, but maybe certain slots are designed, or are designated for higher bandwidth.

That pretty well rules out bandwidth differences, unless there was an issue with that specific port or cable. You might try preclearing the slow drive one more time connected to the cable and port used by one of the faster drives. And if you have the syslog during the slow drives preclear, check it for any drive-related errors/exceptions.

Rob,

I got the new memory in and then ran memtest for over night. I then ran a preclear on the same drives in the same slot. I got the same results as the reports I previously provided. I then switched moved the drive in sdd (the slowest drive) to sda and moved the drive in sda (the fastest drive) to sdd. I then ran the preclear again and I got similar results (the slowest drive was still finished 2 hours later) So it seems it is not a cable or slot issue.

I attached all three runs of the slow drive (Z2F0KS4Z) and one report of the fast drive (Z1E2EQXS) when it was on slot sdd.

I am not sure that I will use a speed test tool a 2 hour difference over a 24 hour preclear is not much, and I am guessing that the difference will not be that noticeable. I will put the fastest drive in the parity slot.

Albin

Z2F0KS4Z_sdd_2013-01-05.txt

Z2F0KS4Z_sdd_new_mem_2013-01-15.txt

Z2F0KS4Z_sda_new_mem_dif_slot_2013-01-16.txt

Z1E2EQXS_sdd_new_mem_dif_slot_2013-01-16.txt

User Customizations · January 12, 2013

I can't remember if I discovered that I had a bad memory stick before or after I ran the preclear. Could this would have caused bad results (if the bad stick was still in the machine)? Regardless, I am waiting for the new memory sticks to arrive, and then I am going to run the test again. Should I run the test with all the drives connected to the same slots, and review the results (maybe there is a chance the results would be different.... I am not sure how memory is allocated during the testing prior.... maybe sdd got allocated bad sections of memory? I am Totally guessing on this). Then if I get similar results to those posted, I could switch the drives around (different slots), and see what type of results I get.

I don't see any connection with memory here. I'll just add though that if I have any suspicions at all about the memory of a computer, then I consider that computer to be completely unusable! Period. When you get the new memory sticks, test them with memtest overnight, until you are completely confident in them.

By the way all the drives are connected to on board SATA slots. My first thought is that they should all have similar band widths, but maybe certain slots are designed, or are designated for higher bandwidth.

That pretty well rules out bandwidth differences, unless there was an issue with that specific port or cable. You might try preclearing the slow drive one more time connected to the cable and port used by one of the faster drives. And if you have the syslog during the slow drives preclear, check it for any drive-related errors/exceptions.

Rob,

Very helpful information... thanks. I will test the Memory sticks with memtest and when comfortable I will move forward with test as yoiu recommended for the drives.

Albin

User Customizations · January 12, 2013

I just did a preclear on (3) Seagate ST2000DM001-1CH164.

I ran the preclear on each drive at the same time (start time was only seconds apart)

2 of the drives sda and sdc were neck and neck the whole time (about 10 min total difference in run time)

sdd was over 2 hours of difference.

I got these drives from newegg and I was not impressed with the way they were packed so I may be over concerned about difference between the reports but sdd has a very big difference in the Seek_Error_Rate 8590654534 compared to the other drives at 745946 and 751820. I am not sure if this value is critical or not.

I also was not sure if this type reading may be do to a data or power cable.

I'll start by saying that all 3 drives look fine, no issues at all.

For the following, ignore the temperature SMART attributes (190 and 194), they have their own interpretation rules. For the rest, you should not look at the Raw numbers for most SMART attributes, just the VALUE column (and perhaps the WORST column), which are an attempt by the manufacturer to indicate its own valuation of the numbers. Generally the VALUE's will be from 1 to 100, but often they may be from 1 to 200, or even for a few Maxtors 1 to 253 (the 200's can be halved and considered as 100's). That means you can generally think of them as percentages of perfect, as in 100 is considered factory perfect and 1 is bottomed-out bad and 50 is probably not very good. So even though a Raw_Read_Error_Rate may have a very high raw number, if its VALUE is 100, then the drive manufacturer considers its read error rate to be perfectly normal. I think we look too fast at the raw numbers, most of them should be ignored. We should look first at all the 100's and/or 200's in the VALUE and WORST columns.

As to a possible cable issue, I see no evidence of that. Would need the corresponding syslog to know for sure.

From here on, I'm moving from factual to speculative, trying to come up with ideas why one drive performed somewhat slower, even though all 3 drives were identical, and had the same firmware version. The most likely reason is that different controller chipsets or busses were involved, and the slow drive was stuck with the slower hardware, was bullied out of a fair share of the I/O bandwidth available. You could verify this by swapping its connection with one of the fast drives, and retesting.

But since we're already speculating ... we'll drift a little farther out in left field. All 3 SMART reports were essentially identical, as would be expected by identical drives. But there were 2 odd differences, one was that the slow drive had a far higher SEEK_ERROR_RATE raw number (which we should normally ignore!), and the other was that the slow drive reported a much longer time needed for offline data collection, a fact that is really strange for identical drives! The fast drives sda and sdc reported they only need 80 seconds for offline data collection. The slow drive sdd reports it needs 139 seconds! I don't want to put too much importance on that, since the manufacturers do not provide any info on properly interpreting these numbers, but it does seem very odd, and perhaps indicative of a slower drive. And while I really don't want to draw any conclusions from the SEEK_ERROR_RATE raw number, it plausibly *may* represent the need for many more seeks than the other drives, and seeks are relatively slow actions. You might want to run a drive speed testing tool (HDTune?) on both the slow drive and a fast drive, and compare.

Now for some crazy speculation... Manufacturers like to cut corners. What if, to make 1TB, 2TB, 3TB, and 4TB drives, they just set up production lines for 4TB platter sets, and then when factory testing them, sell the partially defective ones as smaller drives. So if one cannot support 4TB, determine how much it CAN support and sell it accordingly. Now, what if a platter set had a bad region only in the faster tracks, but had 3TB available in the slower tracks? You would create a good 3TB drive, but it would be significantly slower than the average 3TB drive. No easy way to know for sure...

Rob,

Thanks for your reply / post.

I can't remember if I discovered that I had a bad memory stick before or after I ran the preclear. Could this would have caused bad results (if the bad stick was still in the machine)? Regardless, I am waiting for the new memory sticks to arrive, and then I am going to run the test again. Should I run the test with all the drives connected to the same slots, and review the results (maybe there is a chance the results would be different.... I am not sure how memory is allocated during the testing prior.... maybe sdd got allocated bad sections of memory? I am Totally guessing on this). Then if I get similar results to those posted, I could switch the drives around (different slots), and see what type of results I get.

By the way all the drives are connected to on board SATA slots. My first thought is that they should all have similar band widths, but maybe certain slots are designed, or are designated for higher bandwidth.

Albin

User Customizations · January 6, 2013

both look fine

Just checking to see if you were replying to both of usurpator's reports, all three of my reports, or both usurpator and I at the same time.

Thanks

Albin

User Customizations · January 5, 2013

Joe thanks for the up to date preclear.sh tool!

I just did a preclear on (3) Seagate ST2000DM001-1CH164.

I ran the preclear on each drive at the same time (start time was only seconds apart)

2 of the drives sda and sdc were neck and neck the whole time (about 10 min total difference in run time)

sdd was over 2 hours of difference.

This is my first time using the preclear method (I should have done this on all my previous drives, but I just learned about this).

I got these drives from newegg and I was not impressed with the way they were packed so I may be over concerned about difference between the reports but sdd has a very big difference in the Seek_Error_Rate 8590654534 compared to the other drives at 745946 and 751820. I am not sure if this value is critical or not.

I also was not sure if this type reading may be do to a data or power cable.

Thanks for any input on these reports.

Albin

sdd_preclear_rpt__Z2F0KS4Z_2013-01-05.txt

sda_preclear_rpt__Z1E2EQXS_2013-01-05.txt

sdc_preclear_rpt__Z1E2EYQD_2013-01-05.txt

November 9, 2011

To cleanly stop the array from the command line...

You must stop samba file sharing

killall smbd

killall nmbd

then you must un-mount the data disks

umount /dev/md1

umount /dev/md2

umount /dev/md3

etc...

you will not be able to un-mount them if they are busy. (yes, the command is "umount")

Then you can stop the array cleanly

/root/mdcmd stop

at that point you can shut down power in any way you like.

Thanks. I went through your suggested shut down steps, and then restarted the tower. I now have access to the GUI and it says "Parity-Check in progress". Now that I can get to the GUI I can post the version I am running 4.7

My final step is to figure out what to do with the following files:

272920_272962 50,003,968 07/09/2010 05:24 -a-- (687 files with this attribute)

5126_288531 2,659,392 03/17/2007 17:29 -ahs (001 files with this attribute)

2471_287910 21,504 06/21/2004 09:53 -ah- (001 files with this attribute)

4152_287911 8,192 12/18/2559 12:18 r--- (006 files with this attribute)

4152_287917 4,096 12/18/2559 12:18 ---- (001 files with this attribute)

Seeing the recovered file does not have an extension, Windows does not know what to do with it. I have opened a few in a text editor, but no luck at that. I added a jpg extension to the first file and I had no problem (able to open it). The second file I tried, jpg, doc, docx, xls, xlsx, tif, dxf, dwg, jif, wav, avi, and several other extensions (with no luck). Is there an easier way to do this? Does the a, ahs, ah, or r attribute give an hints to what they may be?

Thanks

November 8, 2011

Is the GUI still inaccessible? Do you have power down installed? You can try a short press of the power button (DO NOT hold it down).

The GUI is still inaccessible. :'(

I do not have power down installed. :'(

I have a few more question prior to trying a "short press" of the power button.

Seeing rebuild-tree fixed the errors and the second run of reiserfs shows no errors. Am I in any danger if I power down and parity is not valid? I could just try the "short press" power button, but I am nervous that I may be at risk of data loss if parity is not valid and the short press does not do a proper shut down.

Is it possible to install power down while unraid is running?

I just am making sure I explored all my options prior to trying a short press, or long press of the power button.

Thanks, Albin

Albin

Posts

Joined

Last visited

Content Type

Profiles

Forums

Downloads

Store

Gallery

Bug Reports

Documentation

Landing

Posts posted by Albin

Cannot Get an IP address

unRAID Server Release 5.0-rc11 Available

unRAID Server Release 5.0-rc11 Available

REISERFS error showing in syslog

unRAID Server Release 5.0-rc11 Available

REISERFS error showing in syslog

Syncing files between Unraid and multiple Laptops without the Cloud / DropBox

unRAID Server Release 5.0-rc11 Available

unRAID Server Release 5.0-rc11 Available

Syncing files between Unraid and multiple Laptops without the Cloud / DropBox

Syncing files between Unraid and multiple Laptops without the Cloud / DropBox

Syncing files between Unraid and multiple Laptops without the Cloud / DropBox

Syncing files between Unraid and multiple Laptops without the Cloud / DropBox

[SOLVED] Problem with Syncing a network share with a folder on my windows laptop

[SOLVED] Problem with Syncing a network share with a folder on my windows laptop

[SOLVED] Problem with Syncing a network share with a folder on my windows laptop

[SOLVED] Problem with Syncing a network share with a folder on my windows laptop

[SOLVED] Problem with Syncing a network share with a folder on my windows laptop

Preclear.sh results - Questions about your results? Post them here.

Preclear.sh results - Questions about your results? Post them here.

Preclear.sh results - Questions about your results? Post them here.

Preclear.sh results - Questions about your results? Post them here.

Preclear.sh results - Questions about your results? Post them here.

ReiserFS error: Should I use reiserfsck --rebuild-tree

ReiserFS error: Should I use reiserfsck --rebuild-tree