Albin

Members
  • Posts

    114
  • Joined

  • Last visited

Everything posted by Albin

  1. You didn't need to delete 'super.dat', but no mater. If you are certain parity is assigned correctly click 'Start'. Since the flash drive was backed up, Albin should be able to re-instate the super.dat file. I did back up the flash drive, so I just restored config/super.dat and now all the drives are green balled, and I am getting "configuration valid" I originally went from 4.7 to 5.0-beta12a a long time back, and had some issues with permissions. With this upgrade, I did not see specific instructions for going from 5.0-beta12a to 5.0-rc11, so I thought I may need to get rid of the Super.dat file and doing so might in someway help with my permissions issue (I am only guessing at that though). Should I keep the old super.dat (the one I restored) or should I remove it and do a "start" with out the super.dat file? I will hold off on starting the array, until I hear back. Thanks for your input on this Albin
  2. I did the following for this upgrade (after first backing up the flash drive) Copied the files bzimage and bzroot from the zip file to the root of your flash device Deleted config/passwd Deleted config/shadow Deleted config/smbpasswd Delete the file config/super.dat Booted up server re-assign hard drives to their correct device location The cache disk was already assigned to its correct location I am not seeing "Stopped Configuration Valid" but rather "Stopped. Initial configuration" I do not see "MBR: error", or "MBR: unknown" I have attached a syslog I am getting Blue Balls next to each of the devices (except for cache and flash... they are green) Do I need to check the box "Parity is Valid" and then click "START" next to "Start will record all disk information, bring the array on-line, and start Parity-Sync (if parity is present). The array is immediately available, but is unprotected until Parity-Sync completes."? I did not click on "Identify" tower2_syslog.txt
  3. I am only using it to do scheduled backups. I know I could have used something else for this but I wanted to play around with rsync in unRAID. I am also using rsync on unRAID to produce monthly backups of critical files to ntfs-3g mounted esata for storage offsite. I don't remember having to do anything on unRAID to enable ntpd. I just tell my windows machines to get the time from my unRAID server like this: I think deltacopy will be a good solution for the backups. I did try entering the server name tower2 for my windows machine to fetch the time. It worked on the new version of unraid, but when trying to fetch the time from my 4.7 version unraid (server name tower ), I got an error from windows. (so it works with the newer version anyway... not sure if there is a setting for 4.7 to make it work, but I do not need it to sync with that one.) Thanks again, Albin
  4. Thanks for the suggestion. It looks like deltaCopy will work fine for me if I have one client and Unraid as the server. I do not think it will do 2 clients and Unraid as the Server (maybe if I was a programmer I could do it.... I am not a programmer) If I uncheck "Remove deleted files from Server", I am guessing that would keep all files on the server are on Client 1 or Client 2. Let say that client 1, and Client 2 have files 1, 2, 3, 4 and the server has 1,2,3,4, If I delete file 1 from Client 2 with "Remove deleted files from Server" unchecked, then I would end up with Client 1 and the server having files 1,2,3,4 and client 2 having 2,3,4 Now if Client 1 changes file 2, (now 2rev1) (and then did a sync), Client 1 would have 1,2rev1,3,4 the server would have 1,2rev1,3,4, but Client 2 would have 2 (original),3,4. At this point if I do a sync on client 2, file 2rev1 would be over written and replaced with 2 (original), so the server would now have files 1,2 (original),3,4, going back to client 1 and doing a sync would over right 2 (original) with 2 rev1 on the server. Basically Client 1 and Client 2 are not working together together to have the same files (with the settings I currently have they will continue to fight over what version of file 2 will reside on the server). I am guessing that Client 1 does not know that client 2 even exists and vice versa, so they are just doing what they are told, and that is to make sure that the files on the server are the same as the ones on self, and do not remove deleted files from server) (I am sure there is a more technical way to explain this, but this is more the layman's terms for what the end result seems to be. Again, I understand rsync is powerful, but I do not have the knowledge to tackle writing the additional scripts, or parameters to make sure that client 1, client 2, and the server are all mirror each other. I did notice a nice feature where rysnc / deltacopy adjust the permissions of the files on the server in such a way that it seems you can not browse to the network share and delete or change files there. This is nice seeing it would force the use to make changes to the files on the client and then sync the changes to the unraid server. I did look at the "Additional Parameters" for deltacopy. DeltaCopy's site pointed me to a samba site http://www.samba.org/ftp/rsync/rsync.html There is a lot of stuff there to explain rsync and all the different commands that can be used. You mentioned that you are using DeltaCopy but not the way I am trying to use it. Do you mind explaining how you are using DeltaCopy? I did see that there is another product (other than deltacopy) that synametrics offers called Syncrify http://web.synametrics.com/SyncrifyVsDeltaCopy.htm http://web.synametrics.com/SyncrifyInstallationLinux.htm It looks like it can be installed on FreeNAS http://web.synametrics.com/syncrifyfreenas.htm I see RussellinSacto started a post on this product back in 2011 and ProStuff1 said he would look at some, but I do not see where any more post were made to indicate there was any more progress: http://lime-technology.com/forum/index.php?topic=13728.msg130496#msg130496 Syncrify seems to be more suited for what I am looking for. Has anyone looked at getting Syncrify server on an unraid system. Is it possible? Trurl By the way do you have a link to a lime-tech post explaining how to point a windows machine to the UNraid servers NTP / time to fetch the date and time? Thanks Albin
  5. I really never thought to look at that and honestly I had to look up what NTP Source was "Network Time Protocol" I really have not messed with that much, other than trying to using this to set the time on my routers. I went to the Unraid time settings to see what time zone I am using and I am using (UTC-05:00) eastern Time (US & Canada) and the current date and time look fine, but the "Use NTP" option is set to "NO" I set the "Use NTP" to "Yes", and set "NTP Server 1" to: 0.us.pool.ntp.org I then set the computers NTP Servers to: 0.us.pool.ntp.org (right clicked on the clock and clicked "adjust date/time", then picked the "Internet time" TAB and clicked change settings) I need to do this son my other unraid server, I think the time is off on that one. Thanks for the tip I then tried to force a sync, (right clicked the deltacopy profile name and clicked "run now"). Syncing this way give you a line by line view of what deltacopy is doing. I was getting a no such directory error. I deleted the profile, then recreated the profile and syncing started to semi work. I say semi because if I create a file (file1) on computer1, and then run a sync on computer1, the file is copied to the network share, but if I go to computer2 and run a sync, it deletes the file netwrok shares copy of file1 I just created. If I then create a file (file2) on computer2 and sync, the file2 shows on network share. At this point if I go to computer1 and run a sync, file2 is deleted and file1 is recopied to the network share. Are the above symptoms due to improper steps to setting up deltacopy. Do I need to set up the folder on each computer, leave them empty, then setup the deltacopy profiles, and then run a sync at both locations prior to putting any files in either place? Thanks for any help on this. Looks like I am one step close and I am excited that this is something that could work. Thanks Albin
  6. I just started using Rsync and Deltacopy to sync files between my laptop and a network share on my unraid server. http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145 '>http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145 ( Thanks WeeboTech and Tibbar ) http://lime-technology.com/forum/index.php?topic=25619.0 ( Thanks Trurl ) I wanted to know a little more about how this syncing works: I am syncing \\tower\Backup to D:\Backup If I create a file in D:\Backup it is appearing in \\tower\Backup which is great. My question is do most people using this only edit files at D:\Backup or is it ok to edit the file at \\tower\Backup ? As a test I created a test file in D:\Backup and then attempted to delete the file by browsing to \\tower\Backup to delete it. I got a message saying I needed permission to do this. Is this rsync stopping me from deleting the file? I also was wondering if I can have Computer-1, computer-2, and Computer-3 successfully syncing to \\tower\Backup I would like to have deltacopy on all three computers with the ability to add and edit files at each location, and have the ability to add a forth computer at a latter date and have all the past files propagate at the new location. Is the above possible? First when you setup deltacopy it seems if you want to sync a folder from your computer to the server you have to use the "Add Folder" option. (You can't just specify a folder), Meaning deltacopy will create a folder on the server when you say "add folder" so instead of all your files ending up at \\tower\Backup they will end up at \\tower\Backup\UnraidBackup ("UnraidBackup" is the name of the folder created with deltacopy when using "add folder" With that said I tried to add a second computer and use the same name on the second computer (each computer has a folder called UnraidBackup if the names are different like "UnraidBackup1"and "UnraidBackup2" then you end up with: \\tower\Backup\UnraidBackup1 \\tower\Backup\UnraidBackup2 and no files from computer 1 will end up at computer 2 or vice versa. Is there another way to approach this with deltacopy or do I need to use, unison to make this work? http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145 I am trying to make this work a little like dropbox, but locally, meaning I am not going from computer1 to cloud, then to computer2 (I just want to go from computer1 to server, to computer2 ) just want a solution without the cloud having to be involved. Thanks for any help on this. Albin
  7. TRURL, Thanks for your help. After going through all your suggestions in your last post and working on the reply during each step, it now works. I figured I would still post the entire thing with my step by step replies, in hopes it will help someone else. I get the following: Tower3 login: root Linux 3.4.11-unRAID. root@Tower3:~# rsync rsync://Tower3 rsync: failed to connect to Tower3: Connection refused (111) rsync error: error in socket IO (code 10) at clientserver.c(122) [Receiver=3.0.7 Here is the code in my S20-init.rsyncd file: #!/bin/bash if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi cp /boot/Custom/etc/rsyncd.conf /etc/rsyncd.conf Do you see anything I need to change? Here is the results of me doing: cat /etc/inetd.conf root@Tower3:~# cat /etc/inetd.conf # See "man 8 inetd" for more information. # # If you make changes to this file, either reboot your machine or send the # inetd a HUP signal: # Do a "ps x" as root and look up the pid of inetd. Then do a # "kill -HUP <pid of inetd>". # The inetd will re-read this file whenever it gets that signal. # # <service_name> <sock_type> <proto> <flags> <user> <server_path> <args> # # The first 4 services are really only used for debugging purposes, so # we comment them out since they can otherwise be used for some nasty # denial-of-service attacks. If you need them, uncomment them. # echo stream tcp nowait root internal # echo dgram udp wait root internal # discard stream tcp nowait root internal # discard dgram udp wait root internal # daytime stream tcp nowait root internal # daytime dgram udp wait root internal # chargen stream tcp nowait root internal # chargen dgram udp wait root internal time stream tcp nowait root internal time dgram udp wait root internal # # These are standard services: # # Very Secure File Transfer Protocol (FTP) server. ftp stream tcp nowait root /usr/sbin/tcpd vsftpd # # Professional File Transfer Protocol (FTP) server. #ftp stream tcp nowait root /usr/sbin/tcpd proftpd # # Telnet server: telnet stream tcp nowait root /usr/sbin/tcpd in.telnetd # # The comsat daemon notifies the user of new mail when biff is set to y: #comsat dgram udp wait root /usr/sbin/tcpd in.comsat # # Shell, login, exec and talk are BSD protocols # #shell stream tcp nowait root /usr/sbin/tcpd in.rshd -L #login stream tcp nowait root /usr/sbin/tcpd in.rlogind # exec stream tcp nowait root /usr/sbin/tcpd in.rexecd # talk dgram udp wait root /usr/sbin/tcpd in.talkd #ntalk dgram udp wait root /usr/sbin/tcpd in.talkd # # To use the talk daemons from KDE, comment the talk and ntalk lines above # and uncomment the ones below: # talk dgram udp wait root /usr/sbin/tcpd /usr/bin/kotalkd # ntalk dgram udp wait root /usr/sbin/tcpd /usr/bin/ktalkd # # Kerberos authenticated services # # klogin stream tcp nowait root /usr/sbin/tcpd rlogind -k # eklogin stream tcp nowait root /usr/sbin/tcpd rlogind -k -x # kshell stream tcp nowait root /usr/sbin/tcpd rshd -k # # Services run ONLY on the Kerberos server # # krbupdate stream tcp nowait root /usr/sbin/tcpd registerd # kpasswd stream tcp nowait root /usr/sbin/tcpd kpasswdd # # POP and IMAP mail servers # # Post Office Protocol version 3 (POP3) server: #pop3 stream tcp nowait root /usr/sbin/tcpd /usr/sbin/popa3d # Internet Message Access Protocol (IMAP) server: #imap2 stream tcp nowait root /usr/sbin/tcpd imapd # # The Internet Unix to Unix copy (UUCP) service: # uucp stream tcp nowait uucp /usr/sbin/tcpd /usr/lib/uucp/uucico - l # # Tftp service is provided primarily for booting. Most sites # run this only on machines acting as "boot servers." # tftp dgram udp wait root /usr/sbin/in.tftpd in.tftpd -s /tftpboo t -r blksize # # Internet Bootstrap Protocol (BOOTP) server: # bootps dgram udp wait root /usr/sbin/bootpd bootpd # # Finger, systat and netstat give out user information which may be # valuable to potential "system crackers." Many sites choose to disable # some or all of these services to improve security. # Try "telnet localhost systat" and "telnet localhost netstat" to see that # information yourself! #finger stream tcp nowait nobody /usr/sbin/tcpd in.fingerd -u # systat stream tcp nowait nobody /usr/sbin/tcpd /bin/ps -auwwx # netstat stream tcp nowait root /usr/sbin/tcpd /bin/netstat - a # # Ident service is used for net authentication #auth stream tcp wait root /usr/sbin/in.identd in.identd # # These are to start Samba, an smb server that can export filesystems to # Pathworks, Lanmanager for DOS, Windows for Workgroups, Windows95, Lanmanager # for Windows, Lanmanager for OS/2, Windows NT, etc. # If you're running smbd and nmbd as daemons in /etc/rc.d/rc.samba, then you # shouldn't uncomment these lines. #netbios-ssn stream tcp nowait root /usr/sbin/smbd smbd #netbios-ns dgram udp wait root /usr/sbin/nmbd nmbd # #Samba Web Administration Tool: #swat stream tcp nowait.400 root /usr/sbin/swat swat # # Sun-RPC based services. # <service name/version><sock_type><rpc/prot><flags><user><server><args> # rstatd/1-3 dgram rpc/udp wait root /usr/sbin/tcpd rpc.rstatd # rusersd/2-3 dgram rpc/udp wait root /usr/sbin/tcpd rpc.rusersd # walld/1 dgram rpc/udp wait root /usr/sbin/tcpd rpc.rwalld # # End of inetd.conf. root@Tower3:~# Here is what I got when doing: cat /etc/rsyncd.conf root@Tower3:~# cat /etc/rsyncd.conf cat: /etc/rsyncd.conf: No such file or directory OK I am sure that I copied the file using Midnight Commander http://lime-technology.com/wiki/index.php/UnRAID_Add_Ons#mc_.28Midnight_Commander_file_manager_-_version_2010-02-06_.29 I am not sure why after coping it over from /boot/Custom/etc/ that it was not there after a reboot. Is the path in step 7 above that I made bold really what you used or is that just a typo? The correct path should be the same as the cp command in the code in step 5: /etc/rsyncd.conf I did check this after you brought it to my attention, and I am sure I did not create a folder called Custom under /etc/, so there is no path called /etc/Custom/etc/ and no file seeing there is no path. I telneted back in through putty, and entered MC to get to Midnight Commander screen. Before copying the file over I went in (using the edit feature in MC) and check all the files I created or edited These files: /boot/Custom/etc/rc.d/S20-init.rsyncd /boot/Custom/etc/rsyncd.conf /boot/config/go When looking at them I saw the following at the end of every line ^M I removed the 2 spaces prior to the ^M and I removed the ^M for each line in each file. Only a few lines in my "go" file had this. one was a comment line so I am guessing that had no impact, but I think the other line was /usr/local/sbin/emhttp & which would right where I needed to do a carriage return to start the newly created line for /boot/Custom/etc/rc.d/S20-int.rsyncd So those " ^M " are all removed With the ^M remvoed from the files I copied rsyncd.conf from /boot/Custom/etc/ to /etc/ I went through and fixed all these locations, so any place where I had "custom" I changed it to "Custom" You were very helpful. Thanks so much. I will have to say I fixed the upper / lower case issue for "custom" / "Custom" first, then I removed the ^M from the files, then copied the rsyncd.conf file to /etc/. I think I did a reboot in between step one and 2 but I am not sure. I know I did a reboot after all three. So what I do not know is if one of the above, a combination of the above, or all of the above were the problems. Needless to say you helped me check all the write areas, and I now I get the following when doing rsync rsync://tower3 root@Tower3:/boot/config# rsync rsync://tower3 backup Backup or doing rsync rsync://192.168.2.132 root@Tower3:/boot/config# rsync rsync://192.168.2.132 backup Backup DeltaCopy now fetches the virtual directory "backup" with either a server name tower3 or 192.168.2.132 Now I need to spend some time figuring out DeltaCopy's options, and start syncing files. I will go back and fix any other errors in my original post and mark it as solved Thanks again, Albin
  8. I think I had a firewall entry because I was also playing around with rsync going the other way, hence an entry for DeltaCopy Server, but there shouldn't need to be one for the client since it is outgoing. My unRAID is named unSERVER. When I do: rsync rsync://unSERVER I get a listing of the stuff I configured in /etc/rsyncd.conf I'm not real good with linux but I think the script in S20-init.rsyncd is checking for an rsync entry in /etc/inetd.conf and if it doesn't exist it appends: rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon to it, and if I do: cat /etc/inetd.conf I can see that line at the end so you might check that and also: cat /etc/rsyncd.conf to make sure it has what you intend in it as well. One other thing I noticed in your original post, in some places you have "Custom" in the path and some places just "custom". Linux is case-sensitive so make sure you are using the same case everywhere. Thanks for check this over. I am going to go back through this tomorrow and try what you suggested. I think I have some "Custom" / "custom" errors Thanks Albin
  9. Some of the errors I mention are when I telnet in. I do not see how those errors could be firewall related. I did turn off the firewall and tried detacopy with the firewall off. I got the same error / message Thanks Albin
  10. Is the path in step 7 above that I made bold really what you used or is that just a typo? The correct path should be the same as the cp command in the code in step 5: /etc/rsyncd.conf Also, what editor did you use to create these files? You must be sure to use an editor that can save text in Unix-compatible form; i.e., with LF for newline instead of CR/LF as is done by Windows. Search for notepad++ if you don't have an editor that will do this. Thanks for your reply. /etc/Custom/etc/rsyncd.conf was typo when creating the post (sorry about that) I used /etc/rsyncd.conf I will correct the post The editor I use is notepad++ (I think I started using notepad++ when I started using Unraid for the first time) I think I answered all your questions. Thanks Albin
  11. UnRaid version: 5.0-rc8a DeltaCopy Version 1.4 (installed on Windows Vista Home Premium SP3) (I could use unison if that would be easier) http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145 I have been wanting to sync files between my server and my laptop and attempted to follow WeeboTech and Tibbar "How to" to get this working. http://lime-technology.com/forum/index.php?topic=2165.msg16145#msg16145 I figured I would layout all the steps that I went through which came from the "How to" (Thanks WeeboTech and Tibbar) Maybe I missed one of the steps or did not do one of the steps properly. Steps already completed: Short description of the steps: Created the following folders and files /boot/Custom (Folder) /boot/Custom/etc (Folder) /boot/Custom/etc/rc.d (Folder) /boot/Custom/etc/rsyncd.conf (File)(see below for code inserted in filed) /boot/Custom/etc/rc.d/S20-init.rsyncd (File)(see below for code inserted in filed) Edited "GO" Script (see below for code) Copied the rsyncd.conf from /boot/Custom/etc/rsyncd.conf to /etc/rsyncd.conf Created a network share called "Backup" Rebooted the Unraid Server Installed DeltaCopy and attempted to fetch the directory names (this failed) Detailed Steps (long version of the steps): 1. Created folder called "Custom" on Flash Drive full path = /boot/Custom full path if flash drive is mounted to windows= /Custom 2. Created sub folder called "etc" full path = /boot/Custom/etc full path if flash drive is mounted to windows= /Custom/etc 3. Created sub folder called "rc.d" full path = /boot/Custom/etc/rc.d full path if flash drive is mounted to windows= /Custom/etc/rc.d 4. Created file in sub-folder "etc" file name "rsyncd.conf" full path = /boot/Custom/etc/rsyncd.conf full path if flash drive is mounted to windows= /Custom/etc/rsyncd.conf Code in file called rsyncd.conf gid = root uid = root use chroot = 4 max connections = 4 pid file = /var/run/rsyncd.pid timeout = 600 [backup] path = /mnt/disk1/Backup comment = Backup read only = FALSE list = yes *I noticed the code is pointing to a disk then a folder and under stand that I could use /mnt/Backup seeing I did create a network share called Backup. I currently left this the way it is, and I am assuming it should work, but maybe I am assuming wrong? 5. Creadted file in sub-folder "rc.d" file name S20-init.rsyncd code placed in file #!/bin/bash if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi cp /boot/custom/etc/rsyncd.conf /etc/rsyncd.conf 6. Edited the file called "GO" located in /boot/config full path = /boot/config/go full path if flash drive is mounted to windows= /config/go Code added as last line in the "GO" file /boot/custom/etc/rc.d/S20-init.rsyncd 7. Copied the rsyncd.conf from /boot/Custom/etc/rsyncd.conf to /etc/rsyncd.conf To do this I Telnet http://lime-technology.com/wiki/index.php/Telnet in to the server via putty After entering my login credentials I typed MC for midnight commander and navigated to /etc in the left pane and /boot/Custom/etc in the right pane, then clicked on the rsyncd.conf file and hit copy. 8. I created a network share called Backup (currently export is set to "YES" and security is set to "PUBLIC") 9. Downloaded and installed DeltaCopy to windows vista 10 ran deltacopy client used the "add New Profile" icon profile name "Backup" Server IP/HOST Name: 192.168.2.132 (also tried Tower3) This would be Tower for most users) Virtual Directory Name, I do not think you type anything here, you want to click the browse icon and let deltacopy fetch the available virtual directories. This is where I am getting stuck. I am getting the following error from deltacopy: Unable to fetch directory names. rsync: failed to connect to tower3: Connection refused (111) Separately: I also tried the following from a Telnet prompt: (NOTE I tried Tower3 and 192.168.2.132) This was from WeeboTech http://lime-technology.com/forum/index.php?topic=2165.15 Tower3 login: root Linux 3.4.11-unRAID. root@Tower3:~# whereis rsync rsync: /usr/bin/rsync /usr/bin/X11/rsync root@Tower3:~# ls -l /usr/bin/rsync -rwxr-xr-x 1 root root 361352 2010-02-28 20:38 /usr/bin/rsync* root@Tower3:~# /usr/bin/rsync rsync://tower3 rsync: failed to connect to tower3: Connection refused (111) rsync error: error in socket IO (code 10) at clientserver.c(122) [Receiver=3.0.7] echo $PATH root@Tower3:~# echo $PATH /usr/local/sbin:/usr/sbin:/sbin:./:/usr/local/bin:/usr/bin:/bin:/usr/kerberos/bin:/usr/kerberos/sbin root@Tower3:~# /usr/bin/rsync rsync://192.168.2.132/ rsync: failed to connect to 192.168.2.132: Connection refused (111) rsync error: error in socket IO (code 10) at clientserver.c(122) [Receiver=3.0.7] Did I miss a step? Do I have the code / scripts in the files wrong? I do not think it is a permissions issue seeing the security is set to public. Is it a problem with the unraid version I am using? I attached my sys log. I do see where there is a line in the syslog that says: get_config_idx: fopen /boot/config/shares/Backup.cfg: No such file or directory - assigning defaults Do I need Backup.cfg for this to work, or is this a separate issue? Thanks for any help on this. Albin System_Log.txt
  12. I don't see any connection with memory here. I'll just add though that if I have any suspicions at all about the memory of a computer, then I consider that computer to be completely unusable! Period. When you get the new memory sticks, test them with memtest overnight, until you are completely confident in them. That pretty well rules out bandwidth differences, unless there was an issue with that specific port or cable. You might try preclearing the slow drive one more time connected to the cable and port used by one of the faster drives. And if you have the syslog during the slow drives preclear, check it for any drive-related errors/exceptions. Rob, I got the new memory in and then ran memtest for over night. I then ran a preclear on the same drives in the same slot. I got the same results as the reports I previously provided. I then switched moved the drive in sdd (the slowest drive) to sda and moved the drive in sda (the fastest drive) to sdd. I then ran the preclear again and I got similar results (the slowest drive was still finished 2 hours later) So it seems it is not a cable or slot issue. I attached all three runs of the slow drive (Z2F0KS4Z) and one report of the fast drive (Z1E2EQXS) when it was on slot sdd. I am not sure that I will use a speed test tool a 2 hour difference over a 24 hour preclear is not much, and I am guessing that the difference will not be that noticeable. I will put the fastest drive in the parity slot. Albin Z2F0KS4Z_sdd_2013-01-05.txt Z2F0KS4Z_sdd_new_mem_2013-01-15.txt Z2F0KS4Z_sda_new_mem_dif_slot_2013-01-16.txt Z1E2EQXS_sdd_new_mem_dif_slot_2013-01-16.txt
  13. I don't see any connection with memory here. I'll just add though that if I have any suspicions at all about the memory of a computer, then I consider that computer to be completely unusable! Period. When you get the new memory sticks, test them with memtest overnight, until you are completely confident in them. That pretty well rules out bandwidth differences, unless there was an issue with that specific port or cable. You might try preclearing the slow drive one more time connected to the cable and port used by one of the faster drives. And if you have the syslog during the slow drives preclear, check it for any drive-related errors/exceptions. Rob, Very helpful information... thanks. I will test the Memory sticks with memtest and when comfortable I will move forward with test as yoiu recommended for the drives. Albin
  14. I'll start by saying that all 3 drives look fine, no issues at all. For the following, ignore the temperature SMART attributes (190 and 194), they have their own interpretation rules. For the rest, you should not look at the Raw numbers for most SMART attributes, just the VALUE column (and perhaps the WORST column), which are an attempt by the manufacturer to indicate its own valuation of the numbers. Generally the VALUE's will be from 1 to 100, but often they may be from 1 to 200, or even for a few Maxtors 1 to 253 (the 200's can be halved and considered as 100's). That means you can generally think of them as percentages of perfect, as in 100 is considered factory perfect and 1 is bottomed-out bad and 50 is probably not very good. So even though a Raw_Read_Error_Rate may have a very high raw number, if its VALUE is 100, then the drive manufacturer considers its read error rate to be perfectly normal. I think we look too fast at the raw numbers, most of them should be ignored. We should look first at all the 100's and/or 200's in the VALUE and WORST columns. As to a possible cable issue, I see no evidence of that. Would need the corresponding syslog to know for sure. From here on, I'm moving from factual to speculative, trying to come up with ideas why one drive performed somewhat slower, even though all 3 drives were identical, and had the same firmware version. The most likely reason is that different controller chipsets or busses were involved, and the slow drive was stuck with the slower hardware, was bullied out of a fair share of the I/O bandwidth available. You could verify this by swapping its connection with one of the fast drives, and retesting. But since we're already speculating ... we'll drift a little farther out in left field. All 3 SMART reports were essentially identical, as would be expected by identical drives. But there were 2 odd differences, one was that the slow drive had a far higher SEEK_ERROR_RATE raw number (which we should normally ignore!), and the other was that the slow drive reported a much longer time needed for offline data collection, a fact that is really strange for identical drives! The fast drives sda and sdc reported they only need 80 seconds for offline data collection. The slow drive sdd reports it needs 139 seconds! I don't want to put too much importance on that, since the manufacturers do not provide any info on properly interpreting these numbers, but it does seem very odd, and perhaps indicative of a slower drive. And while I really don't want to draw any conclusions from the SEEK_ERROR_RATE raw number, it plausibly *may* represent the need for many more seeks than the other drives, and seeks are relatively slow actions. You might want to run a drive speed testing tool (HDTune?) on both the slow drive and a fast drive, and compare. Now for some crazy speculation... Manufacturers like to cut corners. What if, to make 1TB, 2TB, 3TB, and 4TB drives, they just set up production lines for 4TB platter sets, and then when factory testing them, sell the partially defective ones as smaller drives. So if one cannot support 4TB, determine how much it CAN support and sell it accordingly. Now, what if a platter set had a bad region only in the faster tracks, but had 3TB available in the slower tracks? You would create a good 3TB drive, but it would be significantly slower than the average 3TB drive. No easy way to know for sure... Rob, Thanks for your reply / post. I can't remember if I discovered that I had a bad memory stick before or after I ran the preclear. Could this would have caused bad results (if the bad stick was still in the machine)? Regardless, I am waiting for the new memory sticks to arrive, and then I am going to run the test again. Should I run the test with all the drives connected to the same slots, and review the results (maybe there is a chance the results would be different.... I am not sure how memory is allocated during the testing prior.... maybe sdd got allocated bad sections of memory? I am Totally guessing on this). Then if I get similar results to those posted, I could switch the drives around (different slots), and see what type of results I get. By the way all the drives are connected to on board SATA slots. My first thought is that they should all have similar band widths, but maybe certain slots are designed, or are designated for higher bandwidth. Albin
  15. Just checking to see if you were replying to both of usurpator's reports, all three of my reports, or both usurpator and I at the same time. Thanks Albin
  16. Joe thanks for the up to date preclear.sh tool! I just did a preclear on (3) Seagate ST2000DM001-1CH164. I ran the preclear on each drive at the same time (start time was only seconds apart) 2 of the drives sda and sdc were neck and neck the whole time (about 10 min total difference in run time) sdd was over 2 hours of difference. This is my first time using the preclear method (I should have done this on all my previous drives, but I just learned about this). I got these drives from newegg and I was not impressed with the way they were packed so I may be over concerned about difference between the reports but sdd has a very big difference in the Seek_Error_Rate 8590654534 compared to the other drives at 745946 and 751820. I am not sure if this value is critical or not. I also was not sure if this type reading may be do to a data or power cable. Thanks for any input on these reports. Albin sdd_preclear_rpt__Z2F0KS4Z_2013-01-05.txt sda_preclear_rpt__Z1E2EQXS_2013-01-05.txt sdc_preclear_rpt__Z1E2EYQD_2013-01-05.txt
  17. Thanks. I went through your suggested shut down steps, and then restarted the tower. I now have access to the GUI and it says "Parity-Check in progress". Now that I can get to the GUI I can post the version I am running 4.7 My final step is to figure out what to do with the following files: 272920_272962 50,003,968 07/09/2010 05:24 -a-- (687 files with this attribute) 5126_288531 2,659,392 03/17/2007 17:29 -ahs (001 files with this attribute) 2471_287910 21,504 06/21/2004 09:53 -ah- (001 files with this attribute) 4152_287911 8,192 12/18/2559 12:18 r--- (006 files with this attribute) 4152_287917 4,096 12/18/2559 12:18 ---- (001 files with this attribute) Seeing the recovered file does not have an extension, Windows does not know what to do with it. I have opened a few in a text editor, but no luck at that. I added a jpg extension to the first file and I had no problem (able to open it). The second file I tried, jpg, doc, docx, xls, xlsx, tif, dxf, dwg, jif, wav, avi, and several other extensions (with no luck). Is there an easier way to do this? Does the a, ahs, ah, or r attribute give an hints to what they may be? Thanks
  18. The GUI is still inaccessible. :'( I do not have power down installed. :'( I have a few more question prior to trying a "short press" of the power button. Seeing rebuild-tree fixed the errors and the second run of reiserfs shows no errors. Am I in any danger if I power down and parity is not valid? I could just try the "short press" power button, but I am nervous that I may be at risk of data loss if parity is not valid and the short press does not do a proper shut down. Is it possible to install power down while unraid is running? I just am making sure I explored all my options prior to trying a short press, or long press of the power button. Thanks, Albin
  19. I reran rieserfsck and here is the out put: ########### reiserfsck --check started at Mon Nov 7 20:41:23 2011 ########### Replaying journal: Done. Reiserfs journal '/dev/md4' in blocks [18..8211]: 0 transactions replayed Checking internal tree.. finished Comparing bitmaps..finished Checking Semantic tree: finished No corruptions found There are on the filesystem: Leaves 156339 Internal nodes 1028 Directories 13983 Other files 470018 Data block pointers 84486375 (143506 of them are zero) Safe links 0 ########### reiserfsck finished at Mon Nov 7 21:20:46 2011 ########### After starting Samba and remounted disk4, I tried killall emhttp nohup /usr/local/sbin/emhttp & I was unable to access the GUI but I did get the following: [1] 5351 nohup: ignoring input and appending output to `nohup.out' Is there a way to invoke a parity check from telnet / putty?
  20. I performed the "rebuild tree" via telnet/putty and after it completed I went through the steps to resume normal operation (so all shares would be visible) Here are the last lines of the Rebuild-Tree: (full log attached) =================================================================== Flushing..finished03, 33 /sec Objects without names 705 Dirs linked to /lost+found: 9 Dirs without stat data found 3 Files linked to /lost+found 696 Objects having used objectids: 684 files fixed 676 dirs fixed 8 Pass 4 - finished done 155681, 57 /sec Deleted unreachable items 23 Flushing..finished Syncing..finished ########### reiserfsck finished at Thu Nov 3 03:13:35 2011 ########### root@Tower:~# ===================================================== I mapped a network drive for Disk 4 and see there is a "lost+found" folder (below is an abbreviated print of the directory tree) (attached is the full tree) File/Folder Name Size DATE Attribute 1121_272857\ <DIR> 11/02/2011 22:56 ---- (04 files with original name) 1121_272870\ <DIR> 06/01/2007 16:11 ---- (12 files with original name) 1121_272871\ <DIR> 06/01/2007 16:11 ---- (Empty Folder) 1122_272872\ <DIR> 06/01/2007 16:03 ---- (Empty Folder) 133_272852\ <DIR> 06/01/2007 15:55 ---- (Folder with 2 Files original names) 2480_283471\ <DIR> 06/01/2007 16:04 ---- (Empty) 264783_283477\ <DIR> 11/02/2011 22:57 ---- (04 files with original name) 272849_272874\ <DIR> 11/02/2011 22:57 ---- (Empty) 5889_283472\ <DIR> 06/01/2007 16:36 ---- (33 files with original name) 272920_272962 50,003,968 07/09/2010 05:24 -a-- (687 with this attribute) 5126_288531 2,659,392 03/17/2007 17:29 -ahs (001 with this attribute) 2471_287910 21,504 06/21/2004 09:53 -ah- (001 with this attribute) 4152_287911 8,192 12/18/2559 12:18 r--- (006 with this attribute) 4152_287917 4,096 12/18/2559 12:18 ---- (001 with this attribute) ==================================== This may or may not be related to the rebuild-tree but I can't get to the GUI for this tower. So I am not sure of the condition or state of of the parity file/s is. Is there a way to restart the GUI? I do not have unmenu installed. I am not sure of the version I am running (I know I am not running 5.x (I do have a recent syslog but where in the file is the version number)) (Is there a way to see the version in telnet/putty) I am not sure how safe it is to power down without knowing the state of Parity. So right now I need to know the safest method to reboot the server (or restart the GUI), with the above considered? Is there a specific method or program for determining what file types these recovered files are (other than trial and error)? After Rebuild-tree I did a back up of the syslog, but can't access it at the moment (I tried to map a network drive for \\tower\flash but it did not work) lost-and-found.txt rebuild-tree-log.txt
  21. Thanks for the reply. I will run rebuild-tree and post a status soon.
  22. I was asked to move this post to its own thread: I was having problems with read only state/s and when looking at the syslog it was apparent the issue was md4. I ran reiserfsck as per wiki http://lime-technology.com/wiki/index.php?title=Check_Disk_Filesystems cd [this will make sure you are in the /root directory] samba stop [all your shares will disappear from network] umount /dev/md4 ['md4' corresponds to disk4, note it is 'umount', not 'unmount'] reiserfsck --check /dev/md4 [answer with the word Yes when prompted, do not type yes or YES, but Yes (capital Y and lower case es)] After reiserfsck finished I got a message saying, "3 found corruptions can be fixed only when running with --rebuild-tree" (am I to take this as "your are being instructed by reiserfsck to run --rebuild-tree?) I may be over thinking this, but I surely do not want to loose data. Wiki says, "Important Note!!! Do NOT run reiserfsck with the --rebuild-sb or --rebuild-tree switches, unless you are instructed to, by the instruction of a previous run of reiserfsck, or by an expert user!" Am I ok to proceed with: reiserfsck --rebuild-tree /dev/md4 [answer with Yes when prompted. (capital Y and lower case es)] I am just needing some assurance from an "EXPERT USER" that this is the best thing for me to do. (PS I do not currently have UnMenu installed) Albin
  23. Sorry for hijacking the thread. I am still learning about Forum/Posting Etiquette. I thought that it is better to find similar threads and keep similar problems in similar places, and starting new forums on similar topics is frowned upon. I guess I got that wrong. Thanks for the heads up. I will remove my post and start a separate thread.
  24. I was having problems with read only state/s and when looking at the syslog it was apparent the issue was md4. I ran reiserfsck as per wiki http://lime-technology.com/wiki/index.php?title=Check_Disk_Filesystems cd [this will make sure you are in the /root directory] samba stop [all your shares will disappear from network] umount /dev/md4 ['md4' corresponds to disk4, note it is 'umount', not 'unmount'] reiserfsck --check /dev/md4 [answer with the word Yes when prompted, do not type yes or YES, but Yes (capital Y and lower case es)] After reiserfsck finished I got a message saying, "3 found corruptions can be fixed only when running with --rebuild-tree" (am I to take this as "your are being instructed by reiserfsck to run --rebuild-tree?) I may be over thinking this, but I surely do not want to loose data. Wiki says, "Important Note!!! Do NOT run reiserfsck with the --rebuild-sb or --rebuild-tree switches, unless you are instructed to, by the instruction of a previous run of reiserfsck, or by an expert user!" Am I ok to proceed with: reiserfsck --rebuild-tree /dev/md4 [answer with Yes when prompted. (capital Y and lower case es)] I am just needing some assurance from an "EXPERT USER" that this is the best thing for me to do. (PS I do not currently have UnMenu installed) Albin
  25. Thanks... I did a hard shut down, and restarted. i waited for it to complete a parity check and then I tried the "New Permissions" start button again. It seems it did not lock up this time and I can browse all the pages of the GUI. Is there anything in the Syslog that will indicate that Unraid completed the permission changes to all the files? How do you know it is done? Does the "start" button under the "New Permissions" get grayed out, or does it change to "completed" Thanks for any help on this. Still not sure that the Permissions were reset. I tried again, and it locked up again. Any suggestons? I took a picutre of the info on the screen prior to doing a hard shut down. I am also attaching the syslog that I saved prior to clicking the "start" button under "New Permissions" If any one can shed some light on this, I would greatly appreciate it. 11-3-10_1436pmsyslog_PART-1.txt 11-3-10_1436pm_syslog_PART-2.txt