Data Corruption

[DArthur]

Has anyone else seen consistent data corruption?

 

I made the mistake of transferring all of my DVD/AVC rips to my new unraid server (600 Gig), and then cleaning out the original fileserver.  Initial inspection of the files seemed fine.  Upon closer eval, it appears that the majority of these files are corrupt.  I get lots of what appears as MPEG noise and stutters on DVD-rip playback, and ALL of the AVC files freeze upon playback.  Copying the files to the local HD does not clear up the problem (so it's not a network issue upon playback).  All of the files were originally copied using drag-n-drop from windows.

 

I've also noticed that using DVD-Decryptor writing directly to the un-raid server is quited a bit slower than ripping to a local drive (3 x slower).  Tried ripping Aladdin - the RIP was corrupt.  Ripped to local harddrive, then copied it to the UN-raid server, and the Rip was fine. 

 

I'm a little pissed.

 

Running with all recommend hardware (Intel MB, and 4 seagate 400Gig drives.  Have a promise controller installed, but not using it.  512MB RAM.  Set all of the BIOS Par ms as per instructions.  Version 2.060324

 

Anyone have any ideas?  I could live without using this system as my PVR (although I'd hoped to be able to).  But not to be able to use it as a reliable video-file server is ridiculous...

 

Anyone with any ideas? 

 

thanks,

 

Darryl

[herg]

Darryl,

 

This is not apples to apples since I'm running currently running SLAX from a flash drive until I feel comfortable enough to purchase UnRaid.  Hardware is a Intel D915GEVLK, 512 MB RAM, one Seagate 300 GB SATA drive, and two old PATA drives.

 

Using DVD Decrypter writing across the network directly to my server, I also see slower than expected performance and corrupt files.  I am currently using a combination of AnyDVD and DVD Shrink (No compression, reauthor, movie-only) with great success.

 

My PC has two DVD drives on separate IDE channels, and I can rip two DVDs in parallel directly to my server in less than 30 minutes.

 

I have a feeling that DVD Decrypter is the source of your second problem rather than UnRaid.

 

Herg

[TCIII]

herg,

 

I too use AnyDVD, but I use CloneDVD2 instead of DVDShrink or DVDDecrypter and have had no problems with data corruption writing directly to the unRaid server.

 

I can usually rip just the main title and AC3 sound track of a two hour DVD to the unRaid server in about 10 to 15 minutes over my 10/100 LAN.

 

The time does not change if I rip from a PC that is tied directly to the unRaid server over a 1GB LAN indicating that the unRaid OS is the slowest link in the chain.

 

Regards,

TCIII

[DArthur]

Unfortunately,  the majority of my rips were done using DVDShrink, and played well from my old Raid 5 box (no defunct) - So I know that the original rips were fine.  Also, I tested each DVD/AVC re-encode after completion, so I know that the MPEG 4 files were fine.  Now (after copying to the Un-RAID), they immediately freeze.

 

I'm positive that something happened in the original content move to cause file corruption.  I'm just trying to figure out what it could be.  I'll do some more testing and report back.

 

I'll also try ripping to the Un-RAID using DVDShrink.

 

thanks for all the responses so far!

 

Darryl

[DArthur]

Well more testing shows that there is definately a problem.  I used both DVDDecryptor and DVDShrink to create a Rip on a local harddrive.  playback was fine for both Rips (Matrix and Lost in Space).  Copied the files to the UnRAID server, and immediately noticed above mentioned problems upon playback.  This appears to be a write problem, as the errors show up in the exact same spot upon playback.

 

I've sent an email to support - anyone have any more ideas?

 

thanks,

 

Darryl

[limetech]

Sorry you've been having some playback issues; hopefully we can get them resolved.  First, a few questions:

 

If you run a parity-check, does it complete without error?

 

During normal playback do you ever see the Error counters increase?

 

Do you have just these two movies on the disk?  If not, do the other movies play back ok?

 

Something to try: "Rename" one of the movies which has a playback problem to some other name, e.g, "Matrix-original".  Then copy Matrix from local disk to UnRaid again, and watch that version to see if playback problems occur in the same place.

 

 

 

[DArthur]

OK - further testing...

 

I've run a parity-check, no problems.

 

Error counters do not increase during writing or playback.  Error counters have never incremented since I built the unit.

 

Movies play back fine from the physical DVD, and a ripped copy on the local (playback machine) hard drive.  Playback from the un-raid sever consistently causes what appears to be MPEG macro-blocking and stuttering.  I've also tried play back on two different "client" machines.  Both exhibit the same problem.

 

I renamed the ripped folder for "Lost in Space" and created another rip.  Both Rips playback with problems.  Each "rip" consistenly shows the same playback problems at the same spot - however, the two rips have problems at different spots.  So the error are internally consistent to each copy.

 

I copied the same rip I used for the un-raid tests to another PC connected to the same router as the un-raid server.  No problems with playback.

 

I also looked at the network utilization in windows task manager during the rip file copy to the Un-raid server.  Averaged about 80% on my 100MB LAN.  Consistant "Spikes" in utilization, similar to what others have reported in this forum.

 

I'm open to other testing, but I would like to get this problem resolved.  I've got > 50 DVDs to re-rip, and I've probably lost about 20 High-Def movies.

 

I'm currently using (what I think is) the latest Beta.  Should I try the latest public release? if so, how do I obtain a copy (the unit I purchased was loaded with the latest Beta).

 

System is completely stable - no lockups, reboots, etc.

 

Any more ideas?

 

thank you,

 

Darryl

[lovingHDTV]

Have you copied a movie from the UnRaid back to a local pc and tried to play that back?

 

If it works, then you know the copy is good and the issue is something else.

 

[limetech]

Have you copied a movie from the UnRaid back to a local pc and tried to play that back?

 

If it works, then you know the copy is good and the issue is something else.

 

 

I was going to recommend opening a command window and using

fc 

to compare the files of the two movies, but lovingHDTV's idea is simpler and probably just as effective.  Copy a problemtaic movie from the UnRaid back to local disk & see if it still has playback problems.  This would let us determine if actual data corruption is taking place.

[DArthur]

OK -

 

Did both.  Copied the "Lost in Space" folder back to local play-back PC and problems were still there.  Performed a fc using local copy of (.vob file) Aladdin and Un-RAID .vob file and lots of errors immediately.

 

Darryl

[DArthur]

I'll also try copying to another controller/disk/cable combo to see if that has any effect...

 

Darryl

[DArthur]

Latest testing since I last posted:

 

Swapped out both switches (10/100) with two new gigabit switches (planned on the upgrade already).

 

Copied ripped files to every drive on Un-RAID server (disk 1,2,3) - all on the two PATA controllers included with the MB.  Still see the corruption on all 3 drives.

 

Swapped out my 2 256MB DIMMS for 1 Gig DIMM - still see corruption. 

 

replaced ethernet cable between switch and Un-RAID - still see corruption.

 

Any other ideas?

 

I would assume that if it was the memory, i'd be seeing other problems as well -

 

Is it time to replace the Un-RAID USB drive with a new one/current shipping version?

 

Darryl

[TCIII]

DArthur,

 

How big is your unRaid's power supply?

 

I feel that with what the motherboard, four drives, and fans draw in the way of power, you should have at least a 430watt power supply if you are running only one supply.

 

Just a thought.

 

Regards,

TCIII

[DArthur]

TCIII,

 

Thanks for the reply.  I'm using an Antec server PS - 500W with 2 18amp rails - I've also tried another PS.  I've been in contact with Tom via email, and we've been trouble shooting the problem.  I've tried just about everything:

 

different PS

different Memory (ran mem86 test to be sure)

different IDE cables

tried all drives

unplugged all but 2 drives (parity and data)

 

and still trying to find the problem...

 

Darryl

 

 

[erikatcuse]

Have you tried a direct connection to the server?  If you have a laptop close by or a computer just run the ethernet from one to the other.  If it works you know its your network, if it doesn't then maybe your mobo is bad 

[DArthur]

Do you have to use a cross-over cable for direct connect?

[limetech]

Do you have to use a cross-over cable for direct connect?

 

Not with a D865GLCLK motherboard.

[DArthur]

Just to keep everyone up-to-date:

 

I installed XP pro on the Server, and lo and behold, data corruption when copying files over the network.  So, I'm RMAing the MB back to ZipZoomFly. 

 

Generous Kudos to Tom through all this.  We've been emailing back and forth to troubleshoot this problem.  Hopefully when I get my new MB, I can finally get my video server up and going.

 

Thanks everyone!

 

Darryl