This is what I came up with!
With 120GB SATA 1 drive installed as a cache drive. I was getting writes speeds of 23MBs.
Took 1.5TB SATA 2 parity out of the array and added as a cache drive.
Copied files directly to cache share and received transfer rates between 76MBs and 102Mbs on the Writes
Copied files to the array and received transfer rates between 18Mbs and 20Mbs on the Writes
Some reason I notice there is no files in the cache drive that was copied to the array. I think the files copied directly to the array and by passed the cached drive. Even though the share has cache enabled. Maybe the moving of the drives without a reboot cause the problem.
Before I reboot the server I changed the cache back to the 120GB Sata 1 drive and did a speed test copying files directly to the cache share.
Copied files directly to cache share and received transfer rates between 38Mbs and 76Mbs on the Writes
Rebooted server
With 120GB SATA 1 drive still installed as the cache drive I copied files into the array and received transfer rates between 19Mbs and 22Mbs.
I did verify the that files are to the cache drive and not directly into the array.
I believe anytime you are the array offline and moving drives around you should reboot immediately afterwards.
Changed cache drive from 120GB Sata drive to 1.5TB and rebooted server and received transfer rates of 20Mbs to 24Mbs
So I came to the conclusion that the speed are faster when copying files directly to the disk than they are when copying files to the array shares.
So my question is do I only have to copy files into the user shares (slower copy) or can I copy files directly to the disk shares (faster copy)? Will I have a problem with Split Levels by doing that? If thought I do not think that is a problem giving that I am copying the directly to the disk so I am creating my own Split Level? Finally, if it is okay to copy files directly to the disk will that create a problem with the parity sync? I am thinking not because the parity sync is happening at block level and not file, folder, or share level but I am just making sure.