After moving things around to other disks, if you have any user shares that are configured to include or exclude specific disk#s, you may have to change those settings to match where things have been moved.
Alternatively, you could set a New Config and change the drive assignments so that the disk#s match the user share settings.
If you only have single parity, changing the drive assignments will not invalidate parity, so you can check the box to tell it parity is valid.
If you have dual parity, then parity2 will not be valid if you change the drive assignments. I don't know if it will allow you to rebuild only parity2 or if it will do both in that case.