The rebuild process has to rewrite every sector on the target disk, so you should expect it to take a similar amount of time to a parity check. In addition, any other activity on the array will slow the process down just as it would slow a parity check.