No, that's not it at all.
When a drive can no longer be accessed by unraid for whatever reason, all activity to that drive slot is emulated. Since there are writes to the file system metadata when the drive slot is unmounted, parity is guaranteed to be out of sync with the actual physical drive.
So, to answer the title to the thread, there is no way to add a drive back that has been disabled without rebuilding it, unless you don't care about any writes that happened after the disabling event. You will still need to correct parity for all changed bits, which may be anywhere on the drive, so a full correcting check is needed. That will take roughly the same time as a rebuild anyway.
Parity is calculated across the entire capacity of the drive from start to finish, without regard to content. If there have been NO data writes, then the only changes will be to areas close to the beginning of the drive. If something happened to be written to the portion of the drive after you cancelled the parity correction, then that area of parity would be invalid and would cause corruption if a different drive failed out before you got parity back in sync.
Normally when the array is operating you would not know for a few minutes that the drive has been dropped, and even after it's dropped the array will allow reads and writes to the slot without error, so you would pretty much be guaranteed to lose something if you readded the drive without rebuilding. Unraid doesn't drop a drive unless a write fails, so you are going to lose that specific write, and any subsequent ones as well.