I've got the cache pool going again. Steps I took for anyone running into this in the future:
Step 1: Back up everything off the cache pool:
SSH into unraid server, mount one of your cache drives, back everything up.
cd /mnt
mkdir tempmount
#Find out what your cache drives device is using lsblk and then mount it read only.
mount -o ro /dev/nvme0n1p1 /mnt/tempmount
#I backed up the cache to my local machine
#Open local terminal and execute rsync
rsync -avh --progress "
[email protected]:/mnt/tempmount/" ~/Desktop/cache_backup
Go into unraid > Tools > New Config > Preserver Current Assignments > Array > Apply
Go to Main > Add Cache Pool > Assign cache drives like they were before reboot > Check the Parity Valid box > Start array
All of my data seems to be intact on the cache pool, so no need to the backups we made!