It mirrors in the sense that the end result will be the same.
This is for v6.9.x, while it should also work with v6.10.x I didn't test it, and don't like to assume.
You need to have both the old and new replacement devices connected at the same time, if you can have all 4 you can do both replacements and then reset cache config, if not do one, reset cache config, do the other reset cache config again.
First you need to partition the new device, to do that format it using the UD plugin, you can use any filesystem, then with the array started and using the console type:
btrfs replace start -f /dev/sdX1 /dev/sdY1 /mnt/cache
Replace X with source, Y with target, note the 1 in the end of both, you can check replacement progress with:
btrfs replace status /mnt/cache
When done and if you have enough SATA ports you can repeat the procedure for the second device, if not do the cache reset below and then start over for the other device.
Pool config reset: stop the array, if Docker/VM services are using the cache pool disable them, unassign all cache devices, start array to make Unraid "forget" old cache config, stop array, reassign the current cache devices (there can't be an "All existing data on this device will be OVERWRITTEN when array is Started" warning for any cache device), re-enable Docker/VMs if needed, start array.