Yes, but before attempting that make sure backups are up to date, same issue that caused the pool to hang after removing a device might do the same when converting the pool, to convert click on cache, then scroll down to "balance status", next to the "balance" button select "convert to raid0" then click "balance".