I thought maybe Teracopy on WIndows is causing the issue. It seems my Sandisk 500GB Pro NVME drive causing permission issues. I removed the NVME drives as cache for my Unraid, and now it doesn't have those issues anymore.
What could cause the NVME drives to act this strange? It are 2 drives, BTRFS filesystem.