Hello there i'm new but very happy to be here. I'm the first days into Unraid and with a lot of reading and watching tutorial i've managed to build my very first own server without any (major) issues. And so far i need to say that the journey was fun so far. I'm looking forward to upcoming projects and what my server can do for me!

 

But: beside all the positive experiences i have one little problem wich isn't a showstopper but is a bit annoying and makes me feel a little nervous about the safety of my data.

 

So far i've installed a 4TB Parity drive and a 4TB Disk in the Array. The first thing i've done was transferring something around 3TB of data from an old external USB Drive to the Array. After my calculation there should be something around 3TB of used space in my array und around 1TB of free Space in the array. But whan i look at the dashboard it says that there are only 5% of used Space on Disk 1 and when i switch to the Main tab it says that there are only 210GB of my Disk 1 is used (which should be exactly the 5% wich is shown to me on the dashboard) 

When i go to the Drive on my Desktop i can found some Files wich are over 250GB on its own. 

 

Does anyone have an idea what the could cause this issue? 

 

Here i'll give you some Screenshots and my diagnostics.

 

I've done my best to provide every relevant info. I hope this was enough  

 

Thanks in advance, 

Manuel

 

hechtserver-diagnostics-20221207-1501.zip

 

Looks to me like it's a XFS problem with how it's reporting the used space, IIRC there have been a couple of users complaining of something similar recently, if you look at the df output from the diags it agrees with the GUI (note that df uses GiB so you need to convert to GB), on the other hand share usage calculation actuality calculates the used space by all the files in a share, it doesn't look at the free space, and that should be correct, my best guess is that you will need to wait for XFS to fix this in an upcoming kernel, what kind of files are in this share? Any symlinks or hardlinks?

Thanks for the quick reply. To me it looks also like some kind of bug. 

Its mainly every kind of personal data. Photos, Videos University stuff and so on... I didn't heard about symlinks before but i quickly googled it and... i have some old Backups of an iPhoto Library wich maybe can have some symlinks in it?! 

 

But summing up: i don't need to worry about losing any data i think?! Asking because the additional 3TB device listed under unassigneed devices is the disk wich holds the old data wich i copied to the array. Then i will format it and add it to the array. 

3 minutes ago, mHecht said:

i don't need to worry about losing any data i think?!

Don't think so, at least the other users that reported similar issues never had any data problems.

 

4 minutes ago, mHecht said:

i have some old Backups of an iPhoto Library wich maybe can have some symlinks in it?!

Could be.

 

Suggest you run rsync to confirm all data is there, if it is it should be fairly quick:

 

rsync -av /mnt/disks/UD_device_name/ /mnt/user/Share_name/

 

 

16 minutes ago, JorgeB said:

Don't think so, at least the other users that reported similar issues never had any data problems.

 

Could be.

 

Suggest you run rsync to confirm all data is there, if it is it should be fairly quick:

 

rsync -av /mnt/disks/UD_device_name/ /mnt/user/Share_name/

 

 

 

This checks if there are the same files on the unassigned device as in the specified location? Even if these are organised in other directories as on the unassigned device?

 

EDIT: I think this won't work because i can't mount it. To be honest i don't really know why. Originally it was in an external Harddrive enclosure and i plugged it in via USB. After the data transfer i got rid of the enclosure an connected it via SATA. But since then, the only option I see under unassigned devices is to format it.

Edited December 7, 20223 yr by mHecht

Hello there,

 

i want to come back to this topic since there has nothing changed on this issue. Unraid still says that the disk ist only filled about 15%, while there are in fact 2.5tb of data on a 3tb drive.  Is it save that i won't lose any data? I mean, what will happen if the drive is physically full, but Unraid thinks it's just filled about 20%? Isn't it possible that some data will be overwritten?

Edited January 7, 20233 yr by mHecht

18 hours ago, mHecht said:

Isn't it possible that some data will be overwritten?

I don't see how that can happen, you could try btrfs instead to see if it's an xfs issue.

Did you ever find a solution to this?

On 4/1/2023 at 9:50 PM, mattalat said:

Did you ever find a solution to this?

Wondering the same. I think I am seeing this bug on 6.12.3 - I formatted a new disk and converted from zfs to xfs - fresh off restarting the array and formatting this disk - the GUI and "df -h" report the same 118GB used on an empty disk with no files or folders.

 

root@Tower:~/openSeaChest-v23.03.1-linux-x86_64-manylinux# df -h
Filesystem             Size  Used Avail Use% Mounted on
/dev/mapper/md3p1       17T  117G   17T   1% /mnt/disk3

root@Tower:~/openSeaChest-v23.03.1-linux-x86_64-manylinux# cd /mnt/disk3
root@Tower:/mnt/disk3# ncdu
root@Tower:/mnt/disk3# ls -lah
total 0
drwxrwxrwx  2 nobody users   6 Aug  8 23:18 ./
drwxr-xr-x 12 root   root  240 Aug  8 23:08 ../
root@Tower:/mnt/disk3# du -sh
0       .
root@Tower:/mnt/disk3#

 

more details

root@Tower:~# xfs_info /mnt/disk3/
meta-data=/dev/md3p1             isize=512    agcount=17, agsize=268435455 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=1, sparse=1, rmapbt=0
         =                       reflink=1    bigtime=1 inobtcount=1 nrext64=0
data     =                       bsize=4096   blocks=4394582003, imaxpct=5
         =                       sunit=0      swidth=0 blks
naming   =version 2              bsize=4096   ascii-ci=0, ftype=1
log      =internal log           bsize=4096   blocks=521728, version=2
         =                       sectsz=512   sunit=0 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0

root@Tower:~# parted /dev/sdd
GNU Parted 3.6
Using /dev/sdd
Welcome to GNU Parted! Type 'help' to view a list of commands.
(parted) print
Model: ATA WDC WUH721818AL (scsi)
Disk /dev/sdd: 18.0TB
Sector size (logical/physical): 512B/4096B
Partition Table: gpt
Disk Flags:

Number  Start   End     Size    File system  Name  Flags
 1      32.8kB  18.0TB  18.0TB  xfs

(parted) exit

 

Edited August 9, 20232 yr by TheLinuxGuy

That's normal with XFS, it's used for filesystem overhead, the larger the disk the more it will use.

i have a issue with used space that is shown in the overview and the real used space with my zfs pool:

 

 

 

i am wondering why there is a size of 734gb of my 1tb m2 disk (cache) and 382gb of my 512gb ssds (cloud)

The GUI stats for zfs pool should always be correct, and looks like maybe you didn't post the complete df results, in case there are datasets, please post the diagnostics.

I've got a similar problem with the UI reporting a much wider difference than the console on one specific device. I must miss something.

 

The following is the device nvme1 (/dev/nvme0n1p1) mounted to /mnt/disks/nvme1

 

 

 

Those 2 representations are consistent. However when i check what is in /mnt/disks/nvme1 is where I see the much wider difference:

 

There is a delta of over 1.2TB. Any idea what this difference mean? Any additional information you would need to help me figure out what is going on?

 

 

Thanks!

 

Try checking filesystem, if it doesn't resolve, copy everything from that disk elsewhere, reformat and copy back.

On 1/28/2025 at 10:13 AM, JorgeB said:

Try checking filesystem, if it doesn't resolve, copy everything from that disk elsewhere, reformat and copy back.

I restarted the docker service and it sorted the drive itself out. The drive was pretty much only hosting docker containers config