Hi,
I have a growing number of files, around 500.000 , on a single share, spread around 7 disks (XFS).
These files are between 30Mb and 120Mb.
They are in the same directory.
I have severe performance issues.
I would like to discuss a local, specific issue, and the generic/general best practices to improve the situation.
From a local unraid terminal, the same ls command, which returns a small subset of the files, while being instant on any individual drive
ls mnt/disk{disknumber}/Myshare/Thefolder/*AAA*.*
takes forever (almost 1 minute) when I execute on the merged file system
ls mnt/user0/Myshare/Thefolder/*AAA*.*
The issue is the same when it comes to insert new file.
What I want to explore in this thread is
Is this normal/to be expected.
Are there pieces of documentation that cover this topic
Are there figures documented in Unraid that
Does it depend on the number of drives
Does it depend on how files are spread on the disks
if so, how does each share allocation method influence this topic
The file names are random. Would using sub-directories help?
if so, how would directory split level influence this topic
as CPU, RAM, I/O usage don't seem to react, what tools would you use to investigate the bottleneck