Hi,

I have Sabnzbd downloading things from newsgroups, it's installed to my cache drive which is the fastest drive in my rig.

 

when the download is in full flow, I look at the "main" tab and expect to see a load of throughput to the cache drive as that's where I assume it's downloading, but I don't see ANY traffic. Only sporadic writes to the array 

 

Any idea what's happening to the download? Is it going into memory perhaps?

 

Thanks in advance 

10 minutes ago, Turtonater said:

Sabnzbd

Post docker run

 

and Diagnostics 

2 hours ago, trurl said:

Post docker run

 

and Diagnostics 

Docker run output in this way? : 

 

docker run in my post and yours and everywhere it appears in the forum is a link explaining how to get docker run.

 

Similar for Diagnostics.

 

1 hour ago, trurl said:

docker run in my post and yours and everywhere it appears in the forum is a link explaining how to get docker run.

 

Similar for Diagnostics.

 

Thanks. Can't believe i didn't click it !

 

docker run

  -d

  --name='sabnzbd'

  --net='host'

  -e TZ="Europe/London"

  -e HOST_OS="Unraid"

  -e HOST_HOSTNAME="unraid"

  -e HOST_CONTAINERNAME="sabnzbd"

  -e 'TCP_PORT_8080'='8080'

  -e 'PUID'='99'

  -e 'PGID'='100'

  -e 'UMASK'='022'

  -l net.unraid.docker.managed=dockerman

  -l net.unraid.docker.webui='http://[IP]:[PORT:8080]'

  -l net.unraid.docker.icon='https://raw.githubusercontent.com/linuxserver/docker-templates/master/linuxserver.io/img/sabnzbd-logo.png'

  -v '/mnt/user/Downloads/complete/':'/downloads':'rw'

  -v '/mnt/user/Downloads/incomplete/':'/incomplete-downloads':'rw'

  -v '/mnt/user/appdata/sabnzbd':'/config':'rw' 'lscr.io/linuxserver/sabnzbd'

6010c3e80bf3dbf61a67b0ca2e0e00cba60b56c20fd217d86a66a70956d029a8

unraid-diagnostics-20250115-1628.zip

Any ideas anyone please?

On 1/15/2025 at 6:38 AM, Turtonater said:

I look at the "main" tab and expect to see a load of throughput to the cache drive as that's where I assume it's downloading, but I don't see ANY traffic. Only sporadic writes to the array 

There is a "toggle" at upper right above the drives that switches the display between data rate and accumulated read/write. See if that shows it increasing.

11 hours ago, trurl said:

There is a "toggle" at upper right above the drives that switches the display between data rate and accumulated read/write. See if that shows it increasing.

That’s the one I toggled to and didn’t see any usage during a download on the cache drive

The container looks like it should be configured OK, shouldn't be able to download into RAM like that, and nothing else seems to indicate that is happening.

 

If the application were misconfigured somewhere in its settings it would be writing data into docker.img instead of RAM, and that doesn't seem to be happening either.

 

Looks like the Downloads share does have files on cache.

 

Not sure about the display. What browser are you using? Any adblockers or anything that might interfere?

 

Unrelated, your system share has files on the array.

8 hours ago, trurl said:

The container looks like it should be configured OK, shouldn't be able to download into RAM like that, and nothing else seems to indicate that is happening.

 

If the application were misconfigured somewhere in its settings it would be writing data into docker.img instead of RAM, and that doesn't seem to be happening either.

 

Looks like the Downloads share does have files on cache.

 

Not sure about the display. What browser are you using? Any adblockers or anything that might interfere?

 

Unrelated, your system share has files on the array.

Thanks for looking at it 

 

I’ve tested a few more times now and I don’t see any writes to the cache drive during a large download. I just downloaded a huge file so I could look at the figures for a good while and the cache was writing, but at like 1MB/s, whereas the array was writing close to 100MB/s. For reference, the rate I was getting from the internet was 70MB/s.

 

i can’t fathom this

 

Im also curious what you mean about my system share having files on the array, is that a default location for system files? 

1 hour ago, Turtonater said:

cache was writing, but at like 1MB/s, whereas the array was writing close to 100MB/s

It shouldn't be possible to write to the parity array that fast, and you don't even have turbo write turned on.

 

The Downloads share has Minimum Free of 97G, but all disks including cache has that much free space, so it shouldn't be overflowing. And you don't even have Minimum Free set for cache. You should set it to larger than the largest file you expect to write to cache.

 

1 hour ago, Turtonater said:

system share having files on the array

Ideally, these Docker/VM related shares (appdata, domains system) should have all files on cache or other pool with nothing on the array, so Dockers/VMs will perform better, and so array disks can spin down, since these files are always open.

 

system share is where your libvirt.img (VM configurations) and docker.img (container executables) are configured to be stored (this is the default). Perhaps some of this got created on the array when you had Docker/VM enabled without cache.

 

system is configured to be moved from the array to cache, so that's good. But nothing can move open files. You would have to disable Docker and VM Manager in Settings before this could be moved. Also, mover won't overwrite files so if something exists in both places it won't be moved.

 

You can see how much of each disk or pool is used by this share by clicking Compute... for it on the User Shares page.

 

If there are duplicates that can't be moved, you would have to clean that up yourself. Simplest way would be to install Dynamix File Manager plugin (this feature is already built-in to Unraid V7 so plugin not needed for that).

 

15 hours ago, trurl said:

It shouldn't be possible to write to the parity array that fast, and you don't even have turbo write turned on.

 

The Downloads share has Minimum Free of 97G, but all disks including cache has that much free space, so it shouldn't be overflowing. And you don't even have Minimum Free set for cache. You should set it to larger than the largest file you expect to write to cache.

 

Ideally, these Docker/VM related shares (appdata, domains system) should have all files on cache or other pool with nothing on the array, so Dockers/VMs will perform better, and so array disks can spin down, since these files are always open.

 

system share is where your libvirt.img (VM configurations) and docker.img (container executables) are configured to be stored (this is the default). Perhaps some of this got created on the array when you had Docker/VM enabled without cache.

 

system is configured to be moved from the array to cache, so that's good. But nothing can move open files. You would have to disable Docker and VM Manager in Settings before this could be moved. Also, mover won't overwrite files so if something exists in both places it won't be moved.

 

You can see how much of each disk or pool is used by this share by clicking Compute... for it on the User Shares page.

 

If there are duplicates that can't be moved, you would have to clean that up yourself. Simplest way would be to install Dynamix File Manager plugin (this feature is already built-in to Unraid V7 so plugin not needed for that).

 

thank you. Despite not yet being at the point of resolving my initial weirdness, this advice is gold dust

 

Would you mind helping or pointing me to help on the moving of the system config to cache when the vm manager & docker have been stopped ?

i constantly  have a disk in the array awake so I bet the thing you mentioned is the reason 

I don’t know whether this is related but my docker is always warning me that it’s high utilisation. (I’ve never investigated where to increase that)

 

thanks in advance 

 

Edited January 19, 20251 yr by Turtonater
More info

Disable Docker and VM Manager in Settings. Run Mover (Main - Array Operations) and wait for it to complete. Then

 

17 hours ago, trurl said:

You can see how much of each disk or pool is used by this share by clicking Compute... for it on the User Shares page.

 

and

17 hours ago, trurl said:

if there are duplicates that can't be moved, you would have to clean that up yourself. Simplest way would be to install Dynamix File Manager plugin

Dynamix File Manager is explained in pdf in 1st post of its thread.

44 minutes ago, Turtonater said:

Would you mind helping or pointing me to help on the moving of the system config to cache when the vm manager & docker have been stopped ?

i constantly  have a disk in the array awake so I bet the thing you mentioned is the reason

 

From the settings menu, making sure both the docker and vm services are entirely disabled, then set the following settings for each of the shares:

 

Pay extra attention to the mover action field, notice that the Array points to the Cache and not the other way around, this is important as that is how the data is moved when mover runs. If you set it to "Cache -> Array" the data would be moved to the Array disks and not to the cache.

 

Once you've done this for each share you want to have data moved to cache, run mover. Also note that mover will not move files if a duplicate file exists on the destination.  Mover also does not move files in use either.

 

 

 

Edit: Also to kidna answer your question about the writes and reads on the dashboard, the speed. It's normal that the speed fluctuates between 0Mbps and whatever the drive is doing. The only time i've witnessed constant speeds is during a parity sync/check.

Edited January 19, 20251 yr by MowMdown

1 hour ago, trurl said:

Disable Docker in VM Manager in Settings. Run Mover (Main - Array Operations) and wait for it to complete. Then

 

 

and

Dynamix File Manager is explained in pdf in 1st post of its thread.

Thanks and to @MowMdown for the help

 

i managed to move the stuff I was supposed to to the cache with no duplicate files, so I (for the first time) have a sleeping array 😁

 

very very pleased

 

regarding the speed issue (and I have tested again since this afternoons maintenance) I am expecting to see higher writes than a couple of KB/s to the cache drive though, whilst the file is being downloaded. All I see is activity on the array.  It makes me concerned I’m wasting this fast cache disk and it’s not doing much 

12 minutes ago, Turtonater said:

KB/s

I always leave mine on displaying accumulated writes.

 

On 1/17/2025 at 6:56 PM, trurl said:

There is a "toggle" at upper right above the drives that switches the display between data rate and accumulated read/write. See if that shows it increasing.

That should tell you if something is being written. Note that the number of writes does not necessarily correlate to a number of bytes.

8 minutes ago, trurl said:

I always leave mine on displaying accumulated writes.

 

That should tell you if something is being written. Note that the number of writes does not necessarily correlate to a number of bytes.

I’ve tried setting it to that and the array writes are going up in large amounts compared to the cache write figure 

@Turtonater That tells me your "Downloads" share is set to use the array as it's primary storage.

 

Or a minimum free space setting somewhere is too restrictive.

Edited January 19, 20251 yr by MowMdown

Are you perhaps replacing/updating files instead of writing new files? Replacement/updated files will go to the disk that already had the files.