Nvme cache drive read speed dropped to 50mb/s...

[Rbby258]

I noticed when accessing my nvme cache drive from a windows vm it was feeling sluggish. A while back I remember switching my vm network model to Virtio and running crystal disk mark and achieving multiple gig. Disk shares is enabled and I'm accessing the drive in windows via \\192.168.0.48\nvme

 

This is what it is now. 

 

Nvme drive is a sn770 2tb

 

Thanks in advanced for any help.

tower-diagnostics-20230613-1940.zip

Edited June 13, 2023 by Rbby258

[Rbby258]

Bump

 

Just tried manually trimming the drive, still the same

Edited June 14, 2023 by Rbby258

[JorgeB]

If you copy a large file from that drive over SMB do you see the same speed?

[Rbby258]

11 hours ago, JorgeB said:

If you copy a large file from that drive over SMB do you see the same speed?

Copied a 2.2gb rar file from vm desktop to the root of the nvme. Peaked to around 70mb and low of around 20mb

 

 

Edited June 15, 2023 by Rbby258

[JorgeB]

To me that looks more like a device problem, do you have a different one you could test with? Even a regular SATA SSSD would do.

[Rbby258]

7 minutes ago, JorgeB said:

To me that looks more like a device problem, do you have a different one you could test with? Even a regular SATA SSSD would do.

I do but no sata ports available, anything else can try? Appreciate the help thank you.

 

Edit: How do i go about removing the cache drive from the array? Could try re-adding it perhaps and/or test the nvme drive in another device?

Edited June 15, 2023 by Rbby258

[JorgeB]

Try just reading form an array disk, it should still be faster than that, as long as it's a fairly recent model.

[Rbby258]

6 hours ago, JorgeB said:

Try just reading form an array disk, it should still be faster than that, as long as it's a fairly recent model.

Yeah they're recent drives wd golds 6tb. I created a new share only on the array. Its pretty much the same with reads being slow and writes being what they should be, odd.

 

 

Edited June 16, 2023 by Rbby258

[JorgeB]

Run a single stream iperf test in both directions.

[Rbby258]

4 hours ago, JorgeB said:

Run a single stream iperf test in both directions.

Here's unraid client and vm server.

 

And the other way round.

[JorgeB]

That suggests the network is the problem, I assume you are using gigabit?

[Rbby258]

20 minutes ago, JorgeB said:

That suggests the network is the problem, I assume you are using gigabit?

I am, this is what the settings are

 

[Rbby258]

Diskspeed preforming normally 

 

 

[JorgeB]

You are getting under 200Mbits, this is not Unraid settings related, could be NIC (or NIC driver/settings), cables, switch, client PC, etc

[Rbby258]

4 hours ago, JorgeB said:

You are getting under 200Mbits, this is not Unraid settings related, could be NIC (or NIC driver/settings), cables, switch, client PC, etc

I thought as a vm it would be directly connected? I've seen multi gig before and my switch / lan has only even been 1000mbps? Also internet speed on the vm is get full 1 gig speeds on speedtest. Not really sure what to do. 

Edited June 17, 2023 by Rbby258

[JorgeB]

19 minutes ago, Rbby258 said:

I thought as a vm it would be directly connected?

I missed it was a VM, can you test with an actual PC?

[Rbby258]

1 hour ago, JorgeB said:

I missed it was a VM, can you test with an actual PC?

Yeah vm with a passed through nvme for boot, drive in question is a single drive nvme cache. I'll see what I can do. Its almost unusable in this state, playing .mp4s from it in vlc struggles

 

It says it has the 10gbps link 

Edited June 17, 2023 by Rbby258

[JorgeB]

Yeah but that's a virtual link, a real bare-metal PC would be better for testing.

[Rbby258]

10 hours ago, JorgeB said:

Yeah but that's a virtual link, a real bare-metal PC would be better for testing.

My MacBook on wireless, seems normal.

[JorgeB]

WI-Fi is not ideal but are the read speeds from the NVMe device or array are better/normal?

[Rbby258]

2 hours ago, JorgeB said:

WI-Fi is not ideal but are the read speeds from the NVMe device or array are better/normal?

Here's a windows 11 machine connected to the network testing speed to the root of the nvme, hitting the 1 GbE limit.

 

 

Edited June 18, 2023 by Rbby258

[JorgeB]

OK, so the issue appears to be the virtual LAN, you can try a different NIC driver, e.g., if you are using vitio-net try virtio.

[Rbby258]

27 minutes ago, JorgeB said:

OK, so the issue appears to be the virtual LAN, you can try a different NIC driver, e.g., if you are using vitio-net try virtio.

I did try that before reaching out and also e1000 and at the time didn't make much difference. 

[Rbby258]

I've created a new vm on the array and installed windows for testing. But I cant find the server from within that vm?

[Rbby258]

I've not made any real progress. Since moving everything from the cache drive and basically not using it, everything has been performing better despite running from the mechanical drives. Been slowly fixing dockers with corrupt databases but think now everything it back up and running.

 

Noticed now that my sadnzbd download speed is also much lower than it used to be? Before would sit steady at 110mbps download and now seems to peak around 50-55mbps... I know it was my read speed that was that same speed and not write, could this be the same issue? Either way its not working right still.......