TOoSmOotH

Debates over drive speeds are irrelevant to the topic here. Just looking for multiple cache pools.

Are you transcoding on the cache drive?

ok great.. Did not want to drop big money on another 10TB drive.

Do my drive sizes for my dual parity need to match? I have a 10TB drive right now as my main parity and then all of my other drives are 3tb. I would like to go dual parity so does that mean I need to buy another 10TB for that or can I use another disk as long as it is larger than the largest drive? So say like a 6TB parity drive?

+1 to this. Multiple cache pools is something that would be really useful. My use case is I want to have separate SSD based cache for VMs/Dockers vs a cache pool for front ending network shares which would be based on spinning disk with more capacity. Even better would be able to choose which cache pool for certain mounts in a docker. Example: the Plex docker image resides on the spinning disk cache which is mirrored and /transcode filesystem being located on a SSD based pool that is set to raid 0.

I upgraded to 6.3.0-rc9 will see how it does.

So after my gaming session last night my Windows 10 VM was using 12GB of ram even though it is set to 8. It only seem to be happening on my Windows 10 and not my ubuntu vm which has a video card passed to it as well.

Ok My windows 10 VM has been up and idling for an hour. its now using 10.1G of ram from its original 8G of ram. <domain type='kvm' id='5'> <name>Windows 10</name> <uuid>c8104a5f-aa6e-faf6-3171-dbf67ec9f104</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/> </metadata> <memory unit='KiB'>8388608</memory> <currentMemory unit='KiB'>8388608</currentMemory> <memoryBacking> <nosharepages/> <locked/> </memoryBacking> <vcpu placement='static'>8</vcpu> <cputune> <vcpupin vcpu='0' cpuset='0'/> <vcpupin vcpu='1' cpuset='1'/> <vcpupin vcpu='2' cpuset='2'/> <vcpupin vcpu='3' cpuset='3'/> <vcpupin vcpu='4' cpuset='4'/> <vcpupin vcpu='5' cpuset='5'/> <vcpupin vcpu='6' cpuset='6'/> <vcpupin vcpu='7' cpuset='7'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader> <nvram>/etc/libvirt/qemu/nvram/c8104a5f-aa6e-faf6-3171-dbf67ec9f104_VARS-pure-efi.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor id='none'/> </hyperv> </features> <cpu mode='host-passthrough'> <topology sockets='1' cores='4' threads='2'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='block' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source dev='/dev/disk/by-id/ata-KINGSTON_SKC400S371T_50026B72680467AD'/> <backingStore/> <target dev='hdc' bus='sata'/> <boot order='1'/> <alias name='sata0-0-2'/> <address type='drive' controller='0' bus='0' target='0' unit='2'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/virtio-win-0.1.118-2.iso'/> <backingStore/> <target dev='hdb' bus='ide'/> <readonly/> <alias name='ide0-0-1'/> <address type='drive' controller='0' bus='0' target='0' unit='1'/> </disk> <controller type='usb' index='0' model='nec-xhci'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/> </controller> <controller type='pci' index='0' model='pci-root'> <alias name='pci.0'/> </controller> <controller type='ide' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='sata' index='0'> <alias name='sata0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </controller> <controller type='virtio-serial' index='0'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:39:94:78'/> <source bridge='br0'/> <target dev='vnet1'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </interface> <serial type='pty'> <source path='/dev/pts/1'/> <target port='0'/> <alias name='serial0'/> </serial> <console type='pty' tty='/dev/pts/1'> <source path='/dev/pts/1'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-Windows 10/org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x04' slot='0x00' function='0x0'/> </source> <alias name='hostdev0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x04' slot='0x00' function='0x1'/> </source> <alias name='hostdev1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x046d'/> <product id='0xc52b'/> <address bus='3' device='3'/> </source> <alias name='hostdev2'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x1532'/> <product id='0x011a'/> <address bus='3' device='2'/> </source> <alias name='hostdev3'/> </hostdev> <memballoon model='virtio'> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </memballoon> </devices> </domain>

I am actually passing an entire SSD to my gaming VM. I am having good results so far: <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='block' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source dev='/dev/disk/by-id/ata-KINGSTON_SKC400S371T_50026B72680467AD'/> <target dev='hdc' bus='sata'/> <boot order='1'/> <address type='drive' controller='0' bus='0' target='0' unit='2'/> </disk>

Well I added more RAM to both boxes. The frustrating thing is on kids computer ran fine for almost a year with 6 gigs each until I upgraded to 6.2.4. That is when I started seeing the issues with it killing the VM process. I have since upgraded the box to 32 gigs of ram and given each VM 8G. They have eaten up an additional 500M+ each in the 30 hours they have been running. On the new box the VM has been up for 14 hours and is using over 20 gigs of ram now. The first hour it only uses 16GB when I stop it and restart it. Over time it creeps up forcing me to shut it down and start it over every day. I'll back it down to 8 and see what happens.

So I installed Unraid on another bot and am seeing similar behavior. I am running 2 VMs on it as well. A Ubuntu 16.04 that I told it to take 8G of ram and a windows 10 that I allotted 16GB of ram. As you can see in the attached screenshot of htop both are using more than they are supposed to. The windows 10 consistently keeps ticking up memory usage. Anyone else seeing this type of activity?

I upgraded to 6.2.4 yesterday and now am having issues with one of my VMs getting killed off due to out of memory messages. The previous version I was running ran in this configuration since last March with no issues. Thoughts? System Specs: i7 6 core HT on x99 chipset 16 gigs of ram I am running 2 Windows 10 VMs that my kids game off the same computer. I am passing through a GTX 970 and a 2 port USB pci card to each system. Each box has 6 gigs of ram dedicated to it. System Log: Jan 6 07:56:51 KidsServ kernel: kvm [19862]: vcpu2 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop Jan 6 10:03:36 KidsServ kernel: DMAR: DRHD: handling fault status reg 602 Jan 6 10:03:36 KidsServ kernel: DMAR: DMAR:[DMA Read] Request device [0a:00.0] fault addr ef000 Jan 6 10:03:36 KidsServ kernel: DMAR:[fault reason 06] PTE Read access is not set Jan 6 10:04:50 KidsServ kernel: DMAR: DRHD: handling fault status reg 702 Jan 6 10:04:50 KidsServ kernel: DMAR: DMAR:[DMA Read] Request device [0a:00.0] fault addr ef000 Jan 6 10:04:50 KidsServ kernel: DMAR:[fault reason 06] PTE Read access is not set Jan 6 10:08:03 KidsServ kernel: DMAR: DRHD: handling fault status reg 2 Jan 6 10:08:03 KidsServ kernel: DMAR: DMAR:[DMA Read] Request device [0a:00.0] fault addr ef000 Jan 6 10:08:03 KidsServ kernel: DMAR:[fault reason 06] PTE Read access is not set Jan 6 10:09:18 KidsServ kernel: DMAR: DRHD: handling fault status reg 102 Jan 6 10:09:18 KidsServ kernel: DMAR: DMAR:[DMA Read] Request device [0a:00.0] fault addr ef000 Jan 6 10:09:18 KidsServ kernel: DMAR:[fault reason 06] PTE Read access is not set Jan 6 10:09:30 KidsServ kernel: emhttp invoked oom-killer: gfp_mask=0x24080c0, order=0, oom_score_adj=0 Jan 6 10:09:30 KidsServ kernel: emhttp cpuset=/ mems_allowed=0 Jan 6 10:09:30 KidsServ kernel: CPU: 1 PID: 3376 Comm: emhttp Not tainted 4.4.30-unRAID #2 Jan 6 10:09:30 KidsServ kernel: Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./X99-SLI-CF, BIOS F1 04/15/2015 Jan 6 10:09:30 KidsServ kernel: 0000000000000000 ffff88048d77f9c8 ffffffff8136f79f ffff88048d77fba0 Jan 6 10:09:30 KidsServ kernel: ffffffff8177d510 ffff88048d77fa38 ffffffff8110857d 0000000000000202 Jan 6 10:09:30 KidsServ kernel: 0000000000000202 ffff88048d77fa18 ffffffff810a936b ffff8804bfff8b30 Jan 6 10:09:30 KidsServ kernel: Call Trace: Jan 6 10:09:30 KidsServ kernel: [<ffffffff8136f79f>] dump_stack+0x61/0x7e Jan 6 10:09:30 KidsServ kernel: [<ffffffff8110857d>] dump_header+0x55/0x1d2 Jan 6 10:09:30 KidsServ kernel: [<ffffffff810a936b>] ? delayacct_end+0x51/0x5a Jan 6 10:09:30 KidsServ kernel: [<ffffffff810bbaab>] oom_kill_process+0x84/0x3a9 Jan 6 10:09:30 KidsServ kernel: [<ffffffff810bc1f7>] out_of_memory+0x3dd/0x3f8 Jan 6 10:09:30 KidsServ kernel: [<ffffffff810c0502>] __alloc_pages_nodemask+0x82a/0x8ca Jan 6 10:09:30 KidsServ kernel: [<ffffffff8111e179>] ? alloc_inode+0x2b/0x75 Jan 6 10:09:30 KidsServ kernel: [<ffffffff810ef648>] alloc_pages_current+0xbe/0xe8 Jan 6 10:09:30 KidsServ kernel: [<ffffffff810bca87>] __get_free_pages+0x9/0x37 Jan 6 10:09:30 KidsServ kernel: [<ffffffff810bcac6>] get_zeroed_page+0x11/0x13 Jan 6 10:09:30 KidsServ kernel: [<ffffffff8115a5e5>] kernfs_iop_follow_link+0x22/0x16c Jan 6 10:09:30 KidsServ kernel: [<ffffffff8111456b>] link_path_walk+0x1fe/0x44b Jan 6 10:09:30 KidsServ kernel: [<ffffffff81112b57>] ? path_init+0x109/0x2d0 Jan 6 10:09:30 KidsServ kernel: [<ffffffff81114e2c>] path_openat+0x1e9/0xc45 Jan 6 10:09:30 KidsServ kernel: [<ffffffff810872c5>] ? rcu_is_watching+0x10/0x22 Jan 6 10:09:30 KidsServ kernel: [<ffffffff811167ba>] do_filp_open+0x48/0x9e Jan 6 10:09:30 KidsServ kernel: [<ffffffff81122a43>] ? mntput_no_expire+0x27/0x176 Jan 6 10:09:30 KidsServ kernel: [<ffffffff81120c3a>] ? __alloc_fd+0x150/0x160 Jan 6 10:09:30 KidsServ kernel: [<ffffffff8110a029>] do_sys_open+0x148/0x1d8 Jan 6 10:09:30 KidsServ kernel: [<ffffffff8110a029>] ? do_sys_open+0x148/0x1d8 Jan 6 10:09:30 KidsServ kernel: [<ffffffff8110a0d2>] SyS_open+0x19/0x1b Jan 6 10:09:30 KidsServ kernel: [<ffffffff81629c2e>] entry_SYSCALL_64_fastpath+0x12/0x6d Jan 6 10:09:30 KidsServ kernel: Mem-Info: Jan 6 10:09:30 KidsServ kernel: active_anon:83374 inactive_anon:3203 isolated_anon:0 Jan 6 10:09:30 KidsServ kernel: active_file:174 inactive_file:0 isolated_file:32 Jan 6 10:09:30 KidsServ kernel: unevictable:3866876 dirty:0 writeback:0 unstable:0 Jan 6 10:09:30 KidsServ kernel: slab_reclaimable:19136 slab_unreclaimable:11105 Jan 6 10:09:30 KidsServ kernel: mapped:11784 shmem:85836 pagetables:9496 bounce:0 Jan 6 10:09:30 KidsServ kernel: free:53813 free_pcp:129 free_cma:0 Jan 6 10:09:30 KidsServ kernel: Node 0 DMA free:15904kB min:132kB low:164kB high:196kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15988kB managed:15904kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Jan 6 10:09:30 KidsServ kernel: lowmem_reserve[]: 0 687 15791 15791 Jan 6 10:09:30 KidsServ kernel: Node 0 DMA32 free:66184kB min:5880kB low:7348kB high:8820kB active_anon:17312kB inactive_anon:392kB active_file:8kB inactive_file:8kB unevictable:747440kB isolated(anon):0kB isolated(file):0kB present:851460kB managed:841704kB mlocked:747436kB dirty:0kB writeback:0kB mapped:1368kB shmem:17240kB slab_reclaimable:2884kB slab_unreclaimable:1780kB kernel_stack:496kB pagetables:2140kB unstable:0kB bounce:0kB free_pcp:240kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:504 all_unreclaimable? yes Jan 6 10:09:30 KidsServ kernel: lowmem_reserve[]: 0 0 15103 15103 Jan 6 10:09:30 KidsServ kernel: Node 0 Normal free:133164kB min:129152kB low:161440kB high:193728kB active_anon:316184kB inactive_anon:12420kB active_file:688kB inactive_file:0kB unevictable:14720064kB isolated(anon):0kB isolated(file):128kB present:15728640kB managed:15466628kB mlocked:14720048kB dirty:0kB writeback:0kB mapped:45768kB shmem:326104kB slab_reclaimable:73660kB slab_unreclaimable:42640kB kernel_stack:4608kB pagetables:35844kB unstable:0kB bounce:0kB free_pcp:276kB local_pcp:8kB free_cma:0kB writeback_tmp:0kB pages_scanned:4328 all_unreclaimable? yes Jan 6 10:09:30 KidsServ kernel: lowmem_reserve[]: 0 0 0 0 Jan 6 10:09:30 KidsServ kernel: Node 0 DMA: 0*4kB 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (U) 3*4096kB (M) = 15904kB Jan 6 10:09:30 KidsServ kernel: Node 0 DMA32: 96*4kB (UM) 91*8kB (UME) 146*16kB (UME) 184*32kB (UME) 118*64kB (UME) 67*128kB (UME) 42*256kB (UM) 27*512kB (UME) 16*1024kB (UM) 0*2048kB 0*4096kB = 66424kB Jan 6 10:09:30 KidsServ kernel: Node 0 Normal: 202*4kB (UMEH) 243*8kB (UMEH) 1050*16kB (UMEH) 647*32kB (UMEH) 340*64kB (UMEH) 341*128kB (UMH) 76*256kB (UMH) 17*512kB (UMH) 0*1024kB 0*2048kB 0*4096kB = 133824kB Jan 6 10:09:30 KidsServ kernel: 85876 total pagecache pages Jan 6 10:09:30 KidsServ kernel: 0 pages in swap cache Jan 6 10:09:30 KidsServ kernel: Swap cache stats: add 0, delete 0, find 0/0 Jan 6 10:09:30 KidsServ kernel: Free swap = 0kB Jan 6 10:09:30 KidsServ kernel: Total swap = 0kB Jan 6 10:09:30 KidsServ kernel: 4149022 pages RAM Jan 6 10:09:30 KidsServ kernel: 0 pages HighMem/MovableOnly Jan 6 10:09:30 KidsServ kernel: 67963 pages reserved Jan 6 10:09:30 KidsServ kernel: [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name Jan 6 10:09:30 KidsServ kernel: [ 2054] 0 2054 6707 730 14 3 0 -1000 udevd Jan 6 10:09:30 KidsServ kernel: [ 2237] 0 2237 58409 641 25 3 0 0 rsyslogd Jan 6 10:09:30 KidsServ kernel: [ 2365] 81 2365 4903 60 14 3 0 0 dbus-daemon Jan 6 10:09:30 KidsServ kernel: [ 2373] 1 2373 3345 520 11 3 0 0 rpcbind Jan 6 10:09:30 KidsServ kernel: [ 2378] 32 2378 5354 1451 13 3 0 0 rpc.statd Jan 6 10:09:30 KidsServ kernel: [ 2388] 0 2388 1621 385 8 3 0 0 inetd Jan 6 10:09:30 KidsServ kernel: [ 2397] 0 2397 6126 672 16 3 0 -1000 sshd Jan 6 10:09:30 KidsServ kernel: [ 2411] 0 2411 24545 1194 20 3 0 0 ntpd Jan 6 10:09:30 KidsServ kernel: [ 2418] 0 2418 1097 28 6 3 0 0 acpid Jan 6 10:09:30 KidsServ kernel: [ 2427] 0 2427 1623 420 7 3 0 0 crond Jan 6 10:09:30 KidsServ kernel: [ 2429] 0 2429 1620 25 8 3 0 0 atd Jan 6 10:09:30 KidsServ kernel: [ 2435] 0 2435 55044 1466 106 3 0 0 nmbd Jan 6 10:09:30 KidsServ kernel: [ 2437] 0 2437 74301 3748 143 3 0 0 smbd Jan 6 10:09:30 KidsServ kernel: [ 2439] 0 2439 72723 1148 136 3 0 0 smbd-notifyd Jan 6 10:09:30 KidsServ kernel: [ 2440] 0 2440 72723 1043 135 3 0 0 cleanupd Jan 6 10:09:30 KidsServ kernel: [ 2444] 0 2444 67917 1724 127 3 0 0 winbindd Jan 6 10:09:30 KidsServ kernel: [ 2446] 0 2446 67809 1653 129 3 0 0 winbindd Jan 6 10:09:30 KidsServ kernel: [ 2456] 0 2456 2422 647 9 3 0 0 cpuload Jan 6 10:09:30 KidsServ kernel: [ 3094] 0 3094 22464 976 18 3 0 0 emhttp Jan 6 10:09:30 KidsServ kernel: [ 3095] 0 3095 1625 412 8 3 0 0 agetty Jan 6 10:09:30 KidsServ kernel: [ 3096] 0 3096 1625 406 8 3 0 0 agetty Jan 6 10:09:30 KidsServ kernel: [ 3097] 0 3097 1625 416 8 3 0 0 agetty Jan 6 10:09:30 KidsServ kernel: [ 3098] 0 3098 1625 412 8 3 0 0 agetty Jan 6 10:09:30 KidsServ kernel: [ 3099] 0 3099 1625 409 8 3 0 0 agetty Jan 6 10:09:30 KidsServ kernel: [ 3100] 0 3100 1625 428 8 4 0 0 agetty Jan 6 10:09:30 KidsServ kernel: [ 3149] 61 3149 8624 785 22 3 0 0 avahi-daemon Jan 6 10:09:30 KidsServ kernel: [ 3150] 61 3150 8559 63 21 3 0 0 avahi-daemon Jan 6 10:09:30 KidsServ kernel: [ 3158] 0 3158 3187 26 11 3 0 0 avahi-dnsconfd Jan 6 10:09:30 KidsServ kernel: [ 3258] 0 3258 55250 266 19 3 0 0 shfs Jan 6 10:09:30 KidsServ kernel: [ 3353] 0 3353 202112 3611 86 4 0 0 libvirtd Jan 6 10:09:30 KidsServ kernel: [ 3450] 99 3450 4380 522 13 3 0 0 dnsmasq Jan 6 10:09:30 KidsServ kernel: [ 3451] 0 3451 4347 53 12 3 0 0 dnsmasq Jan 6 10:09:30 KidsServ kernel: [ 3476] 0 3476 92068 3612 146 3 0 0 smbd Jan 6 10:09:30 KidsServ kernel: [ 3557] 0 3557 67917 1009 125 3 0 0 winbindd Jan 6 10:09:30 KidsServ kernel: [ 4649] 0 4649 8860 1227 21 3 0 0 sshd Jan 6 10:09:30 KidsServ kernel: [ 4680] 0 4680 3364 858 10 3 0 0 bash Jan 6 10:09:30 KidsServ kernel: [19862] 0 19862 1968508 1868461 3878 10 0 0 qemu-system-x86 Jan 6 10:09:30 KidsServ kernel: [21814] 0 21814 2104186 2003708 4138 11 0 0 qemu-system-x86 Jan 6 10:09:30 KidsServ kernel: [12020] 0 12020 1092 163 7 3 0 0 sleep Jan 6 10:09:30 KidsServ kernel: Out of memory: Kill process 21814 (qemu-system-x86) score 477 or sacrifice child Jan 6 10:09:30 KidsServ kernel: Killed process 21814 (qemu-system-x86) total-vm:8416744kB, anon-rss:7992288kB, file-rss:22544kB Jan 6 10:09:30 KidsServ kernel: br0: port 3(vnet1) entered disabled state