September 15, 201411 yr I have installed Airvideo, MariaDB and Owncloud as Docker containers plus two KVM VM's which I haven't started (archVM & win7 VM). Until yesterday all was all running fine but since today in the morning I have continuos crashes. Unfortunately the only thing I can provide are the iKVM screenshots as there is no syslog generated. The last syslog is from yesterday, so will not help but I have attached it. Any ideas?
September 15, 201411 yr Author ...and the next crash with some more information: /usr/bin/tail -f /var/log/syslog 2>&1 Sep 15 14:42:20 Tower ntpd[9358]: Listen normally on 3 docker0 172.17.42.1 UDP 123 Sep 15 14:42:20 Tower ntpd[9358]: peers refreshed Sep 15 14:42:20 Tower ntpd[9358]: Listening on routing socket on fd #20 for interface updates Sep 15 14:42:20 Tower dhcpcd[1462]: br0: sending ARP announce (1 of 2), next in 2.00 seconds Sep 15 14:42:22 Tower dhcpcd[1462]: br0: sending ARP announce (2 of 2) Sep 15 14:42:37 Tower kernel: mdcmd (46): nocheck Sep 15 14:42:37 Tower kernel: md: md_do_sync: got signal, exit... Sep 15 14:42:37 Tower kernel: md: recovery thread sync completion status: -4 Sep 15 14:42:40 Tower ntpd_intres[1531]: parent died before we finished, exiting Sep 15 14:43:24 Tower sshd[9938]: Accepted password for root from 192.168.178.30 port 52658 ssh2 Sep 15 14:47:44 Tower emhttp: shcmd (72): /usr/local/sbin/mover |& logger & Sep 15 14:47:44 Tower logger: mover started Sep 15 14:47:44 Tower logger: moving Datenaustausch/ Sep 15 14:47:44 Tower logger: ./Datenaustausch/ Sep 15 14:47:44 Tower logger: .d..t...... ./ Sep 15 14:47:44 Tower logger: .d..t...... Datenaustausch/ Sep 15 14:47:44 Tower logger: moving Oliver/ Sep 15 14:47:44 Tower logger: ./Oliver/Archiv/IT/unRaid/unRAIDServer-6.0-beta9-x86_64.zip Sep 15 14:47:44 Tower logger: .d..t...... ./ Sep 15 14:47:45 Tower logger: rsync: get_xattr_names: llistxattr(""/mnt/user0/Oliver"",1024) failed: Software caused connection abort (103) Sep 15 14:47:45 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 15 14:47:45 Tower logger: rsync: failed to set times on "/mnt/user0/Oliver": Transport endpoint is not connected (107) Sep 15 14:47:45 Tower logger: rsync: recv_generator: mkdir "/mnt/user0/Oliver/Archiv" failed: Transport endpoint is not connected (107) Sep 15 14:47:45 Tower logger: *** Skipping any contents from this failed directory *** Sep 15 14:47:45 Tower logger: .d..t.....x Oliver/ Sep 15 14:47:45 Tower logger: cd+++++++++ Oliver/Archiv/ Sep 15 14:47:45 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 15 14:47:45 Tower logger: rsync: get_xattr_names: llistxattr(""/mnt/user0/Oliver"",1024) failed: Transport endpoint is not connected (107) Sep 15 14:47:45 Tower logger: rsync: failed to set times on "/mnt/user0/Oliver": Transport endpoint is not connected (107) Sep 15 14:47:45 Tower kernel: traps: shfs[6201] general protection ip:2b62bdf3b7b7 sp:2b62be688b20 error:0 in libc-2.17.so[2b62bdebc000+1bf000] Sep 15 14:47:45 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.0] Sep 15 14:47:45 Tower logger: skipping appdata/ Sep 15 14:47:45 Tower logger: skipping webvirtmgr/ Sep 15 14:47:45 Tower logger: mover finished Sep 15 14:47:58 Tower emhttp: shcmd (73): crontab -c /etc/cron.d -d &> /dev/null Sep 15 14:49:03 Tower kernel: general protection fault: 0000 [#1] SMP Sep 15 14:49:03 Tower kernel: Modules linked in: kvm_intel kvm vhost_net vhost tun veth xt_nat ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_nat_ipv4 nf_nat iptable_filter ip_tables md_mod ahci e1000e sata_sil24 libahci i2c_i801 ptp mvsas libsas scsi_transport_sas pps_core ipmi_si Sep 15 14:49:03 Tower kernel: CPU: 1 PID: 6213 Comm: shfs Not tainted 3.16.2-unRAID #10 Sep 15 14:49:03 Tower kernel: Hardware name: Supermicro X9SCL/X9SCM/X9SCL/X9SCM, BIOS 2.10 01/09/2014 Sep 15 14:49:03 Tower kernel: task: ffff880221078fc0 ti: ffff88007e39c000 task.ti: ffff88007e39c000 Sep 15 14:49:03 Tower kernel: RIP: 0010:[] [] kmem_cache_alloc+0x78/0x105 Sep 15 14:49:03 Tower kernel: RSP: 0018:ffff88007e39fa08 EFLAGS: 00010286 Sep 15 14:49:03 Tower kernel: RAX: 0000000000000000 RBX: ffff88007e39fa70 RCX: 00000000000018f8 Sep 15 14:49:03 Tower kernel: RDX: 00000000000018f7 RSI: 0000000000011280 RDI: ffff880227003500 Sep 15 14:49:03 Tower kernel: RBP: ffff88007e39fa28 R08: 0000000000015a60 R09: 726f2e7265737500 Sep 15 14:49:03 Tower kernel: R10: ffff880221708740 R11: ffff8800c9e63e18 R12: 0000000000011280 Sep 15 14:49:03 Tower kernel: R13: ffffffff813363bb R14: ffff880227003500 R15: 00000000000000d0 Sep 15 14:49:03 Tower kernel: FS: 00002ac59dfdb700(0000) GS:ffff88022fc40000(0000) knlGS:0000000000000000 Sep 15 14:49:03 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Sep 15 14:49:03 Tower kernel: CR2: 00002b4c208435e0 CR3: 00000000c22d2000 CR4: 00000000001407e0 Sep 15 14:49:03 Tower kernel: Stack: Sep 15 14:49:03 Tower kernel: ffff88007e39fa70 00000000000000d0 ffff880223dbdd80 0000000000000021 Sep 15 14:49:03 Tower kernel: ffff88007e39fa50 ffffffff813363bb ffff880223dbb300 00000000000000d0 Sep 15 14:49:03 Tower kernel: ffff8801f411f500 ffff88007e39faa0 ffffffff813364d0 000000048133aa86 Sep 15 14:49:03 Tower kernel: Call Trace: Sep 15 14:49:03 Tower kernel: [] bvec_alloc+0xa4/0xc4 Sep 15 14:49:03 Tower kernel: [] bio_alloc_bioset+0xf5/0x185 Sep 15 14:49:03 Tower kernel: [] mpage_alloc+0x28/0x80 Sep 15 14:49:03 Tower kernel: [] do_mpage_readpage+0x400/0x506 Sep 15 14:49:03 Tower kernel: [] ? lru_cache_add+0x9/0xb Sep 15 14:49:03 Tower kernel: [] ? reiserfs_commit_write+0x169/0x169 Sep 15 14:49:03 Tower kernel: [] mpage_readpages+0xcf/0x114 Sep 15 14:49:03 Tower kernel: [] ? reiserfs_commit_write+0x169/0x169 Sep 15 14:49:03 Tower kernel: [] ? alloc_pages_current+0xc1/0xde Sep 15 14:49:03 Tower kernel: [] reiserfs_readpages+0x18/0x1a Sep 15 14:49:03 Tower kernel: [] __do_page_cache_readahead+0x12b/0x1c5 Sep 15 14:49:03 Tower kernel: [] ondemand_readahead+0x20a/0x21b Sep 15 14:49:03 Tower kernel: [] page_cache_async_readahead+0x74/0x7d Sep 15 14:49:03 Tower kernel: [] generic_file_read_iter+0x1ea/0x538 Sep 15 14:49:03 Tower kernel: [] ? fuse_dev_read+0x61/0x68 Sep 15 14:49:03 Tower kernel: [] new_sync_read+0x78/0x9c Sep 15 14:49:03 Tower kernel: [] vfs_read+0x89/0x124 Sep 15 14:49:03 Tower kernel: [] SyS_pread64+0x50/0x81 Sep 15 14:49:03 Tower kernel: [] system_call_fastpath+0x16/0x1b Sep 15 14:49:03 Tower kernel: Code: 4d 85 c9 75 16 4c 89 e9 83 ca ff 44 89 e6 4c 89 f7 e8 47 7e 4f 00 49 89 c1 eb 2b 48 85 c0 74 e5 49 63 46 20 48 8d 4a 01 4d 8b 06 <49> 8b 1c 01 4c 89 c8 65 49 0f c7 08 0f 94 c0 84 c0 74 ab 49 63 Sep 15 14:49:03 Tower kernel: RIP [] kmem_cache_alloc+0x78/0x105 Sep 15 14:49:03 Tower kernel: RSP Sep 15 14:49:03 Tower kernel: ---[ end trace f40ee4fffec613b3 ]--- Sep 15 14:49:03 Tower kernel: ------------[ cut here ]------------ Sep 15 14:49:03 Tower kernel: WARNING: CPU: 1 PID: 6213 at kernel/exit.c:669 do_exit+0x60/0x8c0() Sep 15 14:49:03 Tower kernel: Modules linked in: kvm_intel kvm vhost_net vhost tun veth xt_nat ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_nat_ipv4 nf_nat iptable_filter ip_tables md_mod ahci e1000e sata_sil24 libahci i2c_i801 ptp mvsas libsas scsi_transport_sas pps_core ipmi_si Sep 15 14:49:03 Tower kernel: CPU: 1 PID: 6213 Comm: shfs Tainted: G D 3.16.2-unRAID #10 Sep 15 14:49:03 Tower kernel: Hardware name: Supermicro X9SCL/X9SCM/X9SCL/X9SCM, BIOS 2.10 01/09/2014 Sep 15 14:49:03 Tower kernel: 0000000000000000 ffff88007e39f808 ffffffff815d8ee8 0000000000000000 Sep 15 14:49:03 Tower kernel: ffff88007e39f840 ffffffff81040687 ffffffff810421aa ffff880221078fc0 Sep 15 14:49:03 Tower kernel: 000000000000000b ffffffff8170b96d 0000000000000000 ffff88007e39f850 Sep 15 14:49:03 Tower kernel: Call Trace: Sep 15 14:49:03 Tower kernel: [] dump_stack+0x45/0x56 Sep 15 14:49:03 Tower kernel: [] warn_slowpath_common+0x75/0x8e Sep 15 14:49:03 Tower kernel: [] ? do_exit+0x60/0x8c0 Sep 15 14:49:03 Tower kernel: [] warn_slowpath_null+0x15/0x17 Sep 15 14:49:03 Tower kernel: [] do_exit+0x60/0x8c0 Sep 15 14:49:03 Tower kernel: [] ? printk+0x4f/0x51 Sep 15 14:49:03 Tower kernel: [] oops_end+0xcc/0xe1 Sep 15 14:49:03 Tower kernel: [] die+0x55/0x60 Sep 15 14:49:03 Tower kernel: [] do_general_protection+0x95/0x141 Sep 15 14:49:03 Tower kernel: [] ? bvec_alloc+0xa4/0xc4 Sep 15 14:49:03 Tower kernel: [] general_protection+0x28/0x30 Sep 15 14:49:03 Tower kernel: [] ? bvec_alloc+0xa4/0xc4 Sep 15 14:49:03 Tower kernel: [] ? kmem_cache_alloc+0x78/0x105 Sep 15 14:49:03 Tower kernel: [] bvec_alloc+0xa4/0xc4 Sep 15 14:49:03 Tower kernel: [] bio_alloc_bioset+0xf5/0x185 Sep 15 14:49:03 Tower kernel: [] mpage_alloc+0x28/0x80 Sep 15 14:49:03 Tower kernel: [] do_mpage_readpage+0x400/0x506 Sep 15 14:49:03 Tower kernel: [] ? lru_cache_add+0x9/0xb Sep 15 14:49:03 Tower kernel: [] ? reiserfs_commit_write+0x169/0x169 Sep 15 14:49:03 Tower kernel: [] mpage_readpages+0xcf/0x114 Sep 15 14:49:03 Tower kernel: [] ? reiserfs_commit_write+0x169/0x169 Sep 15 14:49:03 Tower kernel: [] ? alloc_pages_current+0xc1/0xde Sep 15 14:49:03 Tower kernel: [] reiserfs_readpages+0x18/0x1a Sep 15 14:49:03 Tower kernel: [] __do_page_cache_readahead+0x12b/0x1c5 Sep 15 14:49:03 Tower kernel: [] ondemand_readahead+0x20a/0x21b Sep 15 14:49:03 Tower kernel: [] page_cache_async_readahead+0x74/0x7d Sep 15 14:49:03 Tower kernel: [] generic_file_read_iter+0x1ea/0x538 Sep 15 14:49:03 Tower kernel: [] ? fuse_dev_read+0x61/0x68 Sep 15 14:49:03 Tower kernel: [] new_sync_read+0x78/0x9c Sep 15 14:49:03 Tower kernel: [] vfs_read+0x89/0x124 Sep 15 14:49:03 Tower kernel: [] SyS_pread64+0x50/0x81 Sep 15 14:49:03 Tower kernel: [] system_call_fastpath+0x16/0x1b Sep 15 14:49:03 Tower kernel: ---[ end trace f40ee4fffec613b4 ]--- Sep 15 14:49:03 Tower kernel: general protection fault: 0000 [#2] SMP Sep 15 14:49:03 Tower kernel: Modules linked in: kvm_intel kvm vhost_net vhost tun veth xt_nat ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_nat_ipv4 nf_nat iptable_filter ip_tables md_mod ahci e1000e sata_sil24 libahci i2c_i801 ptp mvsas libsas scsi_transport_sas pps_core ipmi_si Sep 15 14:49:03 Tower kernel: CPU: 1 PID: 1154 Comm: kworker/1:1H Tainted: G D W 3.16.2-unRAID #10 Sep 15 14:49:03 Tower kernel: Hardware name: Supermicro X9SCL/X9SCM/X9SCL/X9SCM, BIOS 2.10 01/09/2014 Sep 15 14:49:03 Tower kernel: Workqueue: kblockd blk_delay_work Sep 15 14:49:03 Tower kernel: task: ffff880217b8e660 ti: ffff880223698000 task.ti: ffff880223698000 Sep 15 14:49:03 Tower kernel: RIP: 0010:[] [] kmem_cache_alloc+0x78/0x105 Sep 15 14:49:03 Tower kernel: RSP: 0018:ffff88022369bb38 EFLAGS: 00010086 Sep 15 14:49:03 Tower kernel: RAX: 0000000000000000 RBX: ffff8802243af600 RCX: 00000000000018f8 Sep 15 14:49:03 Tower kernel: RDX: 00000000000018f7 RSI: 0000000000011220 RDI: ffff880227003500 Sep 15 14:49:03 Tower kernel: RBP: ffff88022369bb58 R08: 0000000000015a60 R09: 726f2e7265737500 Sep 15 14:49:03 Tower kernel: R10: 0000000000000020 R11: 000000000000b4e7 R12: 0000000000011220 Sep 15 14:49:03 Tower kernel: R13: ffffffff810a5b3d R14: ffff880227003500 R15: ffff880217b8e660 Sep 15 14:49:03 Tower kernel: FS: 0000000000000000(0000) GS:ffff88022fc40000(0000) knlGS:0000000000000000 Sep 15 14:49:03 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Sep 15 14:49:03 Tower kernel: CR2: 00002b4c208435e0 CR3: 00000000c22d2000 CR4: 00000000001407e0 Sep 15 14:49:03 Tower kernel: Stack: Sep 15 14:49:03 Tower kernel: ffff8802243af600 0000000000011220 0000000000000080 ffff88022369bb98 Sep 15 14:49:03 Tower kernel: ffff88022369bb68 ffffffff810a5b3d ffff88022369bbd0 ffffffff810a5c0a Sep 15 14:49:03 Tower kernel: 0001122000000000 0000000000000000 0000000000000000 0000000000000000 Sep 15 14:49:03 Tower kernel: Call Trace: Sep 15 14:49:03 Tower kernel: [] mempool_alloc_slab+0x10/0x12 Sep 15 14:49:03 Tower kernel: [] mempool_alloc+0x4d/0x110 Sep 15 14:49:03 Tower kernel: [] scsi_sg_alloc+0x3d/0x3f Sep 15 14:49:03 Tower kernel: [] __sg_alloc_table+0x68/0x126 Sep 15 14:49:03 Tower kernel: [] ? scsi_init_sgtable+0x59/0x59 Sep 15 14:49:03 Tower kernel: [] scsi_alloc_sgtable+0x22/0x44 Sep 15 14:49:03 Tower kernel: [] scsi_init_sgtable+0x1e/0x59 Sep 15 14:49:03 Tower kernel: [] scsi_init_io+0x37/0x161 Sep 15 14:49:03 Tower kernel: [] scsi_setup_fs_cmnd+0x51/0x6a Sep 15 14:49:03 Tower kernel: [] sd_init_command+0x390/0xaf7 Sep 15 14:49:03 Tower kernel: [] scsi_prep_fn+0x126/0x1cc Sep 15 14:49:03 Tower kernel: [] blk_peek_request+0xef/0x1bc Sep 15 14:49:03 Tower kernel: [] scsi_request_fn+0x2e/0x517 Sep 15 14:49:03 Tower kernel: [] __blk_run_queue+0x2d/0x36 Sep 15 14:49:03 Tower kernel: [] blk_delay_work+0x20/0x77 Sep 15 14:49:03 Tower kernel: [] process_one_work+0x20d/0x332 Sep 15 14:49:03 Tower kernel: [] worker_thread+0x392/0x507 Sep 15 14:49:03 Tower kernel: [] ? cancel_delayed_work_sync+0x10/0x10 Sep 15 14:49:03 Tower kernel: [] kthread+0xd6/0xde Sep 15 14:49:03 Tower kernel: [] ? kthread_create_on_node+0x168/0x168 Sep 15 14:49:03 Tower kernel: [] ret_from_fork+0x7c/0xb0 Sep 15 14:49:03 Tower kernel: [] ? kthread_create_on_node+0x168/0x168 Sep 15 14:49:03 Tower kernel: Code: 4d 85 c9 75 16 4c 89 e9 83 ca ff 44 89 e6 4c 89 f7 e8 47 7e 4f 00 49 89 c1 eb 2b 48 85 c0 74 e5 49 63 46 20 48 8d 4a 01 4d 8b 06 <49> 8b 1c 01 4c 89 c8 65 49 0f c7 08 0f 94 c0 84 c0 74 ab 49 63 Sep 15 14:49:03 Tower kernel: RIP [] kmem_cache_alloc+0x78/0x105 Sep 15 14:49:03 Tower kernel: RSP Sep 15 14:49:03 Tower kernel: ---[ end trace f40ee4fffec613b5 ]--- Sep 15 14:49:03 Tower kernel: ------------[ cut here ]------------ Sep 15 14:49:03 Tower kernel: WARNING: CPU: 1 PID: 1154 at kernel/smp.c:283 smp_call_function_single+0x64/0x86() Sep 15 14:49:03 Tower kernel: Modules linked in: kvm_intel kvm vhost_net vhost tun veth xt_nat ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_nat_ipv4 nf_nat iptable_filter ip_tables md_mod ahci e1000e sata_sil24 libahci i2c_i801 ptp mvsas libsas scsi_transport_sas pps_core ipmi_si Sep 15 14:49:03 Tower kernel: CPU: 1 PID: 1154 Comm: kworker/1:1H Tainted: G D W 3.16.2-unRAID #10 Sep 15 14:49:03 Tower kernel: Hardware name: Supermicro X9SCL/X9SCM/X9SCL/X9SCM, BIOS 2.10 01/09/2014 Sep 15 14:49:03 Tower kernel: fffffffffffffff2 ffff88022369b890 ffffffff815d8ee8 0000000000000000 Sep 15 14:49:03 Tower kernel: ffff88022369b8c8 ffffffff81040687 ffffffff81088e17 0000000000000001 Sep 15 14:49:03 Tower kernel: ffffffff8109b010 ffff88022369b918 ffff88022369b901 ffff88022369b8d8 Sep 15 14:49:03 Tower kernel: Call Trace: Sep 15 14:49:03 Tower kernel: [] dump_stack+0x45/0x56 Sep 15 14:49:03 Tower kernel: [] warn_slowpath_common+0x75/0x8e Sep 15 14:49:03 Tower kernel: [] ? smp_call_function_single+0x64/0x86 Sep 15 14:49:03 Tower kernel: [] ? cpu_clock_event_add+0x16/0x16 Sep 15 14:49:03 Tower kernel: [] warn_slowpath_null+0x15/0x17 Sep 15 14:49:03 Tower kernel: [] smp_call_function_single+0x64/0x86 Sep 15 14:49:03 Tower kernel: [] task_function_call+0x44/0x4e Sep 15 14:49:03 Tower kernel: [] ? __perf_event_task_sched_out+0x31e/0x31e Sep 15 14:49:03 Tower kernel: [] perf_cgroup_exit+0x19/0x1b Sep 15 14:49:03 Tower kernel: [] cgroup_exit+0xa9/0xcd Sep 15 14:49:03 Tower kernel: [] do_exit+0x3ab/0x8c0 Sep 15 14:49:03 Tower kernel: [] ? printk+0x4f/0x51 Sep 15 14:49:03 Tower kernel: [] oops_end+0xcc/0xe1 Sep 15 14:49:03 Tower kernel: [] die+0x55/0x60 Sep 15 14:49:03 Tower kernel: [] do_general_protection+0x95/0x141 Sep 15 14:49:03 Tower kernel: [] ? mempool_alloc_slab+0x10/0x12 Sep 15 14:49:03 Tower kernel: [] general_protection+0x28/0x30 Sep 15 14:49:03 Tower kernel: [] ? mempool_alloc_slab+0x10/0x12 Sep 15 14:49:03 Tower kernel: [] ? kmem_cache_alloc+0x78/0x105 Sep 15 14:49:03 Tower kernel: [] mempool_alloc_slab+0x10/0x12 Sep 15 14:49:03 Tower kernel: [] mempool_alloc+0x4d/0x110 Sep 15 14:49:03 Tower kernel: [] scsi_sg_alloc+0x3d/0x3f Sep 15 14:49:03 Tower kernel: [] __sg_alloc_table+0x68/0x126 Sep 15 14:49:03 Tower kernel: [] ? scsi_init_sgtable+0x59/0x59 Sep 15 14:49:03 Tower kernel: [] scsi_alloc_sgtable+0x22/0x44 Sep 15 14:49:03 Tower kernel: [] scsi_init_sgtable+0x1e/0x59 Sep 15 14:49:03 Tower kernel: [] scsi_init_io+0x37/0x161 Sep 15 14:49:03 Tower kernel: [] scsi_setup_fs_cmnd+0x51/0x6a Sep 15 14:49:03 Tower kernel: [] sd_init_command+0x390/0xaf7 Sep 15 14:49:03 Tower kernel: [] scsi_prep_fn+0x126/0x1cc Sep 15 14:49:03 Tower kernel: [] blk_peek_request+0xef/0x1bc Sep 15 14:49:03 Tower kernel: [] scsi_request_fn+0x2e/0x517 Sep 15 14:49:03 Tower kernel: [] __blk_run_queue+0x2d/0x36 Sep 15 14:49:03 Tower kernel: [] blk_delay_work+0x20/0x77 Sep 15 14:49:03 Tower kernel: [] process_one_work+0x20d/0x332 Sep 15 14:49:03 Tower kernel: [] worker_thread+0x392/0x507 Sep 15 14:49:03 Tower kernel: [] ? cancel_delayed_work_sync+0x10/0x10 Sep 15 14:49:03 Tower kernel: [] kthread+0xd6/0xde Sep 15 14:49:03 Tower kernel: [] ? kthread_create_on_node+0x168/0x168 Sep 15 14:49:03 Tower kernel: [] ret_from_fork+0x7c/0xb0 Sep 15 14:49:03 Tower kernel: [] ? kthread_create_on_node+0x168/0x168 Sep 15 14:49:03 Tower kernel: ---[ end trace f40ee4fffec613b6 ]--- Sep 15 14:49:03 Tower kernel: BUG: unable to handle kernel paging request at ffffffffffffffd8
September 15, 201411 yr Author This is caused whenever the mover is running. Is it possible that this might be a possible way to fix? http://lime-technology.com/forum/index.php?PHPSESSID=40a86229b3fcb45b037d4001b65e0161&topic=28484.0 Desperately seeking for advise.
September 16, 201411 yr Author Whenever I invoke the mover, I can generate a Kernel Panic. I corrected some of the top level directories with the extended attributes script that fixed some errors (mentioned in my previous post) but it haven't fixed my issue: /usr/bin/tail -f /var/log/syslog 2>&1 Sep 16 07:41:00 Tower emhttp: shcmd (71): /usr/local/sbin/emhttp_event started Sep 16 07:41:00 Tower emhttp_event: started Sep 16 07:41:00 Tower rc.unRAID[6844][6848]: Processing /etc/rc.d/rc.unRAID.d/ start scripts. Sep 16 07:41:01 Tower avahi-daemon[5745]: Service "Tower" (/etc/avahi/services/smb.service) successfully established. Sep 16 07:41:01 Tower avahi-daemon[5745]: Service "Tower-AFP" (/etc/avahi/services/afp.service) successfully established. Sep 16 07:41:02 Tower ntpd_intres[1529]: parent died before we finished, exiting Sep 16 07:41:07 Tower kernel: docker0: port 1(vethe808) entered forwarding state Sep 16 07:41:07 Tower kernel: docker0: port 2(vethd0f7) entered forwarding state Sep 16 08:41:49 Tower sshd[28850]: Accepted password for root from 192.168.178.30 port 49322 ssh2 Sep 16 08:58:11 Tower sshd[2467]: Accepted password for root from 192.168.178.30 port 49572 ssh2 Sep 16 09:15:37 Tower emhttp: shcmd (72): /usr/local/sbin/mover |& logger & Sep 16 09:15:37 Tower logger: mover started Sep 16 09:15:37 Tower logger: moving Oliver/ Sep 16 09:15:37 Tower logger: ./Oliver/Archiv/IT/unRaid/unRAIDServer-6.0-beta9-x86_64.zip Sep 16 09:15:37 Tower logger: .d..t...... ./ Sep 16 09:15:37 Tower logger: .d..t.....x Oliver/ Sep 16 09:15:37 Tower logger: .d..t...... Oliver/Archiv/ Sep 16 09:15:37 Tower logger: .d..t...... Oliver/Archiv/IT/ Sep 16 09:15:37 Tower logger: .d..tp..... Oliver/Archiv/IT/unRaid/ Sep 16 09:15:37 Tower logger: >f+++++++++ Oliver/Archiv/IT/unRaid/unRAIDServer-6.0-beta9-x86_64.zip Sep 16 09:17:33 Tower logger: ./Oliver/Archiv/IT/unRaid Sep 16 09:17:33 Tower logger: .d..t...... ./ Sep 16 09:17:33 Tower logger: rsync: get_xattr_names: llistxattr(""/mnt/user0/Oliver"",1024) failed: Software caused connection abort (103) Sep 16 09:17:33 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: failed to set times on "/mnt/user0/Oliver": Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver/Archiv, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_xattr_names: llistxattr(""/mnt/user0/Oliver/Archiv"",1024) failed: Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver/Archiv, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: set_acl: sys_acl_set_file(Oliver/Archiv, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver/Archiv/IT, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_xattr_names: llistxattr(""/mnt/user0/Oliver/Archiv/IT"",1024) failed: Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver/Archiv/IT, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: set_acl: sys_acl_set_file(Oliver/Archiv/IT, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver/Archiv/IT/unRaid, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_xattr_names: llistxattr(""/mnt/user0/Oliver/Archiv/IT/unRaid"",1024) failed: Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver/Archiv/IT/unRaid, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: failed to set times on "/mnt/user0/Oliver/Archiv/IT/unRaid": Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: .d..t.....x Oliver/ Sep 16 09:17:33 Tower logger: .d.......a. Oliver/Archiv/ Sep 16 09:17:33 Tower logger: .d.......a. Oliver/Archiv/IT/ Sep 16 09:17:33 Tower logger: .d..t....a. Oliver/Archiv/IT/unRaid/ Sep 16 09:17:33 Tower logger: rsync: get_acl: sys_acl_get_file(Oliver, ACL_TYPE_ACCESS): Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: get_xattr_names: llistxattr(""/mnt/user0/Oliver"",1024) failed: Transport endpoint is not connected (107) Sep 16 09:17:33 Tower logger: rsync: failed to set times on "/mnt/user0/Oliver": Transport endpoint is not connected (107) Sep 16 09:17:33 Tower kernel: traps: shfs[9460] general protection ip:2b3e41f9e7b7 sp:2b3e42aedb20 error:0 in libc-2.17.so[2b3e41f1f000+1bf000] Sep 16 09:17:33 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.0] Sep 16 09:17:33 Tower logger: skipping appdata/ Sep 16 09:17:33 Tower logger: skipping webvirtmgr/ Sep 16 09:17:33 Tower logger: mover finished Sep 16 09:17:33 Tower kernel: general protection fault: 0000 [#1] SMP Sep 16 09:17:33 Tower kernel: Modules linked in: kvm_intel kvm vhost_net vhost tun veth xt_nat ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_nat_ipv4 nf_nat iptable_filter ip_tables md_mod ahci libahci i2c_i801 e1000e sata_sil24 mvsas ptp libsas scsi_transport_sas pps_core ipmi_si I'm running out of ideas, seeking for ideas (memtest & reiserfsck were both running without issues)
September 16, 201411 yr Author Talking to myself here Rebooted the server Manually deleted the file from the cache drive that caused the server crash: unRAIDServer-6.0-beta9-x86_64.zip Stopped Docker Manually invoked Mover The process was running without any issue. Parity check is running now and I will invoke the Mover once more after the check is done - this time with Docker up and running. However I don't think that Docker is the issue. It seems to be this one file that caused the server crash (also underpinned by the syslog). Why is that?
September 16, 201411 yr You are running beta9, right? On the Settings/Share Settings page, do you have anything filled in for 'Included disk(s)' or 'Excluded disk(s)'? For your individual shares, do any of them has anything filled in for 'Included disk(s)' or 'Excluded disk(s)'? You didn't post a complete syslog. The part you posted indeed shows the crash, but the reason I like to see the entire log is that it lets me see what else might be installed on the server.
September 17, 201411 yr Author Yes Tom, that's correct. It's the first server from my signature. The server is running great since yesterday: I have moved everything off the cache drive (with the exception of those files that resides permanent on my cache drive: docker.img, arch and win7 VMs, webvirtmanager) and stopped any mover activities. No share is now taking advantage of cache. All plugins are running (Web Virt Manager, Libman, Powerdown 2.0.7, Docker Manager) as well as 3 Docker (AirVideo, MariaDB, ownCloud). Back to your questions: I have excluded disk1 for all shares. Disk1 contains two Time Machine sparsebundle files from two Macs and should contain nothing else. I haven't used 'Include disk(s)'. I have a full syslog attached now. Great that you are stepping in
September 26, 201411 yr Author Tom, right after this issue my parity drive crashed and I had to replace it. Could that have caused these errors or do you have another idea?
September 28, 201411 yr Same type of problem here ... 3 crashs in 2 days, I suspect a problem on a data drive (md5). During the first crash, I've seen a weird error message about reiserfs and md5, I have not been able to save the exact message, I was monitoring my server remotly with IPMI, all others access was down (telnet, ssh, webUI, unMenu ...) I'm currently runnin a reiserfschk --check (with array in maintenance mode) on /dev/md5, and I'm waiting for results Syslog attached, downloaded from unMenu, just a few minutes before last 'fatal' crash. syslog-2014-09-28.zip
September 29, 201411 yr After a reiserfsck --check and a successfull reiserfsck --rebuild-tree (as suggested by reiserfsck --check result), an update to beta10 and a reboot, all seems to be fine ! (able to create/copy file to /dev/md5, without log errors and system crash) I will do a few more test in the next days ...
October 2, 201411 yr After a reiserfsck --check and a successfull reiserfsck --rebuild-tree (as suggested by reiserfsck --check result), an update to beta10 and a reboot, all seems to be fine ! (able to create/copy file to /dev/md5, without log errors and system crash) I will do a few more test in the next days ... Thanks for chiming in. And Edgar? Just an FYI, Tom's going to be out for the next few days but may still check in with you on this issue (not sure). Just wanted to let you know if there is a delay in response from him, that's why. We definitely want to get this issue sorted out...
October 2, 201411 yr Author Thanks a lot Jonp...no further server crash after I switched off the cache for all of the shares. The broken parity drive might have caused the issue but it would be good to get a confirmation when Tom is back.
October 2, 201411 yr Thanks a lot Jonp...no further server crash after I switched off the cache for all of the shares. The broken parity drive might have caused the issue but it would be good to get a confirmation when Tom is back. No problem. Thank you for your patience!
Archived
This topic is now archived and is closed to further replies.