Jump to content

al_uk

Members
  • Posts

    161
  • Joined

  • Last visited

Converted

  • Gender
    Undisclosed

Recent Profile Visitors

The recent visitors block is disabled and is not being shown to other users.

al_uk's Achievements

Apprentice

Apprentice (3/14)

3

Reputation

  1. I restarted the pi, which made no difference, then detached and reattched the ports to the vm, and the log entries have stopped appearing. Not entirely sure why, but problem solved for now. Thanks for the help.
  2. Any pointers to help me diagnose the log entries would be much appreciated please 🙂
  3. Thank you for replying. I have a Pi running dietpi and usbip with 2 usb devices attached. On Unraid I have passed those devices to a VM. This is all working fine. Here's a screenshot of my USBIP page. Is it set correctly?
  4. My syslog is full of these messages. Many per second. Is this just debug logging, and doesn't indicate a problem? How do I switch debug logging off? I couldn't see it in the gui or by searching around. Thanks Jan 12 21:25:56 Tower kernel: vhci_hcd: unlink->seqnum 223034811 Jan 12 21:25:56 Tower kernel: vhci_hcd: urb->status -104 Jan 12 21:25:57 Tower kernel: vhci_hcd: unlink->seqnum 223034817 Jan 12 21:25:57 Tower kernel: vhci_hcd: urb->status -104 Jan 12 21:25:57 Tower kernel: vhci_hcd: unlink->seqnum 223034823 Jan 12 21:25:57 Tower kernel: vhci_hcd: urb->status -104 Jan 12 21:25:57 Tower kernel: vhci_hcd: unlink->seqnum 223034829 Jan 12 21:25:57 Tower kernel: vhci_hcd: urb->status -104 Jan 12 21:25:57 Tower kernel: vhci_hcd: unlink->seqnum 223034835 Jan 12 21:25:57 Tower kernel: vhci_hcd: urb->status -104
  5. I had the same error this morning while backing up. So I repeated the btrfs rescue zero-log /dev/dm-7 command in maintenance mode. I still have errors from a file system check though. Is there anything I should do to fix these, and is that likely to mean the backup will proceed properly? [1/7] checking root items [2/7] checking extents data backref 727264886784 root 5 owner 1059284 offset 57325158400 num_refs 0 not found in extent tree incorrect local backref count on 727264886784 root 5 owner 1059284 offset 57325158400 found 1 wanted 0 back 0x603202e0 incorrect local backref count on 727264886784 root 18446612751160515216 owner 1059284 offset 57325158400 found 0 wanted 1 back 0x45322090 backref disk bytenr does not match extent record, bytenr=727264886784, ref bytenr=0 backpointer mismatch on [727264886784 4096] ERROR: errors found in extent allocation tree or chunk allocation [3/7] checking free space tree [4/7] checking fs roots [5/7] checking only csums items (without verifying data) [6/7] checking root refs [7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check... Checking filesystem on /dev/mapper/nvme0n1p1 UUID: 61417f12-0169-441c-9476-9033201fe7b6 found 706134294528 bytes used, error(s) found total csum bytes: 667755876 total tree bytes: 2141306880 total fs tree bytes: 864403456 total extent tree bytes: 444317696 btree space waste bytes: 363431207 file data blocks allocated: 27371022684160 referenced 586627985408
  6. That did it, the array started properly, the cache drive pool appeared, and all dockers and vms re-appeared and started. Thank you. Diags attached again. Do you have a view as to what could have caused the problem? Here's where it seemed to start going wrong at 4:12am in the logs yesterday. Mar 1 04:00:01 Tower CA Backup/Restore: ####################################### Mar 1 04:00:01 Tower CA Backup/Restore: Community Applications appData Backup Mar 1 04:00:01 Tower CA Backup/Restore: Applications will be unavailable during Mar 1 04:00:01 Tower CA Backup/Restore: this process. They will automatically Mar 1 04:00:01 Tower CA Backup/Restore: be restarted upon completion. Mar 1 04:00:01 Tower CA Backup/Restore: ####################################### Mar 1 04:00:01 Tower CA Backup/Restore: Backup of appData starting. This may take awhile Mar 1 04:00:01 Tower CA Backup/Restore: Not stopping adminer: Not started! [ / Exited (0) 2 weeks ago] Mar 1 04:00:01 Tower CA Backup/Restore: Not stopping bookstack: Not started! [ / Exited (255) 6 days ago] Mar 1 04:00:01 Tower CA Backup/Restore: Not stopping CloudCommander: Not started! [ / Exited (137) 2 weeks ago] Mar 1 04:00:01 Tower CA Backup/Restore: Not stopping Crafty-4: Not started! [ / Exited (255) 6 days ago] Mar 1 04:00:01 Tower CA Backup/Restore: Not stopping CrashPlanPRO: Not started! [ / Exited (0) 2 weeks ago] Mar 1 04:00:01 Tower CA Backup/Restore: Czkawka set to not be stopped by ca backup's advanced settings. Skipping Mar 1 04:00:01 Tower CA Backup/Restore: Stopping Duplicacy... Mar 1 04:00:01 Tower kernel: docker0: port 1(veth1ef1653) entered disabled state Mar 1 04:00:01 Tower kernel: veth32d7fb9: renamed from eth0 Mar 1 04:00:01 Tower kernel: docker0: port 1(veth1ef1653) entered disabled state Mar 1 04:00:01 Tower kernel: device veth1ef1653 left promiscuous mode Mar 1 04:00:01 Tower kernel: docker0: port 1(veth1ef1653) entered disabled state Mar 1 04:00:02 Tower CA Backup/Restore: done! (took 1 seconds) Mar 1 04:00:02 Tower CA Backup/Restore: Stopping EmbyServer... Mar 1 04:00:04 Tower kernel: eth0: renamed from veth53d8905 Mar 1 04:00:04 Tower kernel: veth53d8905: renamed from eth0 Mar 1 04:00:05 Tower CA Backup/Restore: done! (took 3 seconds) Mar 1 04:00:05 Tower CA Backup/Restore: Not stopping Emoncms: Not started! [ / Exited (137) 3 weeks ago] Mar 1 04:00:05 Tower CA Backup/Restore: Stopping ESPHome... Mar 1 04:00:15 Tower kernel: vethb8134b2: renamed from eth0 Mar 1 04:00:16 Tower CA Backup/Restore: done! (took 11 seconds) Mar 1 04:00:16 Tower CA Backup/Restore: Stopping freshrss... Mar 1 04:00:20 Tower kernel: docker0: port 2(veth18abbbf) entered disabled state Mar 1 04:00:20 Tower kernel: veth20fe3f5: renamed from eth0 Mar 1 04:00:20 Tower kernel: docker0: port 2(veth18abbbf) entered disabled state Mar 1 04:00:20 Tower kernel: device veth18abbbf left promiscuous mode Mar 1 04:00:20 Tower kernel: docker0: port 2(veth18abbbf) entered disabled state Mar 1 04:00:20 Tower CA Backup/Restore: done! (took 4 seconds) Mar 1 04:00:20 Tower CA Backup/Restore: Not stopping grocy: Not started! [ / Exited (0) 7 weeks ago] Mar 1 04:00:20 Tower CA Backup/Restore: Not stopping Homebox: Not started! [ / Exited (0) 2 weeks ago] Mar 1 04:00:20 Tower CA Backup/Restore: Not stopping linkace: Not started! [ / Exited (255) 6 days ago] Mar 1 04:00:20 Tower CA Backup/Restore: Stopping LogitechMediaServer... Mar 1 04:00:22 Tower kernel: docker0: port 3(veth43ea438) entered disabled state Mar 1 04:00:22 Tower kernel: veth61a91ff: renamed from eth0 Mar 1 04:00:22 Tower kernel: docker0: port 3(veth43ea438) entered disabled state Mar 1 04:00:22 Tower kernel: device veth43ea438 left promiscuous mode Mar 1 04:00:22 Tower kernel: docker0: port 3(veth43ea438) entered disabled state Mar 1 04:00:22 Tower CA Backup/Restore: done! (took 2 seconds) Mar 1 04:00:22 Tower CA Backup/Restore: Not stopping MakeMKV: Not started! [ / Created] Mar 1 04:00:22 Tower CA Backup/Restore: Stopping mariadb... Mar 1 04:00:26 Tower kernel: vethe184c2c: renamed from eth0 Mar 1 04:00:26 Tower CA Backup/Restore: done! (took 4 seconds) Mar 1 04:00:26 Tower CA Backup/Restore: Stopping Mealie... Mar 1 04:00:37 Tower kernel: veth946f58e: renamed from eth0 Mar 1 04:00:37 Tower CA Backup/Restore: done! (took 11 seconds) Mar 1 04:00:37 Tower CA Backup/Restore: Stopping MinecraftBedrockEdition... Mar 1 04:00:39 Tower kernel: veth9a5ee09: renamed from eth0 Mar 1 04:00:39 Tower CA Backup/Restore: done! (took 2 seconds) Mar 1 04:00:39 Tower CA Backup/Restore: Stopping mosquitto... Mar 1 04:00:39 Tower kernel: veth72d18df: renamed from eth0 Mar 1 04:00:40 Tower CA Backup/Restore: done! (took 1 seconds) Mar 1 04:00:40 Tower CA Backup/Restore: Stopping NextCloud... Mar 1 04:00:44 Tower kernel: veth1af17d1: renamed from eth0 Mar 1 04:00:44 Tower CA Backup/Restore: done! (took 4 seconds) Mar 1 04:00:44 Tower CA Backup/Restore: Stopping NodeRed-PROD... Mar 1 04:00:44 Tower kernel: veth28ae760: renamed from eth0 Mar 1 04:00:44 Tower CA Backup/Restore: done! (took 0 seconds) Mar 1 04:00:44 Tower CA Backup/Restore: Stopping NodeRed-TEST... Mar 1 04:00:44 Tower kernel: veth51bd808: renamed from eth0 Mar 1 04:00:45 Tower CA Backup/Restore: done! (took 1 seconds) Mar 1 04:00:45 Tower CA Backup/Restore: Not stopping OpenBooks: Not started! [ / Exited (0) 4 weeks ago] Mar 1 04:00:45 Tower CA Backup/Restore: Stopping paperless-ngx... Mar 1 04:00:48 Tower kernel: device br0 left promiscuous mode Mar 1 04:00:48 Tower kernel: vethbdb9ec9: renamed from eth0 Mar 1 04:00:48 Tower CA Backup/Restore: done! (took 3 seconds) Mar 1 04:00:48 Tower CA Backup/Restore: Not stopping PhotoPrism: Not started! [ / Exited (143) 3 weeks ago] Mar 1 04:00:48 Tower CA Backup/Restore: Not stopping PhotoStructure: Not started! [ / Exited (0) 3 weeks ago] Mar 1 04:00:48 Tower CA Backup/Restore: Not stopping phpmyadmin: Not started! [ / Created] Mar 1 04:00:48 Tower CA Backup/Restore: Stopping pihole-template... Mar 1 04:00:52 Tower kernel: device br0.81 left promiscuous mode Mar 1 04:00:52 Tower kernel: veth878bca7: renamed from eth0 Mar 1 04:00:53 Tower CA Backup/Restore: done! (took 5 seconds) Mar 1 04:00:53 Tower CA Backup/Restore: Stopping PlexMediaServer... Mar 1 04:01:02 Tower CA Backup/Restore: done! (took 9 seconds) Mar 1 04:01:02 Tower CA Backup/Restore: Stopping Pterodactyl-Deamons... Mar 1 04:01:02 Tower CA Backup/Restore: done! (took 0 seconds) Mar 1 04:01:02 Tower CA Backup/Restore: Not stopping Pterodactyl-Panel: Not started! [ / Exited (255) 6 days ago] Mar 1 04:01:02 Tower CA Backup/Restore: Stopping Redis... Mar 1 04:01:02 Tower kernel: device br0.62 left promiscuous mode Mar 1 04:01:02 Tower kernel: veth966a341: renamed from eth0 Mar 1 04:01:02 Tower CA Backup/Restore: done! (took 0 seconds) Mar 1 04:01:02 Tower CA Backup/Restore: Not stopping splunk: Not started! [ / Created] Mar 1 04:01:02 Tower CA Backup/Restore: Not stopping Xeoma: Not started! [ / Dead] Mar 1 04:01:02 Tower CA Backup/Restore: Backing up USB Flash drive config folder to /mnt/user/Backups/staging/USBbackup/ Mar 1 04:01:02 Tower CA Backup/Restore: Using command: /usr/bin/rsync -avXHq --delete --log-file="/var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log" /boot/ "/mnt/user/B../" > /dev/null 2>&1 Mar 1 04:01:11 Tower emhttpd: read SMART /dev/sdm Mar 1 04:01:20 Tower emhttpd: read SMART /dev/sdg Mar 1 04:01:26 Tower CA Backup/Restore: Changing permissions on backup Mar 1 04:01:27 Tower CA Backup/Restore: Backing up libvirt.img to /mnt/user/Backups/staging/libvirt/ Mar 1 04:01:27 Tower CA Backup/Restore: Using Command: /usr/bin/rsync -avXHq --delete --log-file="/var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log" "/mnt/user/s../" > /dev/null 2>&1 ### [PREVIOUS LINE REPEATED 1 TIMES] ### Mar 1 04:01:27 Tower CA Backup/Restore: Changing permissions on backup Mar 1 04:01:27 Tower CA Backup/Restore: Backing Up appData from /mnt/user/appdata/docker/ to /[email protected] Mar 1 04:01:27 Tower CA Backup/Restore: Separate archives disabled! Saving into one file. Mar 1 04:01:27 Tower CA Backup/Restore: Using command: cd '/mnt/user/appdata/docker/' && /usr/bin/tar -caf '/[email protected]' . >> /var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log 2>&1 & echo $! > /tmp/ca.backup2/tempFiles/backupInProgress && wait $! Mar 1 04:01:27 Tower CA Backup/Restore: Backing Up Mar 1 04:12:24 Tower kernel: ------------[ cut here ]------------ Mar 1 04:12:24 Tower kernel: WARNING: CPU: 3 PID: 1388 at fs/btrfs/extent-tree.c:3073 __btrfs_free_extent+0x40e/0xaae Mar 1 04:12:24 Tower kernel: Modules linked in: tcp_diag udp_diag inet_diag vhci_hcd usbip_host usbip_core xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb tap veth macvlan xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs dm_crypt dm_mod dax nfsd auth_rpcgss oid_registry lockd grace sunrpc md_mod ipmi_devintf efivarfs wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha ip6table_filter ip6_tables iptable_filter ip_tables x_tables bridge 8021q garp mrp stp llc igb mlx4_en mlx4_core e1000e i915 ipmi_ssif iosf_mbi drm_buddy ast drm_display_helper drm_vram_helper drm_ttm_helper ttm drm_kms_helper drm x86_pkg_temp_thermal intel_powerclamp intel_gtt i2c_i801 coretemp input_leds wmi_bmof kvm_intel kvm crct10dif_pclmul crc32_pclmul Mar 1 04:12:24 Tower kernel: crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd rapl intel_cstate intel_uncore nvme agpgart i2c_algo_bit i2c_smbus nvme_core led_class joydev i2c_core ahci acpi_ipmi syscopyarea libahci video sysfillrect intel_pch_thermal sysimgblt sata_mv fb_sys_fops thermal wmi fan ipmi_si backlight acpi_pad acpi_tad button unix [last unloaded: igb] Mar 1 04:12:24 Tower kernel: CPU: 3 PID: 1388 Comm: kworker/u24:3 Not tainted 5.19.17-Unraid #2 Mar 1 04:12:24 Tower kernel: Hardware name: Supermicro Super Server/X11SCA-F, BIOS 1.0b 02/13/2019 Mar 1 04:12:24 Tower kernel: Workqueue: events_unbound btrfs_preempt_reclaim_metadata_space Mar 1 04:12:24 Tower kernel: RIP: 0010:__btrfs_free_extent+0x40e/0xaae Mar 1 04:12:24 Tower kernel: Code: f6 48 c7 c7 dc 1b 0f 82 e8 8e c2 51 00 0f 0b 44 89 f1 ba fc 0b 00 00 eb 77 45 31 f6 44 8b 6d 40 e9 b9 00 00 00 83 f8 fe 75 7a <0f> 0b 48 8b 7d 00 e8 95 43 00 00 4d 89 e1 48 c7 c6 c4 20 0f 82 41 Mar 1 04:12:24 Tower kernel: RSP: 0018:ffffc90003f4fbe0 EFLAGS: 00010246 Mar 1 04:12:24 Tower kernel: RAX: 00000000fffffffe RBX: ffff8888d84c7bc8 RCX: 0000000000000000 Mar 1 04:12:24 Tower kernel: RDX: 0000000000000000 RSI: ffff888e274000a8 RDI: ffffc90003f4fb88 Mar 1 04:12:24 Tower kernel: RBP: ffff8881cb0940e0 R08: 0000000000001000 R09: 0000160000000000 Mar 1 04:12:24 Tower kernel: R10: ffff888000000000 R11: ffff888de2f441a8 R12: 00000000001029d4 Mar 1 04:12:24 Tower kernel: R13: 0000000d58d88000 R14: 00000000fffffffe R15: 0000000000000361 Mar 1 04:12:24 Tower kernel: FS: 0000000000000000(0000) GS:ffff88902bac0000(0000) knlGS:0000000000000000 Mar 1 04:12:24 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Mar 1 04:12:24 Tower kernel: CR2: 0000008ac048525a CR3: 0000000195b3c003 CR4: 00000000003726e0 Mar 1 04:12:24 Tower kernel: Call Trace: Mar 1 04:12:24 Tower kernel: <TASK> Mar 1 04:12:24 Tower kernel: ? __btrfs_run_delayed_refs+0xaad/0xb5e Mar 1 04:12:24 Tower kernel: __btrfs_run_delayed_refs+0x66a/0xb5e Mar 1 04:12:24 Tower kernel: ? preempt_latency_start+0x2b/0x46 Mar 1 04:12:24 Tower kernel: btrfs_run_delayed_refs+0x5b/0x12c Mar 1 04:12:24 Tower kernel: flush_space+0x37e/0x491 Mar 1 04:12:24 Tower kernel: ? update_load_avg+0x44/0x38b Mar 1 04:12:24 Tower kernel: ? _raw_spin_lock+0x13/0x1c Mar 1 04:12:24 Tower kernel: ? _raw_spin_unlock+0x14/0x29 Mar 1 04:12:24 Tower kernel: ? btrfs_bg_type_to_factor+0xa/0x1c Mar 1 04:12:24 Tower kernel: ? calc_available_free_space.isra.0+0x33/0x59 Mar 1 04:12:24 Tower kernel: btrfs_preempt_reclaim_metadata_space+0xe8/0x172 Mar 1 04:12:24 Tower kernel: process_one_work+0x1a8/0x295 Mar 1 04:12:24 Tower kernel: worker_thread+0x18b/0x244 Mar 1 04:12:24 Tower kernel: ? rescuer_thread+0x281/0x281 Mar 1 04:12:24 Tower kernel: kthread+0xe4/0xef Mar 1 04:12:24 Tower kernel: ? kthread_complete_and_exit+0x1b/0x1b Mar 1 04:12:24 Tower kernel: ret_from_fork+0x1f/0x30 Mar 1 04:12:24 Tower kernel: </TASK> Mar 1 04:12:24 Tower kernel: ---[ end trace 0000000000000000 ]--- Mar 1 04:12:24 Tower kernel: BTRFS info (device dm-7): leaf 2175205376 gen 62366 total ptrs 147 free space 4817 owner 2 Mar 1 04:12:24 Tower kernel: item 0 key (727264878592 168 4096) itemoff 16230 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61911 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492938752 count 1 Mar 1 04:12:24 Tower kernel: item 1 key (727264886784 168 4096) itemoff 16177 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 32016 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 18446612751160515216 objectid 1059284 offset 57325158400 count 1 Mar 1 04:12:24 Tower kernel: item 2 key (727264890880 168 8192) itemoff 16124 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 31983 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57325301760 count 1 Mar 1 04:12:24 Tower kernel: item 3 key (727264899072 168 4096) itemoff 16071 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 32142 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57323958272 count 1 Mar 1 04:12:24 Tower kernel: item 4 key (727264907264 168 4096) itemoff 16018 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 44726 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491791872 count 1 Mar 1 04:12:24 Tower kernel: item 5 key (727264911360 168 4096) itemoff 15965 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 33161 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491521536 count 1 Mar 1 04:12:24 Tower kernel: item 6 key (727264915456 168 4096) itemoff 15912 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 32105 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57324498944 count 1 Mar 1 04:12:24 Tower kernel: item 7 key (727264919552 168 4096) itemoff 15859 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 35572 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490907136 count 1 Mar 1 04:12:24 Tower kernel: item 8 key (727264923648 168 4096) itemoff 15806 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 38139 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490972672 count 1 Mar 1 04:12:24 Tower kernel: item 9 key (727264927744 168 4096) itemoff 15753 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 36640 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492152320 count 1 Mar 1 04:12:24 Tower kernel: item 10 key (727264931840 168 4096) itemoff 15700 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49472 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490558976 count 1 Mar 1 04:12:24 Tower kernel: item 11 key (727264935936 168 4096) itemoff 15647 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 35229 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490915328 count 1 Mar 1 04:12:24 Tower kernel: item 12 key (727264940032 168 4096) itemoff 15594 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 36740 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492148224 count 1 Mar 1 04:12:24 Tower kernel: item 13 key (727264944128 168 8192) itemoff 15541 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 31986 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57325252608 count 1 Mar 1 04:12:24 Tower kernel: item 14 key (727264952320 168 1105920) itemoff 15488 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 15250 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059280 offset 23358230528 count 1 Mar 1 04:12:24 Tower kernel: item 15 key (727266058240 168 4096) itemoff 15435 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54899 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335562240 count 1 Mar 1 04:12:24 Tower kernel: item 16 key (727266062336 168 4096) itemoff 15382 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54059 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57337126912 count 1 Mar 1 04:12:24 Tower kernel: item 17 key (727266066432 168 4096) itemoff 15329 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54054 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335709696 count 1 Mar 1 04:12:24 Tower kernel: item 18 key (727266070528 168 4096) itemoff 15276 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58704 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267474432 count 1 Mar 1 04:12:24 Tower kernel: item 19 key (727266074624 168 4096) itemoff 15223 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54056 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57336340480 count 1 Mar 1 04:12:24 Tower kernel: item 20 key (727266078720 168 4096) itemoff 15170 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 53377 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491939328 count 1 Mar 1 04:12:24 Tower kernel: item 21 key (727266082816 168 4096) itemoff 15117 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58766 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267519488 count 1 Mar 1 04:12:24 Tower kernel: item 22 key (727266086912 168 4096) itemoff 15064 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 48867 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492344832 count 1 Mar 1 04:12:24 Tower kernel: item 23 key (727266091008 168 4096) itemoff 15011 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54742 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57336213504 count 1 Mar 1 04:12:24 Tower kernel: item 24 key (727266095104 168 4096) itemoff 14958 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54059 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57337151488 count 1 Mar 1 04:12:24 Tower kernel: item 25 key (727266099200 168 4096) itemoff 14905 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 57360 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54884954112 count 1 Mar 1 04:12:24 Tower kernel: item 26 key (727266103296 168 4096) itemoff 14852 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 48701 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491963904 count 1 Mar 1 04:12:24 Tower kernel: item 27 key (727266107392 168 4096) itemoff 14799 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58668 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267367936 count 1 Mar 1 04:12:24 Tower kernel: item 28 key (727266111488 168 4096) itemoff 14746 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58474 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491402752 count 1 Mar 1 04:12:24 Tower kernel: item 29 key (727266115584 168 4096) itemoff 14693 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 48651 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491271680 count 1 Mar 1 04:12:24 Tower kernel: item 30 key (727266119680 168 4096) itemoff 14640 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54602 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334444032 count 1 Mar 1 04:12:24 Tower kernel: item 31 key (727266123776 168 4096) itemoff 14587 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54814 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335930880 count 1 Mar 1 04:12:24 Tower kernel: item 32 key (727266127872 168 4096) itemoff 14534 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 56836 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54890745856 count 1 Mar 1 04:12:24 Tower kernel: item 33 key (727266131968 168 4096) itemoff 14481 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54882 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335185408 count 1 Mar 1 04:12:24 Tower kernel: item 34 key (727266136064 168 4096) itemoff 14428 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62365 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57325965312 count 1 Mar 1 04:12:24 Tower kernel: item 35 key (727266140160 168 4096) itemoff 14375 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49190 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490554880 count 1 Mar 1 04:12:24 Tower kernel: item 36 key (727266148352 168 4096) itemoff 14322 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61916 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267499008 count 1 Mar 1 04:12:24 Tower kernel: item 37 key (727266152448 168 4096) itemoff 14269 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 48933 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491148800 count 1 Mar 1 04:12:24 Tower kernel: item 38 key (727266156544 168 4096) itemoff 14216 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54831 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57336684544 count 1 Mar 1 04:12:24 Tower kernel: item 39 key (727266160640 168 4096) itemoff 14163 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 50439 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490591744 count 1 Mar 1 04:12:24 Tower kernel: item 40 key (727266164736 168 4096) itemoff 14110 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 57596 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492017152 count 1 Mar 1 04:12:24 Tower kernel: item 41 key (727266168832 168 4096) itemoff 14057 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49470 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491886080 count 1 Mar 1 04:12:24 Tower kernel: item 42 key (727266172928 168 4096) itemoff 14004 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61634 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 68920590336 count 1 Mar 1 04:12:24 Tower kernel: item 43 key (727266177024 168 4096) itemoff 13951 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 53228 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54885126144 count 1 Mar 1 04:12:24 Tower kernel: item 44 key (727266181120 168 4096) itemoff 13898 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49570 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490567168 count 1 Mar 1 04:12:24 Tower kernel: item 45 key (727266185216 168 4096) itemoff 13845 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 56836 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54891208704 count 1 Mar 1 04:12:24 Tower kernel: item 46 key (727266189312 168 4096) itemoff 13792 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62044 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492942848 count 1 Mar 1 04:12:24 Tower kernel: item 47 key (727266193408 168 4096) itemoff 13739 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 53804 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490644992 count 1 Mar 1 04:12:24 Tower kernel: item 48 key (727266197504 168 4096) itemoff 13686 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 56837 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54891216896 count 1 Mar 1 04:12:24 Tower kernel: item 49 key (727266201600 168 4096) itemoff 13633 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 48870 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492746240 count 1 Mar 1 04:12:24 Tower kernel: item 50 key (727266205696 168 4096) itemoff 13580 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 56837 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492021248 count 1 Mar 1 04:12:24 Tower kernel: item 51 key (727266209792 168 4096) itemoff 13527 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62102 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 40057319424 count 1 Mar 1 04:12:24 Tower kernel: item 52 key (727266213888 168 4096) itemoff 13474 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58892 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267634176 count 1 Mar 1 04:12:24 Tower kernel: item 53 key (727266217984 168 4096) itemoff 13421 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 50132 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490571264 count 1 Mar 1 04:12:24 Tower kernel: item 54 key (727266222080 168 4096) itemoff 13368 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 52412 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57336578048 count 1 Mar 1 04:12:24 Tower kernel: item 55 key (727266226176 168 4096) itemoff 13315 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62336 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490624512 count 1 Mar 1 04:12:24 Tower kernel: item 56 key (727266230272 168 4096) itemoff 13262 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49561 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492754432 count 1 Mar 1 04:12:24 Tower kernel: item 57 key (727266234368 168 4096) itemoff 13209 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58557 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267286016 count 1 Mar 1 04:12:24 Tower kernel: item 58 key (727266238464 168 4096) itemoff 13156 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 57573 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54890864640 count 1 Mar 1 04:12:24 Tower kernel: item 59 key (727266242560 168 4096) itemoff 13103 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58555 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267306496 count 1 Mar 1 04:12:24 Tower kernel: item 60 key (727266246656 168 4096) itemoff 13050 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 55373 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491316736 count 1 Mar 1 04:12:24 Tower kernel: item 61 key (727266250752 168 4096) itemoff 12997 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49241 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492369408 count 1 Mar 1 04:12:24 Tower kernel: item 62 key (727266254848 168 4096) itemoff 12944 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61947 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 67351552000 count 1 Mar 1 04:12:24 Tower kernel: item 63 key (727266258944 168 4096) itemoff 12891 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58789 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267531776 count 1 Mar 1 04:12:24 Tower kernel: item 64 key (727266263040 168 4096) itemoff 12838 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 33520 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492525056 count 1 Mar 1 04:12:24 Tower kernel: item 65 key (727266267136 168 4096) itemoff 12785 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62365 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57325998080 count 1 Mar 1 04:12:24 Tower kernel: item 66 key (727266271232 168 4096) itemoff 12732 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 60954 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54885138432 count 1 Mar 1 04:12:24 Tower kernel: item 67 key (727266275328 168 4096) itemoff 12679 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61466 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492926464 count 1 Mar 1 04:12:24 Tower kernel: item 68 key (727266283520 168 4096) itemoff 12626 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62303 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492082688 count 1 Mar 1 04:12:24 Tower kernel: item 69 key (727266287616 168 4096) itemoff 12573 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61797 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57269379072 count 1 Mar 1 04:12:24 Tower kernel: item 70 key (727266291712 168 4096) itemoff 12520 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62252 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492029440 count 1 Mar 1 04:12:24 Tower kernel: item 71 key (727266295808 168 4096) itemoff 12467 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58639 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267372032 count 1 Mar 1 04:12:24 Tower kernel: item 72 key (727266299904 168 4096) itemoff 12414 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 51539 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491136512 count 1 Mar 1 04:12:24 Tower kernel: item 73 key (727266304000 168 4096) itemoff 12361 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62365 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57326018560 count 1 Mar 1 04:12:24 Tower kernel: item 74 key (727266308096 168 4096) itemoff 12308 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54555 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334566912 count 1 Mar 1 04:12:24 Tower kernel: item 75 key (727266312192 168 4096) itemoff 12255 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 57642 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54890422272 count 1 Mar 1 04:12:24 Tower kernel: item 76 key (727266316288 168 4096) itemoff 12202 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61023 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 40057987072 count 1 Mar 1 04:12:24 Tower kernel: item 77 key (727266320384 168 4096) itemoff 12149 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58831 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57268105216 count 1 Mar 1 04:12:24 Tower kernel: item 78 key (727266324480 168 4096) itemoff 12096 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58048 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490735104 count 1 Mar 1 04:12:24 Tower kernel: item 79 key (727266328576 168 4096) itemoff 12043 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58725 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267470336 count 1 Mar 1 04:12:24 Tower kernel: item 80 key (727266332672 168 4096) itemoff 11990 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61557 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57268281344 count 1 Mar 1 04:12:24 Tower kernel: item 81 key (727266336768 168 4096) itemoff 11937 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61944 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 67351486464 count 1 Mar 1 04:12:24 Tower kernel: item 82 key (727266340864 168 12288) itemoff 11884 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 62365 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57325309952 count 1 Mar 1 04:12:24 Tower kernel: item 83 key (727266353152 168 4096) itemoff 11831 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49022 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 60330246144 count 1 Mar 1 04:12:24 Tower kernel: item 84 key (727266357248 168 4096) itemoff 11778 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54630 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335332864 count 1 Mar 1 04:12:24 Tower kernel: item 85 key (727266361344 168 4096) itemoff 11725 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49010 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490546688 count 1 Mar 1 04:12:24 Tower kernel: item 86 key (727266365440 168 4096) itemoff 11672 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 52279 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491214336 count 1 Mar 1 04:12:24 Tower kernel: item 87 key (727266369536 168 4096) itemoff 11619 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61453 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491447808 count 1 Mar 1 04:12:24 Tower kernel: item 88 key (727266373632 168 4096) itemoff 11566 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54851 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57336729600 count 1 Mar 1 04:12:24 Tower kernel: item 89 key (727266377728 168 4096) itemoff 11513 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54502 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54885167104 count 1 Mar 1 04:12:24 Tower kernel: item 90 key (727266381824 168 4096) itemoff 11460 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54702 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335214080 count 1 Mar 1 04:12:24 Tower kernel: item 91 key (727266385920 168 4096) itemoff 11407 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61947 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 67351605248 count 1 Mar 1 04:12:24 Tower kernel: item 92 key (727266390016 168 4096) itemoff 11354 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49106 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490550784 count 1 Mar 1 04:12:24 Tower kernel: item 93 key (727266394112 168 4096) itemoff 11301 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54560 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334681600 count 1 Mar 1 04:12:24 Tower kernel: item 94 key (727266398208 168 4096) itemoff 11248 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 59282 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267986432 count 1 Mar 1 04:12:24 Tower kernel: item 95 key (727266402304 168 4096) itemoff 11195 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61634 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 68920688640 count 1 Mar 1 04:12:24 Tower kernel: item 96 key (727266406400 168 4096) itemoff 11142 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 59711 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57326288896 count 1 Mar 1 04:12:24 Tower kernel: item 97 key (727266410496 168 4096) itemoff 11089 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 48972 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491152896 count 1 Mar 1 04:12:24 Tower kernel: item 98 key (727266414592 168 4096) itemoff 11036 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 45233 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491050496 count 1 Mar 1 04:12:24 Tower kernel: item 99 key (727266418688 168 4096) itemoff 10983 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49099 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491873792 count 1 Mar 1 04:12:24 Tower kernel: item 100 key (727266422784 168 4096) itemoff 10930 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49381 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492361216 count 1 Mar 1 04:12:24 Tower kernel: item 101 key (727266426880 168 4096) itemoff 10877 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49560 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491165184 count 1 Mar 1 04:12:24 Tower kernel: item 102 key (727266430976 168 4096) itemoff 10824 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54695 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335091200 count 1 Mar 1 04:12:24 Tower kernel: item 103 key (727266435072 168 4096) itemoff 10771 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49200 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492357120 count 1 Mar 1 04:12:24 Tower kernel: item 104 key (727266439168 168 4096) itemoff 10718 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61768 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492586496 count 1 Mar 1 04:12:24 Tower kernel: item 105 key (727266443264 168 4096) itemoff 10665 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 56839 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54887878656 count 1 Mar 1 04:12:24 Tower kernel: item 106 key (727266447360 168 4096) itemoff 10612 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49109 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491156992 count 1 Mar 1 04:12:24 Tower kernel: item 107 key (727266451456 168 4096) itemoff 10559 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 56085 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491333120 count 1 Mar 1 04:12:24 Tower kernel: item 108 key (727266455552 168 4096) itemoff 10506 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54599 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334431744 count 1 Mar 1 04:12:24 Tower kernel: item 109 key (727266459648 168 4096) itemoff 10453 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 59106 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 56798818304 count 1 Mar 1 04:12:24 Tower kernel: item 110 key (727266463744 168 4096) itemoff 10400 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 56840 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54885089280 count 1 Mar 1 04:12:24 Tower kernel: item 111 key (727266467840 168 4096) itemoff 10347 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54603 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334435840 count 1 Mar 1 04:12:24 Tower kernel: item 112 key (727266471936 168 4096) itemoff 10294 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58766 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267560448 count 1 Mar 1 04:12:24 Tower kernel: item 113 key (727266476032 168 4096) itemoff 10241 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 45944 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492312064 count 1 Mar 1 04:12:24 Tower kernel: item 114 key (727266480128 168 4096) itemoff 10188 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54612 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334517760 count 1 Mar 1 04:12:24 Tower kernel: item 115 key (727266484224 168 4096) itemoff 10135 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 57108 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491357696 count 1 Mar 1 04:12:24 Tower kernel: item 116 key (727266488320 168 4096) itemoff 10082 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61732 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492934656 count 1 Mar 1 04:12:24 Tower kernel: item 117 key (727266492416 168 4096) itemoff 10029 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54622 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334685696 count 1 Mar 1 04:12:24 Tower kernel: item 118 key (727266496512 168 4096) itemoff 9976 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54603 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334501376 count 1 Mar 1 04:12:24 Tower kernel: item 119 key (727266500608 168 4096) itemoff 9923 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54601 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334448128 count 1 Mar 1 04:12:24 Tower kernel: item 120 key (727266508800 168 4096) itemoff 9870 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 61834 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490796544 count 1 Mar 1 04:12:24 Tower kernel: item 121 key (727266512896 168 4096) itemoff 9817 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49850 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 54890459136 count 1 Mar 1 04:12:24 Tower kernel: item 122 key (727266516992 168 4096) itemoff 9764 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49971 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491181568 count 1 Mar 1 04:12:24 Tower kernel: item 123 key (727266521088 168 4096) itemoff 9711 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54601 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334493184 count 1 Mar 1 04:12:24 Tower kernel: item 124 key (727266525184 168 4096) itemoff 9658 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54688 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334792192 count 1 Mar 1 04:12:24 Tower kernel: item 125 key (727266529280 168 4096) itemoff 9605 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49646 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492365312 count 1 Mar 1 04:12:24 Tower kernel: item 126 key (727266533376 168 4096) itemoff 9552 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54622 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334927360 count 1 Mar 1 04:12:24 Tower kernel: item 127 key (727266537472 168 4096) itemoff 9499 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49913 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492758528 count 1 Mar 1 04:12:24 Tower kernel: item 128 key (727266541568 168 4096) itemoff 9446 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49686 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491173376 count 1 Mar 1 04:12:24 Tower kernel: item 129 key (727266545664 168 4096) itemoff 9393 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54601 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334513664 count 1 Mar 1 04:12:24 Tower kernel: item 130 key (727266549760 168 4096) itemoff 9340 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 55272 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57490608128 count 1 Mar 1 04:12:24 Tower kernel: item 131 key (727266557952 168 4096) itemoff 9287 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54667 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335025664 count 1 Mar 1 04:12:24 Tower kernel: item 132 key (727266562048 168 4096) itemoff 9234 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54612 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334640640 count 1 Mar 1 04:12:24 Tower kernel: item 133 key (727266566144 168 4096) itemoff 9181 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54687 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57335205888 count 1 Mar 1 04:12:24 Tower kernel: item 134 key (727266570240 168 4096) itemoff 9128 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54613 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334489088 count 1 Mar 1 04:12:24 Tower kernel: item 135 key (727266574336 168 4096) itemoff 9075 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 52851 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491230720 count 1 Mar 1 04:12:24 Tower kernel: item 136 key (727266578432 168 4096) itemoff 9022 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54602 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334468608 count 1 Mar 1 04:12:24 Tower kernel: item 137 key (727266582528 168 4096) itemoff 8969 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 51770 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57492811776 count 1 Mar 1 04:12:24 Tower kernel: item 138 key (727266586624 168 4096) itemoff 8916 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 55790 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491320832 count 1 Mar 1 04:12:24 Tower kernel: item 139 key (727266590720 168 4096) itemoff 8863 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54602 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334538240 count 1 Mar 1 04:12:24 Tower kernel: item 140 key (727266594816 168 4096) itemoff 8810 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 49674 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57491894272 count 1 Mar 1 04:12:24 Tower kernel: item 141 key (727266598912 168 8192) itemoff 8757 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54599 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334448128 count 1 Mar 1 04:12:24 Tower kernel: item 142 key (727266607104 168 4096) itemoff 8704 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54602 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334546432 count 1 Mar 1 04:12:24 Tower kernel: item 143 key (727266611200 168 4096) itemoff 8651 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58506 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267310592 count 1 Mar 1 04:12:24 Tower kernel: item 144 key (727266615296 168 4096) itemoff 8598 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 58937 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57267703808 count 1 Mar 1 04:12:24 Tower kernel: item 145 key (727266619392 168 8192) itemoff 8545 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54601 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334460416 count 1 Mar 1 04:12:24 Tower kernel: item 146 key (727266627584 168 8192) itemoff 8492 itemsize 53 Mar 1 04:12:24 Tower kernel: extent refs 1 gen 54601 flags 1 Mar 1 04:12:24 Tower kernel: ref#0: extent data backref root 5 objectid 1059284 offset 57334472704 count 1 Mar 1 04:12:24 Tower kernel: BTRFS error (device dm-7): unable to find ref byte nr 727264886784 parent 0 root 5 owner 1059284 offset 57325158400 Mar 1 04:12:24 Tower kernel: ------------[ cut here ]------------ Mar 1 04:12:24 Tower kernel: BTRFS: Transaction aborted (error -2) Mar 1 04:12:24 Tower kernel: WARNING: CPU: 3 PID: 1388 at fs/btrfs/extent-tree.c:3079 __btrfs_free_extent+0x468/0xaae Mar 1 04:12:24 Tower kernel: Modules linked in: tcp_diag udp_diag inet_diag vhci_hcd usbip_host usbip_core xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb tap veth macvlan xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs dm_crypt dm_mod dax nfsd auth_rpcgss oid_registry lockd grace sunrpc md_mod ipmi_devintf efivarfs wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha ip6table_filter ip6_tables iptable_filter ip_tables x_tables bridge 8021q garp mrp stp llc igb mlx4_en mlx4_core e1000e i915 ipmi_ssif iosf_mbi drm_buddy ast drm_display_helper drm_vram_helper drm_ttm_helper ttm drm_kms_helper drm x86_pkg_temp_thermal intel_powerclamp intel_gtt i2c_i801 coretemp input_leds wmi_bmof kvm_intel kvm crct10dif_pclmul crc32_pclmul Mar 1 04:12:24 Tower kernel: crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd rapl intel_cstate intel_uncore nvme agpgart i2c_algo_bit i2c_smbus nvme_core led_class joydev i2c_core ahci acpi_ipmi syscopyarea libahci video sysfillrect intel_pch_thermal sysimgblt sata_mv fb_sys_fops thermal wmi fan ipmi_si backlight acpi_pad acpi_tad button unix [last unloaded: igb] Mar 1 04:12:24 Tower kernel: CPU: 3 PID: 1388 Comm: kworker/u24:3 Tainted: G W 5.19.17-Unraid #2 Mar 1 04:12:24 Tower kernel: Hardware name: Supermicro Super Server/X11SCA-F, BIOS 1.0b 02/13/2019 Mar 1 04:12:24 Tower kernel: Workqueue: events_unbound btrfs_preempt_reclaim_metadata_space Mar 1 04:12:24 Tower kernel: RIP: 0010:__btrfs_free_extent+0x468/0xaae Mar 1 04:12:24 Tower kernel: Code: 48 8b 43 50 48 8d 90 58 0a 00 00 f0 48 0f ba 2a 03 0f 92 c2 5e 84 d2 75 13 be fe ff ff ff 48 c7 c7 dc 1b 0f 82 e8 17 c2 51 00 <0f> 0b b9 fe ff ff ff ba 07 0c 00 00 48 c7 c6 20 08 e4 81 48 89 df Mar 1 04:12:24 Tower kernel: RSP: 0018:ffffc90003f4fbe0 EFLAGS: 00010282 Mar 1 04:12:24 Tower kernel: RAX: 0000000000000000 RBX: ffff8888d84c7bc8 RCX: 0000000000000003 Mar 1 04:12:24 Tower kernel: RDX: 0000000000000001 RSI: 0000000000000003 RDI: 00000000ffffffff Mar 1 04:12:24 Tower kernel: RBP: ffff8881cb0940e0 R08: 0000000000000000 R09: ffffffff82244bd0 Mar 1 04:12:24 Tower kernel: R10: 0000000000000006 R11: ffffffff8287cfd6 R12: 00000000001029d4 Mar 1 04:12:24 Tower kernel: R13: 0000000d58d88000 R14: 00000000fffffffe R15: 0000000000000361 Mar 1 04:12:24 Tower kernel: FS: 0000000000000000(0000) GS:ffff88902bac0000(0000) knlGS:0000000000000000 Mar 1 04:12:24 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Mar 1 04:12:24 Tower kernel: CR2: 0000008ac048525a CR3: 0000000195b3c003 CR4: 00000000003726e0 Mar 1 04:12:24 Tower kernel: Call Trace: Mar 1 04:12:24 Tower kernel: <TASK> Mar 1 04:12:24 Tower kernel: ? __btrfs_run_delayed_refs+0xaad/0xb5e Mar 1 04:12:24 Tower kernel: __btrfs_run_delayed_refs+0x66a/0xb5e Mar 1 04:12:24 Tower kernel: ? preempt_latency_start+0x2b/0x46 Mar 1 04:12:24 Tower kernel: btrfs_run_delayed_refs+0x5b/0x12c Mar 1 04:12:24 Tower kernel: flush_space+0x37e/0x491 Mar 1 04:12:24 Tower kernel: ? update_load_avg+0x44/0x38b Mar 1 04:12:24 Tower kernel: ? _raw_spin_lock+0x13/0x1c Mar 1 04:12:24 Tower kernel: ? _raw_spin_unlock+0x14/0x29 Mar 1 04:12:24 Tower kernel: ? btrfs_bg_type_to_factor+0xa/0x1c Mar 1 04:12:24 Tower kernel: ? calc_available_free_space.isra.0+0x33/0x59 Mar 1 04:12:24 Tower kernel: btrfs_preempt_reclaim_metadata_space+0xe8/0x172 Mar 1 04:12:24 Tower kernel: process_one_work+0x1a8/0x295 Mar 1 04:12:24 Tower kernel: worker_thread+0x18b/0x244 Mar 1 04:12:24 Tower kernel: ? rescuer_thread+0x281/0x281 Mar 1 04:12:24 Tower kernel: kthread+0xe4/0xef Mar 1 04:12:24 Tower kernel: ? kthread_complete_and_exit+0x1b/0x1b Mar 1 04:12:24 Tower kernel: ret_from_fork+0x1f/0x30 Mar 1 04:12:24 Tower kernel: </TASK> Mar 1 04:12:24 Tower kernel: ---[ end trace 0000000000000000 ]--- Mar 1 04:12:24 Tower kernel: BTRFS: error (device dm-7: state A) in __btrfs_free_extent:3079: errno=-2 No such entry Mar 1 04:12:24 Tower kernel: BTRFS info (device dm-7: state EA): forced readonly Mar 1 04:12:24 Tower kernel: BTRFS: error (device dm-7: state EA) in btrfs_run_delayed_refs:2157: errno=-2 No such entry Mar 1 04:14:44 Tower kernel: BTRFS warning (device dm-7: state EA): checksum verify failed on 1416708096 wanted 0x69be4882 found 0x089d4e5d level 0 Mar 1 04:14:44 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1416708096 wanted 62366 found 62220 ### [PREVIOUS LINE REPEATED 4 TIMES] ### Mar 1 04:14:50 Tower kernel: I/O error, dev loop2, sector 4576848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0 Mar 1 04:14:50 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 1, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:14:59 Tower CA Backup/Restore: tar creation/extraction failed! Mar 1 04:15:03 Tower CA Backup/Restore: Backup Complete Mar 1 04:15:03 Tower CA Backup/Restore: done Mar 1 04:15:03 Tower CA Backup/Restore: Starting Duplicacy... (try #1) Mar 1 04:15:03 Tower kernel: docker0: port 1(vethf5ee084) entered blocking state Mar 1 04:15:03 Tower kernel: docker0: port 1(vethf5ee084) entered disabled state Mar 1 04:15:03 Tower kernel: device vethf5ee084 entered promiscuous mode Mar 1 04:15:03 Tower kernel: docker0: port 1(vethf5ee084) entered blocking state Mar 1 04:15:03 Tower kernel: docker0: port 1(vethf5ee084) entered forwarding state Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 23406688 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 2, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 23406664 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 3, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 9822048 op 0x1:(WRITE) flags 0x800 phys_seg 2 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 4, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: docker0: port 1(vethf5ee084) entered disabled state ### [PREVIOUS LINE REPEATED 1 TIMES] ### Mar 1 04:15:03 Tower kernel: device vethf5ee084 left promiscuous mode Mar 1 04:15:03 Tower kernel: docker0: port 1(vethf5ee084) entered disabled state Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 2864128 op 0x1:(WRITE) flags 0x1800 phys_seg 4 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 5, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 766976 op 0x1:(WRITE) flags 0x1800 phys_seg 4 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 6, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 2864192 op 0x1:(WRITE) flags 0x1800 phys_seg 4 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 7, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 767040 op 0x1:(WRITE) flags 0x1800 phys_seg 4 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 8, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 767136 op 0x1:(WRITE) flags 0x1800 phys_seg 54 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 9, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 2864000 op 0x1:(WRITE) flags 0x1800 phys_seg 16 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 10, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: I/O error, dev loop2, sector 766848 op 0x1:(WRITE) flags 0x1800 phys_seg 16 prio class 0 Mar 1 04:15:03 Tower kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 11, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:03 Tower kernel: BTRFS: error (device loop2) in btrfs_commit_transaction:2418: errno=-5 IO failure (Error while writing out transaction) Mar 1 04:15:03 Tower kernel: BTRFS info (device loop2: state E): forced readonly Mar 1 04:15:03 Tower kernel: BTRFS warning (device loop2: state E): Skipping commit of aborted transaction. Mar 1 04:15:03 Tower kernel: BTRFS: error (device loop2: state EA) in cleanup_transaction:1982: errno=-5 IO failure Mar 1 04:15:03 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:08 Tower CA Backup/Restore: Starting Duplicacy... (try #2) Mar 1 04:15:08 Tower kernel: docker0: port 1(vethe00d96c) entered blocking state Mar 1 04:15:08 Tower kernel: docker0: port 1(vethe00d96c) entered disabled state Mar 1 04:15:08 Tower kernel: device vethe00d96c entered promiscuous mode Mar 1 04:15:08 Tower kernel: docker0: port 1(vethe00d96c) entered blocking state Mar 1 04:15:08 Tower kernel: docker0: port 1(vethe00d96c) entered forwarding state Mar 1 04:15:08 Tower kernel: docker0: port 1(vethe00d96c) entered disabled state Mar 1 04:15:08 Tower kernel: device vethe00d96c left promiscuous mode Mar 1 04:15:08 Tower kernel: docker0: port 1(vethe00d96c) entered disabled state Mar 1 04:15:08 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:10 Tower kernel: blk_print_req_error: 6 callbacks suppressed Mar 1 04:15:10 Tower kernel: I/O error, dev loop2, sector 4576848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0 Mar 1 04:15:10 Tower kernel: btrfs_dev_stat_print_on_error: 6 callbacks suppressed Mar 1 04:15:10 Tower kernel: BTRFS error (device loop2: state EA): bdev /dev/loop2 errs: wr 18, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:15:13 Tower CA Backup/Restore: Starting Duplicacy... (try #3) Mar 1 04:15:13 Tower kernel: docker0: port 1(veth096ccbb) entered blocking state Mar 1 04:15:13 Tower kernel: docker0: port 1(veth096ccbb) entered disabled state Mar 1 04:15:13 Tower kernel: device veth096ccbb entered promiscuous mode Mar 1 04:15:13 Tower kernel: docker0: port 1(veth096ccbb) entered blocking state Mar 1 04:15:13 Tower kernel: docker0: port 1(veth096ccbb) entered forwarding state Mar 1 04:15:13 Tower kernel: docker0: port 1(veth096ccbb) entered disabled state Mar 1 04:15:13 Tower kernel: device veth096ccbb left promiscuous mode Mar 1 04:15:13 Tower kernel: docker0: port 1(veth096ccbb) entered disabled state Mar 1 04:15:13 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:13 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:15:15 Tower CA Backup/Restore: Starting EmbyServer... (try #1) Mar 1 04:15:15 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:20 Tower CA Backup/Restore: Starting EmbyServer... (try #2) Mar 1 04:15:20 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:25 Tower CA Backup/Restore: Starting EmbyServer... (try #3) Mar 1 04:15:25 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:25 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:15:27 Tower CA Backup/Restore: Starting ESPHome... (try #1) Mar 1 04:15:27 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:32 Tower CA Backup/Restore: Starting ESPHome... (try #2) Mar 1 04:15:32 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:37 Tower CA Backup/Restore: Starting ESPHome... (try #3) Mar 1 04:15:37 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:37 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:15:39 Tower CA Backup/Restore: Starting freshrss... (try #1) Mar 1 04:15:39 Tower kernel: docker0: port 1(vethae1f0fc) entered blocking state Mar 1 04:15:39 Tower kernel: docker0: port 1(vethae1f0fc) entered disabled state Mar 1 04:15:39 Tower kernel: device vethae1f0fc entered promiscuous mode Mar 1 04:15:39 Tower kernel: docker0: port 1(vethae1f0fc) entered disabled state Mar 1 04:15:39 Tower kernel: device vethae1f0fc left promiscuous mode Mar 1 04:15:39 Tower kernel: docker0: port 1(vethae1f0fc) entered disabled state Mar 1 04:15:39 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:44 Tower CA Backup/Restore: Starting freshrss... (try #2) Mar 1 04:15:44 Tower kernel: docker0: port 1(vethc12621c) entered blocking state Mar 1 04:15:44 Tower kernel: docker0: port 1(vethc12621c) entered disabled state Mar 1 04:15:44 Tower kernel: device vethc12621c entered promiscuous mode Mar 1 04:15:44 Tower kernel: docker0: port 1(vethc12621c) entered blocking state Mar 1 04:15:44 Tower kernel: docker0: port 1(vethc12621c) entered forwarding state Mar 1 04:15:44 Tower kernel: docker0: port 1(vethc12621c) entered disabled state Mar 1 04:15:44 Tower kernel: device vethc12621c left promiscuous mode Mar 1 04:15:44 Tower kernel: docker0: port 1(vethc12621c) entered disabled state Mar 1 04:15:44 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:49 Tower CA Backup/Restore: Starting freshrss... (try #3) Mar 1 04:15:49 Tower kernel: docker0: port 1(veth677283e) entered blocking state Mar 1 04:15:49 Tower kernel: docker0: port 1(veth677283e) entered disabled state Mar 1 04:15:49 Tower kernel: device veth677283e entered promiscuous mode Mar 1 04:15:49 Tower kernel: docker0: port 1(veth677283e) entered blocking state Mar 1 04:15:49 Tower kernel: docker0: port 1(veth677283e) entered forwarding state Mar 1 04:15:49 Tower kernel: docker0: port 1(veth677283e) entered disabled state Mar 1 04:15:49 Tower kernel: device veth677283e left promiscuous mode Mar 1 04:15:49 Tower kernel: docker0: port 1(veth677283e) entered disabled state Mar 1 04:15:49 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:49 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:15:51 Tower CA Backup/Restore: Starting LogitechMediaServer... (try #1) Mar 1 04:15:51 Tower kernel: docker0: port 1(veth4eea231) entered blocking state Mar 1 04:15:51 Tower kernel: docker0: port 1(veth4eea231) entered disabled state Mar 1 04:15:51 Tower kernel: device veth4eea231 entered promiscuous mode Mar 1 04:15:51 Tower kernel: docker0: port 1(veth4eea231) entered blocking state Mar 1 04:15:51 Tower kernel: docker0: port 1(veth4eea231) entered forwarding state Mar 1 04:15:51 Tower kernel: docker0: port 1(veth4eea231) entered disabled state Mar 1 04:15:51 Tower kernel: device veth4eea231 left promiscuous mode Mar 1 04:15:51 Tower kernel: docker0: port 1(veth4eea231) entered disabled state Mar 1 04:15:51 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:15:56 Tower CA Backup/Restore: Starting LogitechMediaServer... (try #2) Mar 1 04:15:56 Tower kernel: docker0: port 1(vetha8521e2) entered blocking state Mar 1 04:15:56 Tower kernel: docker0: port 1(vetha8521e2) entered disabled state Mar 1 04:15:56 Tower kernel: device vetha8521e2 entered promiscuous mode Mar 1 04:15:56 Tower kernel: docker0: port 1(vetha8521e2) entered blocking state Mar 1 04:15:56 Tower kernel: docker0: port 1(vetha8521e2) entered forwarding state Mar 1 04:15:56 Tower kernel: docker0: port 1(vetha8521e2) entered disabled state Mar 1 04:15:56 Tower kernel: device vetha8521e2 left promiscuous mode Mar 1 04:15:56 Tower kernel: docker0: port 1(vetha8521e2) entered disabled state Mar 1 04:15:56 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:01 Tower CA Backup/Restore: Starting LogitechMediaServer... (try #3) Mar 1 04:16:01 Tower kernel: docker0: port 1(veth4acde4f) entered blocking state Mar 1 04:16:01 Tower kernel: docker0: port 1(veth4acde4f) entered disabled state Mar 1 04:16:01 Tower kernel: device veth4acde4f entered promiscuous mode Mar 1 04:16:01 Tower kernel: docker0: port 1(veth4acde4f) entered blocking state Mar 1 04:16:01 Tower kernel: docker0: port 1(veth4acde4f) entered forwarding state Mar 1 04:16:01 Tower kernel: docker0: port 1(veth4acde4f) entered disabled state Mar 1 04:16:01 Tower kernel: device veth4acde4f left promiscuous mode Mar 1 04:16:01 Tower kernel: docker0: port 1(veth4acde4f) entered disabled state Mar 1 04:16:01 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:01 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:16:03 Tower CA Backup/Restore: Starting mariadb... (try #1) Mar 1 04:16:03 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:08 Tower CA Backup/Restore: Starting mariadb... (try #2) Mar 1 04:16:09 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:14 Tower CA Backup/Restore: Starting mariadb... (try #3) Mar 1 04:16:14 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:14 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:16:16 Tower CA Backup/Restore: Starting Mealie... (try #1) Mar 1 04:16:16 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:21 Tower CA Backup/Restore: Starting Mealie... (try #2) Mar 1 04:16:21 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:26 Tower CA Backup/Restore: Starting Mealie... (try #3) Mar 1 04:16:26 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:26 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:16:28 Tower CA Backup/Restore: Starting mosquitto... (try #1) Mar 1 04:16:28 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:33 Tower CA Backup/Restore: Starting mosquitto... (try #2) Mar 1 04:16:33 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:38 Tower CA Backup/Restore: Starting mosquitto... (try #3) Mar 1 04:16:38 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:38 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:16:40 Tower CA Backup/Restore: Starting NextCloud... (try #1) Mar 1 04:16:40 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:45 Tower CA Backup/Restore: Starting NextCloud... (try #2) Mar 1 04:16:45 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:50 Tower CA Backup/Restore: Starting NextCloud... (try #3) Mar 1 04:16:50 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:50 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:16:52 Tower CA Backup/Restore: Starting NodeRed-PROD... (try #1) Mar 1 04:16:52 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:16:57 Tower CA Backup/Restore: Starting NodeRed-PROD... (try #2) Mar 1 04:16:57 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:02 Tower CA Backup/Restore: Starting NodeRed-PROD... (try #3) Mar 1 04:17:02 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:02 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:17:04 Tower CA Backup/Restore: Starting NodeRed-TEST... (try #1) Mar 1 04:17:04 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:09 Tower CA Backup/Restore: Starting NodeRed-TEST... (try #2) Mar 1 04:17:09 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:14 Tower CA Backup/Restore: Starting NodeRed-TEST... (try #3) Mar 1 04:17:14 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:14 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:17:16 Tower CA Backup/Restore: Starting paperless-ngx... (try #1) Mar 1 04:17:16 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:21 Tower CA Backup/Restore: Starting paperless-ngx... (try #2) Mar 1 04:17:21 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:26 Tower CA Backup/Restore: Starting paperless-ngx... (try #3) Mar 1 04:17:26 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:26 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:17:28 Tower CA Backup/Restore: Starting pihole-template... (try #1) Mar 1 04:17:28 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:33 Tower CA Backup/Restore: Starting pihole-template... (try #2) Mar 1 04:17:33 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:38 Tower CA Backup/Restore: Starting pihole-template... (try #3) Mar 1 04:17:38 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:38 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:17:40 Tower CA Backup/Restore: Starting PlexMediaServer... (try #1) Mar 1 04:17:40 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:45 Tower CA Backup/Restore: Starting PlexMediaServer... (try #2) Mar 1 04:17:45 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:50 Tower CA Backup/Restore: Starting PlexMediaServer... (try #3) Mar 1 04:17:50 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:50 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:17:52 Tower CA Backup/Restore: Starting Redis... (try #1) Mar 1 04:17:52 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:17:57 Tower CA Backup/Restore: Starting Redis... (try #2) Mar 1 04:17:57 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:18:02 Tower CA Backup/Restore: Starting Redis... (try #3) Mar 1 04:18:02 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:18:02 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:18:04 Tower CA Backup/Restore: Starting MinecraftBedrockEdition... (try #1) Mar 1 04:18:04 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:18:09 Tower CA Backup/Restore: Starting MinecraftBedrockEdition... (try #2) Mar 1 04:18:09 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:18:14 Tower CA Backup/Restore: Starting MinecraftBedrockEdition... (try #3) Mar 1 04:18:14 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:18:14 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:18:16 Tower CA Backup/Restore: Starting Pterodactyl-Deamons... (try #1) Mar 1 04:18:16 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:18:21 Tower CA Backup/Restore: Starting Pterodactyl-Deamons... (try #2) Mar 1 04:18:21 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:18:26 Tower CA Backup/Restore: Starting Pterodactyl-Deamons... (try #3) Mar 1 04:18:26 Tower CA Backup/Restore: Error while starting container! - Code: Server error Mar 1 04:18:26 Tower CA Backup/Restore: Container did not started after multiple tries, skipping. Mar 1 04:18:28 Tower CA Backup/Restore: ####################### Mar 1 04:18:28 Tower CA Backup/Restore: appData Backup complete Mar 1 04:18:28 Tower CA Backup/Restore: ####################### Mar 1 04:18:29 Tower CA Backup/Restore: A error occurred somewhere. Not deleting old backup sets of appdata Mar 1 04:18:29 Tower CA Backup/Restore: Backup / Restore Completed Mar 1 04:20:12 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1680228352 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:20:22 Tower kernel: I/O error, dev loop3, sector 27024 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0 Mar 1 04:20:22 Tower kernel: BTRFS error (device loop3): bdev /dev/loop3 errs: wr 1, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:20:22 Tower kernel: I/O error, dev loop3, sector 27040 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0 Mar 1 04:20:22 Tower kernel: BTRFS error (device loop3): bdev /dev/loop3 errs: wr 2, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:20:28 Tower kernel: I/O error, dev loop3, sector 27024 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0 Mar 1 04:20:28 Tower kernel: BTRFS error (device loop3): bdev /dev/loop3 errs: wr 3, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:20:28 Tower kernel: I/O error, dev loop3, sector 27040 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0 Mar 1 04:20:28 Tower kernel: I/O error, dev loop3, sector 27376 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0 Mar 1 04:20:28 Tower kernel: BTRFS error (device loop3): bdev /dev/loop3 errs: wr 4, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:20:28 Tower kernel: BTRFS error (device loop3): bdev /dev/loop3 errs: wr 5, rd 0, flush 0, corrupt 0, gen 0 Mar 1 04:39:29 Tower kernel: BTRFS warning (device dm-7: state EA): checksum verify failed on 1752956928 wanted 0xd959aa4e found 0xdfb206c5 level 0 Mar 1 04:39:29 Tower kernel: verify_parent_transid: 2 callbacks suppressed Mar 1 04:39:29 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1752956928 wanted 62366 found 62344 ### [PREVIOUS LINE REPEATED 4 TIMES] ### Mar 1 04:39:29 Tower kernel: BTRFS warning (device dm-7: state EA): checksum verify failed on 1509163008 wanted 0x7349e05a found 0x4528fc85 level 0 Mar 1 04:39:29 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 4 TIMES] ### Mar 1 04:40:01 Tower root: Fix Common Problems Version 2023.02.17 Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Plugin unassigned.devices.preclear.plg is not up to date Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application adminer has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application bookstack has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application CrashPlanPRO has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application Duplicacy has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application EmbyServer has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application ESPHome has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application freshrss has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application grocy has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application LogitechMediaServer has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application MakeMKV has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application mariadb has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application mosquitto has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application NextCloud has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application phpmyadmin has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application pihole-template has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application PlexMediaServer has an update available for it Mar 1 04:40:02 Tower root: Fix Common Problems: Warning: Docker Application Redis has an update available for it Mar 1 04:40:04 Tower root: Fix Common Problems: Error: Unable to write to data-nvme Mar 1 04:40:04 Tower root: Fix Common Problems: Error: Unable to write to Docker Image Mar 1 04:40:10 Tower root: Fix Common Problems: Warning: The plugin usb_manager_usbip_addon.plg is not known to Community Applications and is possibly incompatible with your server Mar 1 04:40:10 Tower root: Fix Common Problems: Warning: Share appdata set to use pool data-nvme, but files / folders exist on the cache-ssd pool Mar 1 04:40:10 Tower root: Fix Common Problems: Warning: Docker Update Patch not installed Mar 1 04:40:13 Tower kernel: verify_parent_transid: 54 callbacks suppressed Mar 1 04:40:13 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1542438912 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:40:19 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:40:19 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:40:24 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:40:24 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:40:29 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:40:29 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:40:57 Tower kernel: verify_parent_transid: 2 callbacks suppressed Mar 1 04:40:57 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:41:02 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:41:02 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:41:08 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:41:08 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:42:15 Tower kernel: verify_parent_transid: 8 callbacks suppressed Mar 1 04:42:15 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1598783488 wanted 62366 found 62243 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:42:20 Tower kernel: verify_parent_transid: 4 callbacks suppressed Mar 1 04:42:20 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1598783488 wanted 62366 found 62243 ### [PREVIOUS LINE REPEATED 27 TIMES] ### Mar 1 04:44:47 Tower kernel: verify_parent_transid: 2 callbacks suppressed Mar 1 04:44:47 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:44:52 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:44:52 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1723727872 wanted 62366 found 62344 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:44:57 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:44:57 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1542438912 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:02 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:45:02 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:07 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:45:07 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:12 Tower kernel: verify_parent_transid: 32 callbacks suppressed Mar 1 04:45:12 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:17 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:45:17 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:23 Tower kernel: verify_parent_transid: 14 callbacks suppressed Mar 1 04:45:23 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1598783488 wanted 62366 found 62243 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:28 Tower kernel: verify_parent_transid: 2 callbacks suppressed Mar 1 04:45:28 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1598783488 wanted 62366 found 62243 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:33 Tower kernel: verify_parent_transid: 4 callbacks suppressed Mar 1 04:45:33 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1598783488 wanted 62366 found 62243 ### [PREVIOUS LINE REPEATED 7 TIMES] ### Mar 1 04:45:37 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 1 TIMES] ### Mar 1 04:45:38 Tower kernel: verify_parent_transid: 4 callbacks suppressed Mar 1 04:45:38 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:43 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:45:43 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1723727872 wanted 62366 found 62344 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:48 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:45:48 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:45:53 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:45:53 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 5 TIMES] ### Mar 1 04:45:53 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 3 TIMES] ### Mar 1 04:45:58 Tower kernel: verify_parent_transid: 32 callbacks suppressed Mar 1 04:45:58 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:48:03 Tower kernel: verify_parent_transid: 14 callbacks suppressed Mar 1 04:48:03 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:48:08 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:48:08 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1723727872 wanted 62366 found 62344 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:48:14 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:48:14 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1542438912 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:48:19 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:48:19 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:48:24 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:48:24 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:48:29 Tower kernel: verify_parent_transid: 32 callbacks suppressed Mar 1 04:48:29 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:48:34 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:48:34 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1548140544 wanted 62366 found 62187 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:49:34 Tower kernel: verify_parent_transid: 8 callbacks suppressed Mar 1 04:49:34 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1598783488 wanted 62366 found 62243 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:49:39 Tower kernel: verify_parent_transid: 2 callbacks suppressed Mar 1 04:49:39 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1598783488 wanted 62366 found 62243 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:49:44 Tower kernel: verify_parent_transid: 2 callbacks suppressed Mar 1 04:49:44 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1598783488 wanted 62366 found 62243 ### [PREVIOUS LINE REPEATED 5 TIMES] ### Mar 1 04:49:48 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 3 TIMES] ### Mar 1 04:49:50 Tower kernel: verify_parent_transid: 8 callbacks suppressed Mar 1 04:49:50 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:49:55 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:49:55 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1723727872 wanted 62366 found 62344 ### [PREVIOUS LINE REPEATED 9 TIMES] ### Mar 1 04:50:00 Tower kernel: verify_parent_transid: 26 callbacks suppressed Mar 1 04:50:00 Tower kernel: BTRFS error (device dm-7: state EA): parent transid verify failed on 1509163008 wanted 62366 found 62343 ### [PREVIOUS LINE REPEATED 9 TIMES] ### tower-diagnostics-20230302-1035.zip
  7. Thanks JorgeB Here's the output of BTRFS check after rebooting and starting in maintenance mode Diags also attached. [1/7] checking root items [2/7] checking extents data backref 727264886784 root 5 owner 1059284 offset 57325158400 num_refs 0 not found in extent tree incorrect local backref count on 727264886784 root 5 owner 1059284 offset 57325158400 found 1 wanted 0 back 0x2b7f2f00 incorrect local backref count on 727264886784 root 18446612751160515216 owner 1059284 offset 57325158400 found 0 wanted 1 back 0x2b7528d0 backref disk bytenr does not match extent record, bytenr=727264886784, ref bytenr=0 backpointer mismatch on [727264886784 4096] ERROR: errors found in extent allocation tree or chunk allocation [3/7] checking free space tree [4/7] checking fs roots [5/7] checking only csums items (without verifying data) [6/7] checking root refs [7/7] checking quota groups skipped (not enabled on this FS) Opening filesystem to check... Checking filesystem on /dev/mapper/nvme0n1p1 UUID: 61417f12-0169-441c-9476-9033201fe7b6 found 683876212736 bytes used, error(s) found total csum bytes: 665553916 total tree bytes: 2065924096 total fs tree bytes: 826064896 total extent tree bytes: 412942336 btree space waste bytes: 353492783 file data blocks allocated: 27232204554240 referenced 566318612480 tower-diagnostics-20230301-2035.zip
  8. Just had this error today. VMs and Dockers have stopped. Diagnostics attached. I assume one of my NVME drives is failing, so I need to stop the array, take it out of the cache pool, restart the array, and buy a new one? thank you. tower-diagnostics-20230301-1443.zip
  9. Still not got emoncms fully working. I do have inputs coming in via MQTT, and I can create feeds. It is also connecting to redis and mariadb dockers. But I can'tupdate it due to the error above, and I don't have most of the modules, eg. Sync or Schedule. Anyone any ideas? Cheers.
  10. I now have it kinda working, connecting to a mariadb instance but I'm not able to do an update, and much of the left hand side menu is missing. Here's a couple of screenshots.
  11. I tried 127.0.0.1 in the MYSQL host parameter and the message changed to "Connection Refused". Does this Docker have mysql installed or do I need to connect to an external DB server? Cheers.
  12. I just did a fresh install of the emoncms docker. I changed no settings. I get this error. What do I need to change? Cheers. Can't connect to database, please verify credentials/configuration in settings.ini Error message: No such file or directory
  13. I'll repeat JB's words because they apply to me as well! The script needs the 1st 2 snapshots already created. It shutsdown any running VMs, tests that they are shutdown. This bit was cribbed from somewhere else. It does not force a shutdown. It starts back up any VMs set to "autostart" It ran for the 1st time on Sunday, and I haven't had time to check that the snapshots created are correct. There's very little error checking in it. cd /mnt/cache/appdata/snapshots sd=$(echo VMs_Off* | awk '{print $1}') ps=$(echo VMs_Off* | awk '{print $2}') if [ "$ps" == "VMs_Offline_$(date '+%Y%m%d')" ] then echo "There's already a snapshot from today" else for i in `virsh list | grep running | awk '{print $2}'`; do virsh shutdown $i; done # Wait until all domains are shut down or timeout has reached. END_TIME=$(date -d "300 seconds" +%s) while [ $(date +%s) -lt $END_TIME ]; do # Break while loop when no domains are left. test -z "`virsh list | grep running | awk '{print $2}'`" && break # Wait a little, we don't want to DoS libvirt. sleep 1 done echo "shutdown completed" virsh list | grep running | awk '{print $2}' btrfs sub snap -r /mnt/cache/appdata/VMs /mnt/cache/appdata/snapshots/VMs_Offline_$(date '+%Y%m%d') for i in `virsh list --all --autostart|awk '{print $2}'|grep -v Name`; do virsh start $i; done sync btrfs send -p /mnt/cache/appdata/snapshots/$ps /mnt/cache/appdata/snapshots/VMs_Offline_$(date '+%Y%m%d') | btrfs receive /mnt/disks/unRAIDBackup_BTRFS/snapshots if [[ $? -eq 0 ]]; then /usr/local/emhttp/webGui/scripts/notify -i normal -s "Send/Receive complete" btrfs sub del /mnt/cache/appdata/snapshots/$sd #btrfs sub del /mnt/disks/unRAIDBackup_BTRFS/snapshots/$sd else /usr/local/emhttp/webGui/scripts/notify -i warning -s "Send/Receive failed" fi fi
×
×
  • Create New...