All kinds of issues: Execution 403, Docker failed to start, and Read only file system


Recommended Posts

Started having this issue yesterday evening with a container being turned off automatically. Fast forward to today woke up to 4 containers off.

 

I assume it is a log issue, but in general my research has led me to believe it is a docker image going, and I quote, "kaput". So i followed instructions here but now my docker service is failing to start. Attached are my diagnostics. How do I go about fixing this?

edith-diagnostics-20220102-0950.zip

Link to comment

Looking into the syslog I can see BTRF errors all kinds. Now I have 2 Samsung SSD that are mirrored and they are not full

 

image.thumb.png.055ad802cad361e973bf40be03436733.png

Jan  2 08:30:41 EDITH kernel: BTRFS critical (device dm-2): corrupt leaf: root=2 block=1921433600 slot=43, invalid key objectid, have 56986013760 expect to be aligned to 4096
Jan  2 08:30:41 EDITH kernel: BTRFS info (device dm-2): leaf 1921433600 gen 2492035 total ptrs 155 free space 4193 owner 2
Jan  2 08:30:41 EDITH kernel: 	item 0 key (56982016000 168 8192) itemoff 16230 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487446 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46755840 count 1
Jan  2 08:30:41 EDITH kernel: 	item 1 key (56982024192 168 8192) itemoff 16177 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487447 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 47165440 count 1
Jan  2 08:30:41 EDITH kernel: 	item 2 key (56982036480 168 16384) itemoff 16124 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066306 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10547503 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 3 key (56982061056 168 12288) itemoff 16071 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487448 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46485504 count 1
Jan  2 08:30:41 EDITH kernel: 	item 4 key (56982077440 168 8192) itemoff 16018 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487450 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46669824 count 1
Jan  2 08:30:41 EDITH kernel: 	item 5 key (56982085632 168 4096) itemoff 15965 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487448 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46956544 count 1
Jan  2 08:30:41 EDITH kernel: 	item 6 key (56982097920 168 8192) itemoff 15912 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487449 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46682112 count 1
Jan  2 08:30:41 EDITH kernel: 	item 7 key (56982118400 168 8192) itemoff 15859 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2404263 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 32966 offset 82378752 count 1
Jan  2 08:30:41 EDITH kernel: 	item 8 key (56982126592 168 372736) itemoff 15806 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2432073 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14442835 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 9 key (56982503424 168 4096) itemoff 15753 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487431 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 47026176 count 1
Jan  2 08:30:41 EDITH kernel: 	item 10 key (56982507520 168 4096) itemoff 15700 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492031 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4689920 count 1
Jan  2 08:30:41 EDITH kernel: 	item 11 key (56982511616 168 8192) itemoff 15647 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487446 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46882816 count 1
Jan  2 08:30:41 EDITH kernel: 	item 12 key (56982519808 168 16384) itemoff 15594 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487450 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46649344 count 1
Jan  2 08:30:41 EDITH kernel: 	item 13 key (56982536192 168 16384) itemoff 15541 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066306 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10547446 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 14 key (56982552576 168 348160) itemoff 15488 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2432074 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14445496 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 15 key (56982900736 168 8192) itemoff 15435 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487428 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887161 offset 62709760 count 1
Jan  2 08:30:41 EDITH kernel: 	item 16 key (56982913024 168 81920) itemoff 15382 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066238 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10536616 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 17 key (56983003136 168 331776) itemoff 15329 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2045417 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 9058059 offset 27734016 count 1
Jan  2 08:30:41 EDITH kernel: 	item 18 key (56983334912 168 192512) itemoff 15276 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2432075 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14447538 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 19 key (56983527424 168 4096) itemoff 15223 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492027 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1662976 count 1
Jan  2 08:30:41 EDITH kernel: 	item 20 key (56983531520 168 20480) itemoff 15170 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066297 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10545302 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 21 key (56983552000 168 217088) itemoff 15117 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2432075 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14447461 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 22 key (56983773184 168 12288) itemoff 15064 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487450 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46706688 count 1
Jan  2 08:30:41 EDITH kernel: 	item 23 key (56983785472 168 4096) itemoff 15011 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492024 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 421888 count 1
Jan  2 08:30:41 EDITH kernel: 	item 24 key (56983789568 168 4096) itemoff 14958 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492024 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 888832 count 1
Jan  2 08:30:41 EDITH kernel: 	item 25 key (56983793664 168 4096) itemoff 14905 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492021 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1818624 count 1
Jan  2 08:30:41 EDITH kernel: 	item 26 key (56983797760 168 20480) itemoff 14852 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066297 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10545303 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 27 key (56983818240 168 16384) itemoff 14799 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2450903 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 32966 offset 72220672 count 1
Jan  2 08:30:41 EDITH kernel: 	item 28 key (56983834624 168 8192) itemoff 14746 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487446 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 47210496 count 1
Jan  2 08:30:41 EDITH kernel: 	item 29 key (56983851008 168 20480) itemoff 14693 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2063356 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10468198 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 30 key (56983871488 168 430080) itemoff 14640 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2432072 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14442705 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 31 key (56984301568 168 1056768) itemoff 14587 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2446300 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14543638 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 32 key (56985358336 168 188416) itemoff 14534 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2458066 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14646774 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 33 key (56985829376 168 12288) itemoff 14481 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 2 gen 2487449 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46886912 count 2
Jan  2 08:30:41 EDITH kernel: 	item 34 key (56985968640 168 4096) itemoff 14428 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491965 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 892928 count 1
Jan  2 08:30:41 EDITH kernel: 	item 35 key (56985972736 168 4096) itemoff 14375 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492024 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 901120 count 1
Jan  2 08:30:41 EDITH kernel: 	item 36 key (56985976832 168 4096) itemoff 14322 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492033 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1503232 count 1
Jan  2 08:30:41 EDITH kernel: 	item 37 key (56985980928 168 4096) itemoff 14269 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492035 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1187840 count 1
Jan  2 08:30:41 EDITH kernel: 	item 38 key (56985985024 168 4096) itemoff 14216 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492024 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1478656 count 1
Jan  2 08:30:41 EDITH kernel: 	item 39 key (56985989120 168 8192) itemoff 14163 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492005 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1511424 count 1
Jan  2 08:30:41 EDITH kernel: 	item 40 key (56985997312 168 8192) itemoff 14110 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491994 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 602112 count 1
Jan  2 08:30:41 EDITH kernel: 	item 41 key (56986005504 168 4096) itemoff 14057 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492001 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 741376 count 1
Jan  2 08:30:41 EDITH kernel: 	item 42 key (56986009600 168 4096) itemoff 14004 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492005 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4599808 count 1
Jan  2 08:30:41 EDITH kernel: 	item 43 key (56986013760 168 28672) itemoff 13951 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487445 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46678016 count 1
Jan  2 08:30:41 EDITH kernel: 	item 44 key (56986042368 168 4096) itemoff 13898 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492035 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1773568 count 1
Jan  2 08:30:41 EDITH kernel: 	item 45 key (56986046464 168 4096) itemoff 13845 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492014 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 880640 count 1
Jan  2 08:30:41 EDITH kernel: 	item 46 key (56986050560 168 4096) itemoff 13792 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491991 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4567040 count 1
Jan  2 08:30:41 EDITH kernel: 	item 47 key (56986054656 168 20480) itemoff 13739 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 2 gen 2487445 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46759936 count 2
Jan  2 08:30:41 EDITH kernel: 	item 48 key (56986075136 168 12288) itemoff 13686 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487449 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 47239168 count 1
Jan  2 08:30:41 EDITH kernel: 	item 49 key (56986087424 168 4096) itemoff 13633 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492024 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4268032 count 1
Jan  2 08:30:41 EDITH kernel: 	item 50 key (56986091520 168 28672) itemoff 13580 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066296 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10545146 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 51 key (56986124288 168 12288) itemoff 13527 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487450 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46743552 count 1
Jan  2 08:30:41 EDITH kernel: 	item 52 key (56986148864 168 8192) itemoff 13474 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2478149 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 32966 offset 72187904 count 1
Jan  2 08:30:41 EDITH kernel: 	item 53 key (56986157056 168 4096) itemoff 13421 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2489358 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46931968 count 1
Jan  2 08:30:41 EDITH kernel: 	item 54 key (56986161152 168 1683456) itemoff 13368 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 1416986 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 5206163 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 55 key (56987844608 168 122880) itemoff 13315 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 1903321 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 8482965 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 56 key (56987967488 168 12288) itemoff 13262 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487446 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46895104 count 1
Jan  2 08:30:41 EDITH kernel: 	item 57 key (56987979776 168 8192) itemoff 13209 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2488644 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 32966 offset 72343552 count 1
Jan  2 08:30:41 EDITH kernel: 	item 58 key (56988000256 168 4096) itemoff 13156 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492032 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1519616 count 1
Jan  2 08:30:41 EDITH kernel: 	item 59 key (56988004352 168 4096) itemoff 13103 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492034 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1101824 count 1
Jan  2 08:30:41 EDITH kernel: 	item 60 key (56988008448 168 16384) itemoff 13050 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491981 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 294912 count 1
Jan  2 08:30:41 EDITH kernel: 	item 61 key (56988024832 168 8192) itemoff 12997 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492028 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 708608 count 1
Jan  2 08:30:41 EDITH kernel: 	item 62 key (56988033024 168 16384) itemoff 12944 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2196950 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 7074768 offset 5488640 count 1
Jan  2 08:30:41 EDITH kernel: 	item 63 key (56988049408 168 16384) itemoff 12891 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066306 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10547447 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 64 key (56988065792 168 626688) itemoff 12838 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2488714 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14900617 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 65 key (56988729344 168 4096) itemoff 12785 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492014 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1032192 count 1
Jan  2 08:30:41 EDITH kernel: 	item 66 key (56988733440 168 4096) itemoff 12732 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491967 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4308992 count 1
Jan  2 08:30:41 EDITH kernel: 	item 67 key (56988737536 168 4096) itemoff 12679 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492034 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1716224 count 1
Jan  2 08:30:41 EDITH kernel: 	item 68 key (56988741632 168 4096) itemoff 12626 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2489358 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 47116288 count 1
Jan  2 08:30:41 EDITH kernel: 	item 69 key (56988745728 168 8192) itemoff 12573 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492018 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4620288 count 1
Jan  2 08:30:41 EDITH kernel: 	item 70 key (56988753920 168 4096) itemoff 12520 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492017 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5435392 count 1
Jan  2 08:30:41 EDITH kernel: 	item 71 key (56988758016 168 360448) itemoff 12467 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 1903316 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 8475783 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 72 key (56989118464 168 77824) itemoff 12414 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066238 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10536658 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 73 key (56989196288 168 24576) itemoff 12361 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066297 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10545295 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 74 key (56989220864 168 4096) itemoff 12308 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492034 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4403200 count 1
Jan  2 08:30:41 EDITH kernel: 	item 75 key (56989224960 168 4096) itemoff 12255 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492032 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1724416 count 1
Jan  2 08:30:41 EDITH kernel: 	item 76 key (56989229056 168 4096) itemoff 12202 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492017 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5705728 count 1
Jan  2 08:30:41 EDITH kernel: 	item 77 key (56989233152 168 4096) itemoff 12149 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492017 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 6062080 count 1
Jan  2 08:30:41 EDITH kernel: 	item 78 key (56989237248 168 4096) itemoff 12096 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492014 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1294336 count 1
Jan  2 08:30:41 EDITH kernel: 	item 79 key (56989249536 168 8192) itemoff 12043 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491973 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 536576 count 1
Jan  2 08:30:41 EDITH kernel: 	item 80 key (56989257728 168 4096) itemoff 11990 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492007 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1392640 count 1
Jan  2 08:30:41 EDITH kernel: 	item 81 key (56989261824 168 4096) itemoff 11937 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491986 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5005312 count 1
Jan  2 08:30:41 EDITH kernel: 	item 82 key (56989265920 168 4096) itemoff 11884 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492018 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5140480 count 1
Jan  2 08:30:41 EDITH kernel: 	item 83 key (56989270016 168 4096) itemoff 11831 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491997 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4866048 count 1
Jan  2 08:30:41 EDITH kernel: 	item 84 key (56989274112 168 4096) itemoff 11778 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491995 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4538368 count 1
Jan  2 08:30:41 EDITH kernel: 	item 85 key (56989278208 168 4096) itemoff 11725 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492030 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5091328 count 1
Jan  2 08:30:41 EDITH kernel: 	item 86 key (56989282304 168 4096) itemoff 11672 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491990 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5107712 count 1
Jan  2 08:30:41 EDITH kernel: 	item 87 key (56989286400 168 4096) itemoff 11619 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492008 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1757184 count 1
Jan  2 08:30:41 EDITH kernel: 	item 88 key (56989290496 168 4096) itemoff 11566 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492025 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5042176 count 1
Jan  2 08:30:41 EDITH kernel: 	item 89 key (56989294592 168 8192) itemoff 11513 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492020 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4231168 count 1
Jan  2 08:30:41 EDITH kernel: 	item 90 key (56989302784 168 4096) itemoff 11460 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492004 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4575232 count 1
Jan  2 08:30:41 EDITH kernel: 	item 91 key (56989306880 168 16384) itemoff 11407 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487446 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46989312 count 1
Jan  2 08:30:41 EDITH kernel: 	item 92 key (56989323264 168 4096) itemoff 11354 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492017 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4448256 count 1
Jan  2 08:30:41 EDITH kernel: 	item 93 key (56989327360 168 4096) itemoff 11301 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492020 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4616192 count 1
Jan  2 08:30:41 EDITH kernel: 	item 94 key (56989331456 168 4096) itemoff 11248 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492032 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1875968 count 1
Jan  2 08:30:41 EDITH kernel: 	item 95 key (56989335552 168 24576) itemoff 11195 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2063350 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10464292 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 96 key (56989360128 168 4096) itemoff 11142 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492002 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4759552 count 1
Jan  2 08:30:41 EDITH kernel: 	item 97 key (56989364224 168 4096) itemoff 11089 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491996 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1536000 count 1
Jan  2 08:30:41 EDITH kernel: 	item 98 key (56989368320 168 4096) itemoff 11036 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492006 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1921024 count 1
Jan  2 08:30:41 EDITH kernel: 	item 99 key (56989372416 168 8192) itemoff 10983 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492026 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1318912 count 1
Jan  2 08:30:41 EDITH kernel: 	item 100 key (56989380608 168 4096) itemoff 10930 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492007 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1695744 count 1
Jan  2 08:30:41 EDITH kernel: 	item 101 key (56989384704 168 8192) itemoff 10877 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491984 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1589248 count 1
Jan  2 08:30:41 EDITH kernel: 	item 102 key (56989392896 168 4096) itemoff 10824 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492012 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5066752 count 1
Jan  2 08:30:41 EDITH kernel: 	item 103 key (56989396992 168 4096) itemoff 10771 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487448 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 47001600 count 1
Jan  2 08:30:41 EDITH kernel: 	item 104 key (56989401088 168 16384) itemoff 10718 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2063372 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10480257 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 105 key (56989417472 168 8192) itemoff 10665 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2450903 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 32966 offset 72253440 count 1
Jan  2 08:30:41 EDITH kernel: 	item 106 key (56989425664 168 4096) itemoff 10612 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491986 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 569344 count 1
Jan  2 08:30:41 EDITH kernel: 	item 107 key (56989429760 168 4096) itemoff 10559 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492029 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1859584 count 1
Jan  2 08:30:41 EDITH kernel: 	item 108 key (56989433856 168 16384) itemoff 10506 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2197584 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 7074768 offset 5767168 count 1
Jan  2 08:30:41 EDITH kernel: 	item 109 key (56989450240 168 16384) itemoff 10453 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066306 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10547459 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 110 key (56989466624 168 8192) itemoff 10400 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491999 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1339392 count 1
Jan  2 08:30:41 EDITH kernel: 	item 111 key (56989474816 168 8192) itemoff 10347 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492029 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 434176 count 1
Jan  2 08:30:41 EDITH kernel: 	item 112 key (56989483008 168 4096) itemoff 10294 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491966 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4378624 count 1
Jan  2 08:30:41 EDITH kernel: 	item 113 key (56989487104 168 4096) itemoff 10241 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492000 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1056768 count 1
Jan  2 08:30:41 EDITH kernel: 	item 114 key (56989491200 168 4096) itemoff 10188 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492035 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1826816 count 1
Jan  2 08:30:41 EDITH kernel: 	item 115 key (56989495296 168 8192) itemoff 10135 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492018 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5115904 count 1
Jan  2 08:30:41 EDITH kernel: 	item 116 key (56989503488 168 4096) itemoff 10082 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492022 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1376256 count 1
Jan  2 08:30:41 EDITH kernel: 	item 117 key (56989507584 168 4096) itemoff 10029 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492021 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4259840 count 1
Jan  2 08:30:41 EDITH kernel: 	item 118 key (56989511680 168 8192) itemoff 9976 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492000 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1171456 count 1
Jan  2 08:30:41 EDITH kernel: 	item 119 key (56989519872 168 4096) itemoff 9923 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492003 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 319488 count 1
Jan  2 08:30:41 EDITH kernel: 	item 120 key (56989523968 168 4096) itemoff 9870 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492011 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5337088 count 1
Jan  2 08:30:41 EDITH kernel: 	item 121 key (56989528064 168 4096) itemoff 9817 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492012 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5144576 count 1
Jan  2 08:30:41 EDITH kernel: 	item 122 key (56989532160 168 4096) itemoff 9764 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492003 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 704512 count 1
Jan  2 08:30:41 EDITH kernel: 	item 123 key (56989536256 168 8192) itemoff 9711 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492035 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 958464 count 1
Jan  2 08:30:41 EDITH kernel: 	item 124 key (56989544448 168 12288) itemoff 9658 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487451 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 47034368 count 1
Jan  2 08:30:41 EDITH kernel: 	item 125 key (56989556736 168 4096) itemoff 9605 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491984 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5726208 count 1
Jan  2 08:30:41 EDITH kernel: 	item 126 key (56989560832 168 4096) itemoff 9552 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492028 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 6119424 count 1
Jan  2 08:30:41 EDITH kernel: 	item 127 key (56989564928 168 4096) itemoff 9499 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2487450 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14887160 offset 46837760 count 1
Jan  2 08:30:41 EDITH kernel: 	item 128 key (56989569024 168 4096) itemoff 9446 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491979 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1126400 count 1
Jan  2 08:30:41 EDITH kernel: 	item 129 key (56989573120 168 4096) itemoff 9393 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492006 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4272128 count 1
Jan  2 08:30:41 EDITH kernel: 	item 130 key (56989577216 168 4096) itemoff 9340 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492018 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 6193152 count 1
Jan  2 08:30:41 EDITH kernel: 	item 131 key (56989581312 168 4096) itemoff 9287 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492006 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4493312 count 1
Jan  2 08:30:41 EDITH kernel: 	item 132 key (56989585408 168 4096) itemoff 9234 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492030 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5513216 count 1
Jan  2 08:30:41 EDITH kernel: 	item 133 key (56989589504 168 4096) itemoff 9181 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492001 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1527808 count 1
Jan  2 08:30:41 EDITH kernel: 	item 134 key (56989593600 168 4096) itemoff 9128 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492000 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1581056 count 1
Jan  2 08:30:41 EDITH kernel: 	item 135 key (56989597696 168 8192) itemoff 9075 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491951 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1310720 count 1
Jan  2 08:30:41 EDITH kernel: 	item 136 key (56989605888 168 8192) itemoff 9022 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2450903 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 32966 offset 71925760 count 1
Jan  2 08:30:41 EDITH kernel: 	item 137 key (56989614080 168 45056) itemoff 8969 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2066260 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 10539758 offset 0 count 1
Jan  2 08:30:41 EDITH kernel: 	item 138 key (56989659136 168 4096) itemoff 8916 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492027 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4284416 count 1
Jan  2 08:30:41 EDITH kernel: 	item 139 key (56989663232 168 4096) itemoff 8863 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492017 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5505024 count 1
Jan  2 08:30:41 EDITH kernel: 	item 140 key (56989667328 168 4096) itemoff 8810 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492017 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5615616 count 1
Jan  2 08:30:41 EDITH kernel: 	item 141 key (56989675520 168 8192) itemoff 8757 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492029 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1175552 count 1
Jan  2 08:30:41 EDITH kernel: 	item 142 key (56989687808 168 4096) itemoff 8704 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492027 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4513792 count 1
Jan  2 08:30:41 EDITH kernel: 	item 143 key (56989691904 168 4096) itemoff 8651 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492006 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4530176 count 1
Jan  2 08:30:41 EDITH kernel: 	item 144 key (56989696000 168 4096) itemoff 8598 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492017 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 6438912 count 1
Jan  2 08:30:41 EDITH kernel: 	item 145 key (56989700096 168 4096) itemoff 8545 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492019 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1658880 count 1
Jan  2 08:30:41 EDITH kernel: 	item 146 key (56989704192 168 4096) itemoff 8492 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492027 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4685824 count 1
Jan  2 08:30:41 EDITH kernel: 	item 147 key (56989708288 168 4096) itemoff 8439 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492018 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 204800 count 1
Jan  2 08:30:41 EDITH kernel: 	item 148 key (56989712384 168 4096) itemoff 8386 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492024 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 4481024 count 1
Jan  2 08:30:41 EDITH kernel: 	item 149 key (56989716480 168 4096) itemoff 8333 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491985 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 274432 count 1
Jan  2 08:30:41 EDITH kernel: 	item 150 key (56989720576 168 8192) itemoff 8280 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491998 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1740800 count 1
Jan  2 08:30:41 EDITH kernel: 	item 151 key (56989728768 168 8192) itemoff 8227 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2491998 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1855488 count 1
Jan  2 08:30:41 EDITH kernel: 	item 152 key (56989736960 168 8192) itemoff 8174 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492010 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 757760 count 1
Jan  2 08:30:41 EDITH kernel: 	item 153 key (56989745152 168 4096) itemoff 8121 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492023 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 1765376 count 1
Jan  2 08:30:41 EDITH kernel: 	item 154 key (56989749248 168 4096) itemoff 8068 itemsize 53
Jan  2 08:30:41 EDITH kernel: 		extent refs 1 gen 2492030 flags 1
Jan  2 08:30:41 EDITH kernel: 		ref#0: extent data backref root 5 objectid 14919338 offset 5562368 count 1
Jan  2 08:30:41 EDITH kernel: BTRFS error (device dm-2): block=1921433600 write time tree block corruption detected
Jan  2 08:30:41 EDITH kernel: BTRFS: error (device dm-2) in btrfs_commit_transaction:2377: errno=-5 IO failure (Error while writing out transaction)
Jan  2 08:30:41 EDITH kernel: BTRFS info (device dm-2): forced readonly
Jan  2 08:30:41 EDITH kernel: BTRFS warning (device dm-2): Skipping commit of aborted transaction.
Jan  2 08:30:41 EDITH kernel: BTRFS: error (device dm-2) in cleanup_transaction:1942: errno=-5 IO failure
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 124960 op 0x1:(WRITE) flags 0x1800 phys_seg 16 prio class 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 1, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 2, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 125440 op 0x1:(WRITE) flags 0x1800 phys_seg 30 prio class 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 3, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 4, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 5, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 649248 op 0x1:(WRITE) flags 0x1800 phys_seg 16 prio class 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 6, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 7, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 649728 op 0x1:(WRITE) flags 0x1800 phys_seg 30 prio class 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 8, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 9, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 10, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 126496 op 0x1:(WRITE) flags 0x1800 phys_seg 28 prio class 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 650784 op 0x1:(WRITE) flags 0x1800 phys_seg 28 prio class 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 126784 op 0x1:(WRITE) flags 0x1800 phys_seg 14 prio class 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 127072 op 0x1:(WRITE) flags 0x1800 phys_seg 80 prio class 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 651072 op 0x1:(WRITE) flags 0x1800 phys_seg 14 prio class 0
Jan  2 08:30:48 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 651360 op 0x1:(WRITE) flags 0x1800 phys_seg 80 prio class 0
Jan  2 08:30:48 EDITH kernel: BTRFS: error (device loop2) in btrfs_commit_transaction:2377: errno=-5 IO failure (Error while writing out transaction)
Jan  2 08:30:48 EDITH kernel: BTRFS info (device loop2): forced readonly
Jan  2 08:30:48 EDITH kernel: BTRFS warning (device loop2): Skipping commit of aborted transaction.
Jan  2 08:30:48 EDITH kernel: BTRFS: error (device loop2) in cleanup_transaction:1942: errno=-5 IO failure
Jan  2 08:30:54 EDITH kernel: print_req_error: 10 callbacks suppressed
Jan  2 08:30:54 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:30:54 EDITH kernel: btrfs_dev_stat_print_on_error: 48 callbacks suppressed
Jan  2 08:30:54 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 59, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:54 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:30:54 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2506272 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:30:54 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:30:54 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 60, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:54 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 61, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:54 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 62, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:30:54 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2450096 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:30:54 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 63, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:19 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 1492664 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:31:19 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 64, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:19 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 3905160 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:31:19 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 65, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:19 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 3836248 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:31:19 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 66, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:24 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:31:24 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 67, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:24 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 4 prio class 0
Jan  2 08:31:24 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 68, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:24 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2696120 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:31:24 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 69, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:55 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:31:55 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 70, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:55 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:31:55 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 71, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:55 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:31:55 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 72, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:31:55 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:31:55 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 73, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:32:26 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:32:26 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2696120 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:32:26 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 74, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:32:26 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 75, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:32:26 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 4 prio class 0
Jan  2 08:32:26 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 76, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:32:57 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:32:57 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 77, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:32:57 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:32:57 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 78, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:32:57 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:32:57 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 79, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:32:57 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:32:57 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 80, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:33:27 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:33:27 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:33:27 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:33:27 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 81, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:33:27 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 82, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:33:27 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 83, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:33:27 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:33:27 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 84, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:33:31 EDITH kernel: docker0: port 7(veth0c224ae) entered disabled state
Jan  2 08:33:31 EDITH kernel: veth274161d: renamed from eth0
Jan  2 08:33:58 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:33:58 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 85, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:33:58 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:33:58 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 86, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:33:58 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2692008 op 0x1:(WRITE) flags 0x100000 phys_seg 4 prio class 0
Jan  2 08:33:58 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 87, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:34:29 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:34:29 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 88, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:34:29 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:34:29 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 89, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:34:29 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:34:29 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 90, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:34:29 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:34:29 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 91, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:34:59 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:34:59 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 92, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:34:59 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:34:59 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 93, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:34:59 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:34:59 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 94, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:34:59 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:34:59 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 95, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:35:30 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:35:30 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 96, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:35:30 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:35:30 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 97, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:35:30 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2692008 op 0x1:(WRITE) flags 0x100000 phys_seg 4 prio class 0
Jan  2 08:35:30 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 98, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:36:01 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:36:01 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 99, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:36:01 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:36:01 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 100, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:36:01 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:36:01 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 101, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:36:01 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:36:01 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 102, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:36:32 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:36:32 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 103, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:36:32 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:36:32 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 104, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:36:32 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:36:32 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 105, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:37:02 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:37:02 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 106, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:37:02 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:37:02 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 107, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:37:02 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:37:02 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 108, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:37:02 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:37:02 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 109, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:37:33 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:37:33 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 110, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:37:33 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:37:33 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 111, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:37:33 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2692008 op 0x1:(WRITE) flags 0x100000 phys_seg 4 prio class 0
Jan  2 08:37:33 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 112, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:38:04 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:38:04 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 113, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:38:04 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2449848 op 0x1:(WRITE) flags 0x100000 phys_seg 1 prio class 0
Jan  2 08:38:04 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 114, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:38:04 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:38:04 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 115, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:38:04 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:38:04 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 116, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:38:34 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2688592 op 0x1:(WRITE) flags 0x100000 phys_seg 3 prio class 0
Jan  2 08:38:34 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 117, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:38:34 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2446832 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
Jan  2 08:38:34 EDITH kernel: blk_update_request: I/O error, dev loop2, sector 2689488 op 0x1:(WRITE) flags 0x100000 phys_seg 6 prio class 0
Jan  2 08:38:34 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 118, rd 0, flush 0, corrupt 0, gen 0
Jan  2 08:38:34 EDITH kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 119, rd 0, flush 0, corrupt 0, gen 0

 

Link to comment

I am confused on this issue if it is a log issue (I do have some rather big logs about 75MB's for a single container and few, but it can't be more than 1GB), or if this is a docker image being corrupted, or if this is a BTRFS issue, OR a hardware issue where i saw this post and a user realized it was a RAM issue...

Anyone can help would be greatly appreciated to show me where to hunt.

Link to comment

So i restarted my server and put it in maintenance mode and ran a  BTRFS scrub, and I got this:

 

[1/7] checking root items
[2/7] checking extents
data backref 26290810880 root 5 owner 6748568 offset 4419584 num_refs 0 not found in extent tree
incorrect local backref count on 26290810880 root 5 owner 6748568 offset 4419584 found 1 wanted 0 back 0xfdebfb0
incorrect local backref count on 26290810880 root 5 owner 2554264 offset 4419584 found 0 wanted 1 back 0xce5f550
backref disk bytenr does not match extent record, bytenr=26290810880, ref bytenr=0
backpointer mismatch on [26290810880 4096]
ref mismatch on [27050344448 16384] extent item 16385, found 1
ERROR: errors found in extent allocation tree or chunk allocation
[3/7] checking free space tree
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data)
[6/7] checking root refs
[7/7] checking quota groups skipped (not enabled on this FS)
Opening filesystem to check...
Checking filesystem on /dev/mapper/sde1
UUID: 52eaded8-4def-4434-b76d-4461289de4a2
cache and super generation don't match, space cache will be invalidated
found 150266281984 bytes used, error(s) found
total csum bytes: 91393048
total tree bytes: 878690304
total fs tree bytes: 671334400
total extent tree bytes: 77955072
btree space waste bytes: 161118122
file data blocks allocated: 657131868160
 referenced 147798339584

 

Edited by Ustrombase
more detail
Link to comment
Jan  1 21:21:48 EDITH kernel: BTRFS info (device dm-2): bdev /dev/mapper/sde1 errs: wr 0, rd 0, flush 0, corrupt 67, gen 0
Jan  1 21:21:48 EDITH kernel: BTRFS info (device dm-2): bdev /dev/mapper/sdc1 errs: wr 0, rd 0, flush 0, corrupt 98, gen 0

 

That's the start of this all.  BTRFS is finding corruption.  The easiest way for this to have happened is via bad RAM.  Run a memtest for a couple of passes

 

Link to comment

ECC buys you more time before having to replace a stick due to bad memory, but doesn't prevent bad ram from happening.

 

Also, you're running the memory at an overclock (XMP/AMP).  The maximum supported speed on Ryzen 3rd gen is 3200 (https://forums.unraid.net/topic/46802-faq-for-unraid-v6/page/2/?tab=comments#comment-819173)

 

You're running it at 3600 and the native non-overclocked speed of the RAM is 2133  This doesn't help with memory issues.

 

Link to comment
3 hours ago, Ustrombase said:

@Squid, i think the speed is suppose to be 3200 not 2133, right?

The DDR4 base spec is 2133. Some DIMMs are validated at higher frequencies but there are other elements to consider (memory controller, CPU, board design, etc.)

 

The Ryzen 3900 memory controller is rated at 3200MT/s with 2 dual rank DIMMs.

You can try 3200 and see if it is more stable ; if not, try a lower frequency.

Or start at the base frequency and go up.

Link to comment
  • 2 weeks later...

Thank you @ChatNoirI appreciate the further explanation here. Finally got some piece of equipment that allowed me to conduct my memtest over ethernet, and I got some errors.

 

@Squid, and @ChatNoir, ran my memtest at 3600 (which was technically OC) and it gave me errors

 

then ran it at 3200 and 2133 and got errors still in the same address. I wonder, should I bother and conduct this test with single dimm slots or not? I am unsure as these RAM was bought in August of 2020 so is it even possible to ask for a replacement from the manufacturer?

Link to comment

With errors @2133 the stick(s) are definitely bad.  No idea what the warranty period is on your RAM, and it may take a while for any RMA to go through so that's entirely up to you as to how you proceed.  Either way, you do not want to run with that RAM anymore.  

 

If you do choose to simply buy a replacement stick (ie: only replace one of them), then either buy the exact same stick as the defective one or if buying a different stick then ensure that the CL timings are identical between the mismatched set.  Mismatched sets installed work far better and more reliable if the timings (especially CL) matches.

Link to comment
30 minutes ago, Ustrombase said:

I am unsure as these RAM was bought in August of 2020 so is it even possible to ask for a replacement from the manufacturer?

It will depend on the legal warranties obligations in your country (for RMA with the store) but also on the warranties offered by the manufacturer. Big name tend to offer a very long RMA period on RAM. Might be a good idea to investigate further.

Link to comment

@Squid and @ChatNoir so I ran the memtest on individual memory sticks added one at a time and still got errors.

Do you all know if there is a chance it could be a motherboard issue? Just want to make sure that it is the memory sticks. Assuming tho that by buying more ram and testing again if I get issues with brand new ram it could imply it’s an issue uphill aka my motherboard right?


Sent from my iPhone using Tapatalk

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.