JasonK Posted June 17, 2019 Share Posted June 17, 2019 Thanks for trying to help, Squid. I just changed the port to 7902 and 8902 and went about my day. J Quote Link to comment
Squid Posted June 17, 2019 Share Posted June 17, 2019 Thanks for trying to help, Squid. I just changed the port to 7902 and 8902 and went about my day. J Lol yeah, the older I get the more I realize that time is sometimes too precious to spend an hour to find out why something is not working right, and prefer to just fix it and move onto something more interestingSent via tapatalk because my boss won't let me sit in front of the computer all day long and it's beyond his comprehension that the only thing stopping me from putting a bullet in my head to get out of the lame ass job is the unraid forums Quote Link to comment
Melocco Posted June 26, 2019 Share Posted June 26, 2019 Does anyone know of a way to get dupeguru to scan unassigned devices? I have a drive that holds a copy of my moives just incase something happens to unraid. But I think I have copies of movies I have deleted from plex still on the drive and also movies I have upgraded (bought the blu-ray version) and I just wanted to clean it up. If not, my only option is to delete all the files and recopy them back.. Any ideas? Thanks in advance. Quote Link to comment
JonathanM Posted June 26, 2019 Share Posted June 26, 2019 8 minutes ago, Melocco said: Does anyone know of a way to get dupeguru to scan unassigned devices? Add a path mapping to the docker. Quote Link to comment
Melocco Posted June 26, 2019 Share Posted June 26, 2019 Crap.. LOL...You ever have a brain fart? lol... I didn't even think about that.. Thanks... Quote Link to comment
Geck0 Posted January 7, 2020 Share Posted January 7, 2020 Hi, Is there a way to adjust the display of the results page? The height of the rows and displaying the files and the overall window size is squashed. I cannot make out the results properly without exporting them to .csv first, which is less than ideal. I've tried looking in dupeGuru.conf file and adjusting some of the values for the layout. For example: ResultWindowIsMaximized=true ResultWindowRect=0, 40, 1280,30 (I've changed these figures already), they seem to get written back to their original values on restart. Quote Link to comment
Djoss Posted January 8, 2020 Author Share Posted January 8, 2020 16 hours ago, Geck0 said: Hi, Is there a way to adjust the display of the results page? The height of the rows and displaying the files and the overall window size is squashed. I cannot make out the results properly without exporting them to .csv first, which is less than ideal. I've tried looking in dupeGuru.conf file and adjusting some of the values for the layout. For example: ResultWindowIsMaximized=true ResultWindowRect=0, 40, 1280,30 (I've changed these figures already), they seem to get written back to their original values on restart. Did you try to increase the resolution of the window with "Display Width" and "Display Height" in container's settings? Quote Link to comment
RadOD Posted January 15, 2020 Share Posted January 15, 2020 The dupeguru docker freezes after a fairly large task: 7.5 TiB, 534,090 files, 1,298 sub-folders -- all photos. Initially the task would cause the entire Unraid system to slow to a crawl and eventually hang. Logs showed memory allocation errors. I have 32GB so I added ran it with 16GB with the --memory option. The task ran without a hitch but hangs upon trying to take action at the end. Docker log (below) does not seem to show anything useful -- mainly VNC type stuff not dupeguru itself. System logs show nothing related. At the time of freeze up just a lot of 'Monitor: No array operation currently in progress'. It takes >24h to run, so trial and error here is not a good option. Is there a log someplace within the docker I should look to find errors thrown off by the dupeguru process itself? ErrorWarningSystemArrayLogin 14/01/2020 09:28:23 Protocol version sent 3.8, using 3.8 14/01/2020 09:28:23 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 09:28:23 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 09:28:23 Pixel format for client 127.0.0.1: 14/01/2020 09:28:23 32 bpp, depth 24, little endian 14/01/2020 09:28:23 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 09:28:23 no translation needed 14/01/2020 09:28:23 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 09:28:23 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 09:28:23 Using image quality level 6 for client 127.0.0.1 14/01/2020 09:28:23 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 09:28:23 Using compression level 9 for client 127.0.0.1 14/01/2020 09:28:23 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 09:28:23 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 09:28:23 Using tight encoding for client 127.0.0.1 14/01/2020 09:28:24 client 1 network rate 119.5 KB/sec (30840.4 eff KB/sec) 14/01/2020 09:28:24 client 1 latency: 1.5 ms 14/01/2020 09:28:24 dt1: 0.0043, dt2: 0.1240 dt3: 0.0015 bytes: 15237 14/01/2020 09:28:24 link_rate: LR_BROADBAND - 1 ms, 119 KB/s 14/01/2020 09:28:24 client_set_net: 127.0.0.1 0.0000 14/01/2020 09:28:24 created xdamage object: 0x40002c 14/01/2020 09:28:32 created selwin: 0x40002d 14/01/2020 09:28:32 called initialize_xfixes() 14/01/2020 09:28:33 copy_tiles: allocating first_line at size 41 14/01/2020 09:28:53 increased wireframe timeouts for slow network connection. 14/01/2020 09:28:53 netrate: 119 KB/sec, latency: 1 ms 14/01/2020 09:33:24 idle keyboard: turning X autorepeat back on. 14/01/2020 10:27:30 Got connection from client 127.0.0.1 14/01/2020 10:27:30 other clients: 14/01/2020 10:27:30 127.0.0.1 14/01/2020 10:27:30 Got 'ws' WebSockets handshake 14/01/2020 10:27:30 Got protocol: binary 14/01/2020 10:27:30 - webSocketsHandshake: using binary/raw encoding 14/01/2020 10:27:30 - WebSockets client version hybi-13 14/01/2020 10:27:30 incr accepted_client=2 for 127.0.0.1:33966 sock=11 14/01/2020 10:27:30 Client Protocol Version 3.8 14/01/2020 10:27:30 Protocol version sent 3.8, using 3.8 14/01/2020 10:27:30 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 10:27:30 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 10:27:30 Pixel format for client 127.0.0.1: 14/01/2020 10:27:30 32 bpp, depth 24, little endian 14/01/2020 10:27:30 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 10:27:30 no translation needed 14/01/2020 10:27:30 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 10:27:30 Using image quality level 6 for client 127.0.0.1 14/01/2020 10:27:30 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 10:27:30 Using compression level 9 for client 127.0.0.1 14/01/2020 10:27:30 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 10:27:30 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 10:27:30 Using tight encoding for client 127.0.0.1 14/01/2020 10:27:30 client 2 network rate 217.9 KB/sec (38794.9 eff KB/sec) 14/01/2020 10:27:30 client 2 latency: 2.7 ms 14/01/2020 10:27:30 dt1: 0.0090, dt2: 0.0937 dt3: 0.0027 bytes: 22084 14/01/2020 10:27:30 link_rate: LR_BROADBAND - 2 ms, 119 KB/s 14/01/2020 10:27:30 client_set_net: 127.0.0.1 0.0001 14/01/2020 10:27:31 active keyboard: turning X autorepeat off. 14/01/2020 10:29:14 client_count: 1 14/01/2020 10:29:14 Client 127.0.0.1 gone 14/01/2020 10:29:14 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 10:29:14 FramebufferUpdate : 105 | 0/ 0 ( 0.0%) 14/01/2020 10:29:14 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 10:29:14 tight : 193 | 73124/ 4117772 ( 98.2%) 14/01/2020 10:29:14 TOTALS : 299 | 73136/ 4117784 ( 98.2%) 14/01/2020 10:29:14 Statistics events Received/ RawEquiv ( saved) 14/01/2020 10:29:14 PointerEvent : 43 | 258/ 258 ( 0.0%) 14/01/2020 10:29:14 FramebufferUpdate : 106 | 1060/ 1060 ( 0.0%) 14/01/2020 10:29:14 SetEncodings : 1 | 52/ 52 ( 0.0%) 14/01/2020 10:29:14 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 10:29:14 TOTALS : 151 | 1390/ 1390 ( 0.0%) 14/01/2020 10:29:53 got closure, reason 1001 14/01/2020 10:29:53 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 10:29:53 client_count: 0 14/01/2020 10:29:53 Restored X server key autorepeat to: 1 14/01/2020 10:29:53 Client 127.0.0.1 gone 14/01/2020 10:29:53 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 10:29:53 ServerCutText : 1 | 8/ 8 ( 0.0%) 14/01/2020 10:29:53 FramebufferUpdate : 2738 | 0/ 0 ( 0.0%) 14/01/2020 10:29:53 copyRect : 1 | 16/ 691824 (100.0%) 14/01/2020 10:29:53 LastRect : 43 | 516/ 516 ( 0.0%) 14/01/2020 10:29:53 tight : 2997 | 1844512/ 13936412 ( 86.8%) 14/01/2020 10:29:53 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 10:29:53 TOTALS : 5781 | 1846426/ 14630134 ( 87.4%) 14/01/2020 10:29:53 Statistics events Received/ RawEquiv ( saved) 14/01/2020 10:29:53 PointerEvent : 1687 | 10122/ 10122 ( 0.0%) 14/01/2020 10:29:53 FramebufferUpdate : 2741 | 27410/ 27410 ( 0.0%) 14/01/2020 10:29:53 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 10:29:53 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 10:29:53 TOTALS : 4430 | 37608/ 37608 ( 0.0%) 14/01/2020 10:29:53 destroyed xdamage object: 0x40002c 14/01/2020 18:29:20 Got connection from client 127.0.0.1 14/01/2020 18:29:20 other clients: 14/01/2020 18:29:20 Got 'ws' WebSockets handshake 14/01/2020 18:29:20 Got protocol: binary 14/01/2020 18:29:20 - webSocketsHandshake: using binary/raw encoding 14/01/2020 18:29:20 - WebSockets client version hybi-13 14/01/2020 18:29:20 Disabled X server key autorepeat. 14/01/2020 18:29:20 to force back on run: 'xset r on' (3 times) 14/01/2020 18:29:20 incr accepted_client=3 for 127.0.0.1:48316 sock=10 14/01/2020 18:29:20 Client Protocol Version 3.8 14/01/2020 18:29:20 Protocol version sent 3.8, using 3.8 14/01/2020 18:29:20 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 18:29:20 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 18:29:21 Pixel format for client 127.0.0.1: 14/01/2020 18:29:21 32 bpp, depth 24, little endian 14/01/2020 18:29:21 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 18:29:21 no translation needed 14/01/2020 18:29:21 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 18:29:21 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 18:29:21 Using image quality level 6 for client 127.0.0.1 14/01/2020 18:29:21 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 18:29:21 Using compression level 9 for client 127.0.0.1 14/01/2020 18:29:21 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 18:29:21 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 18:29:21 Using tight encoding for client 127.0.0.1 14/01/2020 18:29:25 client_set_net: 127.0.0.1 0.0000 14/01/2020 18:29:25 created xdamage object: 0x40002e 14/01/2020 18:34:21 idle keyboard: turning X autorepeat back on. 14/01/2020 19:29:21 got closure, reason 1001 14/01/2020 19:29:21 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 19:29:21 client_count: 0 14/01/2020 19:29:21 Client 127.0.0.1 gone 14/01/2020 19:29:21 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 19:29:21 FramebufferUpdate : 2726 | 0/ 0 ( 0.0%) 14/01/2020 19:29:21 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 19:29:21 tight : 2780 | 2546996/ 10724048 ( 76.2%) 14/01/2020 19:29:21 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 19:29:21 TOTALS : 5508 | 2548382/ 10725434 ( 76.2%) 14/01/2020 19:29:21 Statistics events Received/ RawEquiv ( saved) 14/01/2020 19:29:21 FramebufferUpdate : 2728 | 27280/ 27280 ( 0.0%) 14/01/2020 19:29:21 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 19:29:21 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 19:29:21 TOTALS : 2730 | 27356/ 27356 ( 0.0%) 14/01/2020 19:29:21 destroyed xdamage object: 0x40002e 14/01/2020 21:00:06 Got connection from client 127.0.0.1 14/01/2020 21:00:06 other clients: 14/01/2020 21:00:06 Got 'ws' WebSockets handshake 14/01/2020 21:00:06 Got protocol: binary 14/01/2020 21:00:06 - webSocketsHandshake: using binary/raw encoding 14/01/2020 21:00:06 - WebSockets client version hybi-13 14/01/2020 21:00:06 Disabled X server key autorepeat. 14/01/2020 21:00:06 to force back on run: 'xset r on' (3 times) 14/01/2020 21:00:06 incr accepted_client=4 for 127.0.0.1:52812 sock=10 14/01/2020 21:00:06 Client Protocol Version 3.8 14/01/2020 21:00:06 Protocol version sent 3.8, using 3.8 14/01/2020 21:00:06 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 21:00:06 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 21:00:06 Pixel format for client 127.0.0.1: 14/01/2020 21:00:06 32 bpp, depth 24, little endian 14/01/2020 21:00:06 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 21:00:06 no translation needed 14/01/2020 21:00:06 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 21:00:06 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 21:00:06 Using image quality level 6 for client 127.0.0.1 14/01/2020 21:00:06 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 21:00:06 Using compression level 9 for client 127.0.0.1 14/01/2020 21:00:06 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 21:00:06 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 21:00:06 Using tight encoding for client 127.0.0.1 14/01/2020 21:00:10 client_set_net: 127.0.0.1 0.0000 14/01/2020 21:00:10 active keyboard: turning X autorepeat off. 14/01/2020 21:00:10 created xdamage object: 0x40002f 14/01/2020 21:05:08 idle keyboard: turning X autorepeat back on. 14/01/2020 21:10:09 got closure, reason 1001 14/01/2020 21:10:09 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 21:10:09 client_count: 0 14/01/2020 21:10:09 Client 127.0.0.1 gone 14/01/2020 21:10:09 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 21:10:09 FramebufferUpdate : 388 | 0/ 0 ( 0.0%) 14/01/2020 21:10:09 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 21:10:09 tight : 421 | 408370/ 4929724 ( 91.7%) 14/01/2020 21:10:09 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 21:10:09 TOTALS : 811 | 409756/ 4931110 ( 91.7%) 14/01/2020 21:10:09 Statistics events Received/ RawEquiv ( saved) 14/01/2020 21:10:09 FramebufferUpdate : 389 | 3890/ 3890 ( 0.0%) 14/01/2020 21:10:09 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 21:10:09 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 21:10:09 TOTALS : 391 | 3966/ 3966 ( 0.0%) 14/01/2020 21:10:09 destroyed xdamage object: 0x40002f 14/01/2020 21:11:02 Got connection from client 127.0.0.1 14/01/2020 21:11:02 other clients: 14/01/2020 21:11:02 Got 'ws' WebSockets handshake 14/01/2020 21:11:02 Got protocol: binary 14/01/2020 21:11:02 - webSocketsHandshake: using binary/raw encoding 14/01/2020 21:11:02 - WebSockets client version hybi-13 14/01/2020 21:11:02 Disabled X server key autorepeat. 14/01/2020 21:11:02 to force back on run: 'xset r on' (3 times) 14/01/2020 21:11:02 incr accepted_client=5 for 127.0.0.1:53144 sock=10 14/01/2020 21:11:02 Client Protocol Version 3.8 14/01/2020 21:11:02 Protocol version sent 3.8, using 3.8 14/01/2020 21:11:02 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 21:11:02 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 21:11:02 Pixel format for client 127.0.0.1: 14/01/2020 21:11:02 32 bpp, depth 24, little endian 14/01/2020 21:11:02 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 21:11:02 no translation needed 14/01/2020 21:11:02 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 21:11:02 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 21:11:02 Using image quality level 6 for client 127.0.0.1 14/01/2020 21:11:02 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 21:11:02 Using compression level 9 for client 127.0.0.1 14/01/2020 21:11:02 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 21:11:02 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 21:11:02 Using tight encoding for client 127.0.0.1 14/01/2020 21:11:02 client 5 network rate 320.7 KB/sec (52646.6 eff KB/sec) 14/01/2020 21:11:02 client 5 latency: 1.2 ms 14/01/2020 21:11:02 dt1: 0.0112, dt2: 0.0641 dt3: 0.0012 bytes: 23965 14/01/2020 21:11:02 link_rate: LR_LAN - 1 ms, 320 KB/s 14/01/2020 21:11:03 client_set_net: 127.0.0.1 0.0001 14/01/2020 21:11:03 active keyboard: turning X autorepeat off. 14/01/2020 21:11:03 created xdamage object: 0x400030 14/01/2020 21:16:03 idle keyboard: turning X autorepeat back on. 14/01/2020 21:21:05 got closure, reason 1001 14/01/2020 21:21:05 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 21:21:05 client_count: 0 14/01/2020 21:21:05 Client 127.0.0.1 gone 14/01/2020 21:21:05 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 21:21:05 FramebufferUpdate : 611 | 0/ 0 ( 0.0%) 14/01/2020 21:21:05 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 21:21:05 tight : 644 | 510341/ 5196848 ( 90.2%) 14/01/2020 21:21:05 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 21:21:05 TOTALS : 1257 | 511727/ 5198234 ( 90.2%) 14/01/2020 21:21:05 Statistics events Received/ RawEquiv ( saved) 14/01/2020 21:21:05 FramebufferUpdate : 612 | 6120/ 6120 ( 0.0%) 14/01/2020 21:21:05 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 21:21:05 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 21:21:05 TOTALS : 614 | 6196/ 6196 ( 0.0%) 14/01/2020 21:21:05 destroyed xdamage object: 0x400030 14/01/2020 21:22:16 Got connection from client 127.0.0.1 14/01/2020 21:22:16 other clients: 14/01/2020 21:22:16 Got 'ws' WebSockets handshake 14/01/2020 21:22:16 Got protocol: binary 14/01/2020 21:22:16 - webSocketsHandshake: using binary/raw encoding 14/01/2020 21:22:16 - WebSockets client version hybi-13 14/01/2020 21:22:16 Disabled X server key autorepeat. 14/01/2020 21:22:16 to force back on run: 'xset r on' (3 times) 14/01/2020 21:22:16 incr accepted_client=6 for 127.0.0.1:53480 sock=10 14/01/2020 21:22:16 Client Protocol Version 3.8 14/01/2020 21:22:16 Protocol version sent 3.8, using 3.8 14/01/2020 21:22:16 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 21:22:16 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 21:22:17 Pixel format for client 127.0.0.1: 14/01/2020 21:22:17 32 bpp, depth 24, little endian 14/01/2020 21:22:17 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 21:22:17 no translation needed 14/01/2020 21:22:17 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 21:22:17 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 21:22:17 Using image quality level 6 for client 127.0.0.1 14/01/2020 21:22:17 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 21:22:17 Using compression level 9 for client 127.0.0.1 14/01/2020 21:22:17 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 21:22:17 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 21:22:17 Using tight encoding for client 127.0.0.1 14/01/2020 21:22:17 client_set_net: 127.0.0.1 0.0001 14/01/2020 21:22:17 active keyboard: turning X autorepeat off. 14/01/2020 21:22:17 created xdamage object: 0x400031 14/01/2020 21:27:17 idle keyboard: turning X autorepeat back on. 14/01/2020 21:32:52 got closure, reason 1001 14/01/2020 21:32:52 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 21:32:52 client_count: 0 14/01/2020 21:32:52 Client 127.0.0.1 gone 14/01/2020 21:32:52 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 21:32:52 FramebufferUpdate : 880 | 0/ 0 ( 0.0%) 14/01/2020 21:32:52 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 21:32:52 tight : 909 | 678200/ 5614620 ( 87.9%) 14/01/2020 21:32:52 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 21:32:52 TOTALS : 1791 | 679586/ 5616006 ( 87.9%) 14/01/2020 21:32:52 Statistics events Received/ RawEquiv ( saved) 14/01/2020 21:32:52 PointerEvent : 71 | 426/ 426 ( 0.0%) 14/01/2020 21:32:52 FramebufferUpdate : 881 | 8810/ 8810 ( 0.0%) 14/01/2020 21:32:52 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 21:32:52 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 21:32:52 TOTALS : 954 | 9312/ 9312 ( 0.0%) 14/01/2020 21:32:52 destroyed xdamage object: 0x400031 Corrupt JPEG data: 524288 extraneous bytes before marker 0xdb 15/01/2020 07:31:12 Got connection from client 127.0.0.1 15/01/2020 07:31:12 other clients: 15/01/2020 07:31:12 Got 'ws' WebSockets handshake 15/01/2020 07:31:12 Got protocol: binary 15/01/2020 07:31:12 - webSocketsHandshake: using binary/raw encoding 15/01/2020 07:31:12 - WebSockets client version hybi-13 15/01/2020 07:31:12 Disabled X server key autorepeat. 15/01/2020 07:31:12 to force back on run: 'xset r on' (3 times) 15/01/2020 07:31:12 incr accepted_client=7 for 127.0.0.1:44222 sock=10 15/01/2020 07:31:12 Client Protocol Version 3.8 15/01/2020 07:31:12 Protocol version sent 3.8, using 3.8 15/01/2020 07:31:12 rfbProcessClientSecurityType: executing handler for type 1 15/01/2020 07:31:12 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 15/01/2020 07:31:12 Pixel format for client 127.0.0.1: 15/01/2020 07:31:12 32 bpp, depth 24, little endian 15/01/2020 07:31:12 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 15/01/2020 07:31:12 no translation needed 15/01/2020 07:31:12 Enabling NewFBSize protocol extension for client 127.0.0.1 15/01/2020 07:31:12 Using image quality level 6 for client 127.0.0.1 15/01/2020 07:31:12 Using JPEG subsampling 0, Q79 for client 127.0.0.1 15/01/2020 07:31:12 Using compression level 9 for client 127.0.0.1 15/01/2020 07:31:12 Enabling LastRect protocol extension for client 127.0.0.1 15/01/2020 07:31:12 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 15/01/2020 07:31:12 Using tight encoding for client 127.0.0.1 15/01/2020 07:31:14 client_set_net: 127.0.0.1 0.0000 15/01/2020 07:31:14 active keyboard: turning X autorepeat off. 15/01/2020 07:31:14 created xdamage object: 0x400032 15/01/2020 07:31:35 client 7 network rate 793.3 KB/sec (9893.3 eff KB/sec) 15/01/2020 07:31:35 client 7 latency: 2.3 ms 15/01/2020 07:31:35 dt1: 0.0027, dt2: 0.0174 dt3: 0.0023 bytes: 15096 15/01/2020 07:31:35 link_rate: LR_LAN - 2 ms, 793 KB/s 15/01/2020 07:38:00 idle keyboard: turning X autorepeat back on. 15/01/2020 07:45:03 got closure, reason 1001 15/01/2020 07:45:03 rfbProcessClientNormalMessage: read: Connection reset by peer 15/01/2020 07:45:03 client_count: 0 15/01/2020 07:45:03 Client 127.0.0.1 gone 15/01/2020 07:45:03 Statistics events Transmit/ RawEquiv ( saved) 15/01/2020 07:45:03 FramebufferUpdate : 546 | 0/ 0 ( 0.0%) 15/01/2020 07:45:03 LastRect : 35 | 420/ 420 ( 0.0%) 15/01/2020 07:45:03 tight : 1553 | 831284/ 11704724 ( 92.9%) 15/01/2020 07:45:03 TOTALS : 2134 | 831704/ 11705144 ( 92.9%) 15/01/2020 07:45:03 Statistics events Received/ RawEquiv ( saved) 15/01/2020 07:45:03 KeyEvent : 70 | 560/ 560 ( 0.0%) 15/01/2020 07:45:03 PointerEvent : 1112 | 6672/ 6672 ( 0.0%) 15/01/2020 07:45:03 FramebufferUpdate : 547 | 5470/ 5470 ( 0.0%) 15/01/2020 07:45:03 SetEncodings : 1 | 52/ 52 ( 0.0%) 15/01/2020 07:45:03 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 15/01/2020 07:45:03 TOTALS : 1731 | 12774/ 12774 ( 0.0%) 15/01/2020 07:45:06 destroyed xdamage object: 0x400032 15/01/2020 07:46:11 Got connection from client 127.0.0.1 15/01/2020 07:46:11 other clients: 15/01/2020 07:46:11 Got 'ws' WebSockets handshake 15/01/2020 07:46:11 Got protocol: binary 15/01/2020 07:46:11 - webSocketsHandshake: using binary/raw encoding 15/01/2020 07:46:11 - WebSockets client version hybi-13 15/01/2020 07:46:11 Disabled X server key autorepeat. 15/01/2020 07:46:11 to force back on run: 'xset r on' (3 times) 15/01/2020 07:46:11 incr accepted_client=8 for 127.0.0.1:44680 sock=10 15/01/2020 07:46:11 Client Protocol Version 3.8 15/01/2020 07:46:11 Protocol version sent 3.8, using 3.8 15/01/2020 07:46:11 rfbProcessClientSecurityType: executing handler for type 1 15/01/2020 07:46:11 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 15/01/2020 07:46:11 Pixel format for client 127.0.0.1: 15/01/2020 07:46:11 32 bpp, depth 24, little endian 15/01/2020 07:46:11 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 15/01/2020 07:46:11 no translation needed 15/01/2020 07:46:11 Enabling NewFBSize protocol extension for client 127.0.0.1 15/01/2020 07:46:11 Using image quality level 6 for client 127.0.0.1 15/01/2020 07:46:11 Using JPEG subsampling 0, Q79 for client 127.0.0.1 15/01/2020 07:46:11 Using compression level 9 for client 127.0.0.1 15/01/2020 07:46:11 Enabling LastRect protocol extension for client 127.0.0.1 15/01/2020 07:46:11 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 15/01/2020 07:46:11 Using tight encoding for client 127.0.0.1 15/01/2020 07:46:12 client_set_net: 127.0.0.1 0.0000 15/01/2020 07:46:12 active keyboard: turning X autorepeat off. 15/01/2020 07:46:12 created xdamage object: 0x400033 Quote Link to comment
Djoss Posted January 16, 2020 Author Share Posted January 16, 2020 11 hours ago, RadOD said: The dupeguru docker freezes after a fairly large task: 7.5 TiB, 534,090 files, 1,298 sub-folders -- all photos. Initially the task would cause the entire Unraid system to slow to a crawl and eventually hang. Logs showed memory allocation errors. I have 32GB so I added ran it with 16GB with the --memory option. The task ran without a hitch but hangs upon trying to take action at the end. Docker log (below) does not seem to show anything useful -- mainly VNC type stuff not dupeguru itself. System logs show nothing related. At the time of freeze up just a lot of 'Monitor: No array operation currently in progress'. It takes >24h to run, so trial and error here is not a good option. Is there a log someplace within the docker I should look to find errors thrown off by the dupeguru process itself? ErrorWarningSystemArrayLogin 14/01/2020 09:28:23 Protocol version sent 3.8, using 3.8 14/01/2020 09:28:23 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 09:28:23 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 09:28:23 Pixel format for client 127.0.0.1: 14/01/2020 09:28:23 32 bpp, depth 24, little endian 14/01/2020 09:28:23 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 09:28:23 no translation needed 14/01/2020 09:28:23 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 09:28:23 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 09:28:23 Using image quality level 6 for client 127.0.0.1 14/01/2020 09:28:23 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 09:28:23 Using compression level 9 for client 127.0.0.1 14/01/2020 09:28:23 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 09:28:23 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 09:28:23 Using tight encoding for client 127.0.0.1 14/01/2020 09:28:24 client 1 network rate 119.5 KB/sec (30840.4 eff KB/sec) 14/01/2020 09:28:24 client 1 latency: 1.5 ms 14/01/2020 09:28:24 dt1: 0.0043, dt2: 0.1240 dt3: 0.0015 bytes: 15237 14/01/2020 09:28:24 link_rate: LR_BROADBAND - 1 ms, 119 KB/s 14/01/2020 09:28:24 client_set_net: 127.0.0.1 0.0000 14/01/2020 09:28:24 created xdamage object: 0x40002c 14/01/2020 09:28:32 created selwin: 0x40002d 14/01/2020 09:28:32 called initialize_xfixes() 14/01/2020 09:28:33 copy_tiles: allocating first_line at size 41 14/01/2020 09:28:53 increased wireframe timeouts for slow network connection. 14/01/2020 09:28:53 netrate: 119 KB/sec, latency: 1 ms 14/01/2020 09:33:24 idle keyboard: turning X autorepeat back on. 14/01/2020 10:27:30 Got connection from client 127.0.0.1 14/01/2020 10:27:30 other clients: 14/01/2020 10:27:30 127.0.0.1 14/01/2020 10:27:30 Got 'ws' WebSockets handshake 14/01/2020 10:27:30 Got protocol: binary 14/01/2020 10:27:30 - webSocketsHandshake: using binary/raw encoding 14/01/2020 10:27:30 - WebSockets client version hybi-13 14/01/2020 10:27:30 incr accepted_client=2 for 127.0.0.1:33966 sock=11 14/01/2020 10:27:30 Client Protocol Version 3.8 14/01/2020 10:27:30 Protocol version sent 3.8, using 3.8 14/01/2020 10:27:30 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 10:27:30 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 10:27:30 Pixel format for client 127.0.0.1: 14/01/2020 10:27:30 32 bpp, depth 24, little endian 14/01/2020 10:27:30 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 10:27:30 no translation needed 14/01/2020 10:27:30 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 10:27:30 Using image quality level 6 for client 127.0.0.1 14/01/2020 10:27:30 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 10:27:30 Using compression level 9 for client 127.0.0.1 14/01/2020 10:27:30 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 10:27:30 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 10:27:30 Using tight encoding for client 127.0.0.1 14/01/2020 10:27:30 client 2 network rate 217.9 KB/sec (38794.9 eff KB/sec) 14/01/2020 10:27:30 client 2 latency: 2.7 ms 14/01/2020 10:27:30 dt1: 0.0090, dt2: 0.0937 dt3: 0.0027 bytes: 22084 14/01/2020 10:27:30 link_rate: LR_BROADBAND - 2 ms, 119 KB/s 14/01/2020 10:27:30 client_set_net: 127.0.0.1 0.0001 14/01/2020 10:27:31 active keyboard: turning X autorepeat off. 14/01/2020 10:29:14 client_count: 1 14/01/2020 10:29:14 Client 127.0.0.1 gone 14/01/2020 10:29:14 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 10:29:14 FramebufferUpdate : 105 | 0/ 0 ( 0.0%) 14/01/2020 10:29:14 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 10:29:14 tight : 193 | 73124/ 4117772 ( 98.2%) 14/01/2020 10:29:14 TOTALS : 299 | 73136/ 4117784 ( 98.2%) 14/01/2020 10:29:14 Statistics events Received/ RawEquiv ( saved) 14/01/2020 10:29:14 PointerEvent : 43 | 258/ 258 ( 0.0%) 14/01/2020 10:29:14 FramebufferUpdate : 106 | 1060/ 1060 ( 0.0%) 14/01/2020 10:29:14 SetEncodings : 1 | 52/ 52 ( 0.0%) 14/01/2020 10:29:14 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 10:29:14 TOTALS : 151 | 1390/ 1390 ( 0.0%) 14/01/2020 10:29:53 got closure, reason 1001 14/01/2020 10:29:53 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 10:29:53 client_count: 0 14/01/2020 10:29:53 Restored X server key autorepeat to: 1 14/01/2020 10:29:53 Client 127.0.0.1 gone 14/01/2020 10:29:53 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 10:29:53 ServerCutText : 1 | 8/ 8 ( 0.0%) 14/01/2020 10:29:53 FramebufferUpdate : 2738 | 0/ 0 ( 0.0%) 14/01/2020 10:29:53 copyRect : 1 | 16/ 691824 (100.0%) 14/01/2020 10:29:53 LastRect : 43 | 516/ 516 ( 0.0%) 14/01/2020 10:29:53 tight : 2997 | 1844512/ 13936412 ( 86.8%) 14/01/2020 10:29:53 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 10:29:53 TOTALS : 5781 | 1846426/ 14630134 ( 87.4%) 14/01/2020 10:29:53 Statistics events Received/ RawEquiv ( saved) 14/01/2020 10:29:53 PointerEvent : 1687 | 10122/ 10122 ( 0.0%) 14/01/2020 10:29:53 FramebufferUpdate : 2741 | 27410/ 27410 ( 0.0%) 14/01/2020 10:29:53 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 10:29:53 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 10:29:53 TOTALS : 4430 | 37608/ 37608 ( 0.0%) 14/01/2020 10:29:53 destroyed xdamage object: 0x40002c 14/01/2020 18:29:20 Got connection from client 127.0.0.1 14/01/2020 18:29:20 other clients: 14/01/2020 18:29:20 Got 'ws' WebSockets handshake 14/01/2020 18:29:20 Got protocol: binary 14/01/2020 18:29:20 - webSocketsHandshake: using binary/raw encoding 14/01/2020 18:29:20 - WebSockets client version hybi-13 14/01/2020 18:29:20 Disabled X server key autorepeat. 14/01/2020 18:29:20 to force back on run: 'xset r on' (3 times) 14/01/2020 18:29:20 incr accepted_client=3 for 127.0.0.1:48316 sock=10 14/01/2020 18:29:20 Client Protocol Version 3.8 14/01/2020 18:29:20 Protocol version sent 3.8, using 3.8 14/01/2020 18:29:20 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 18:29:20 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 18:29:21 Pixel format for client 127.0.0.1: 14/01/2020 18:29:21 32 bpp, depth 24, little endian 14/01/2020 18:29:21 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 18:29:21 no translation needed 14/01/2020 18:29:21 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 18:29:21 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 18:29:21 Using image quality level 6 for client 127.0.0.1 14/01/2020 18:29:21 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 18:29:21 Using compression level 9 for client 127.0.0.1 14/01/2020 18:29:21 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 18:29:21 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 18:29:21 Using tight encoding for client 127.0.0.1 14/01/2020 18:29:25 client_set_net: 127.0.0.1 0.0000 14/01/2020 18:29:25 created xdamage object: 0x40002e 14/01/2020 18:34:21 idle keyboard: turning X autorepeat back on. 14/01/2020 19:29:21 got closure, reason 1001 14/01/2020 19:29:21 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 19:29:21 client_count: 0 14/01/2020 19:29:21 Client 127.0.0.1 gone 14/01/2020 19:29:21 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 19:29:21 FramebufferUpdate : 2726 | 0/ 0 ( 0.0%) 14/01/2020 19:29:21 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 19:29:21 tight : 2780 | 2546996/ 10724048 ( 76.2%) 14/01/2020 19:29:21 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 19:29:21 TOTALS : 5508 | 2548382/ 10725434 ( 76.2%) 14/01/2020 19:29:21 Statistics events Received/ RawEquiv ( saved) 14/01/2020 19:29:21 FramebufferUpdate : 2728 | 27280/ 27280 ( 0.0%) 14/01/2020 19:29:21 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 19:29:21 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 19:29:21 TOTALS : 2730 | 27356/ 27356 ( 0.0%) 14/01/2020 19:29:21 destroyed xdamage object: 0x40002e 14/01/2020 21:00:06 Got connection from client 127.0.0.1 14/01/2020 21:00:06 other clients: 14/01/2020 21:00:06 Got 'ws' WebSockets handshake 14/01/2020 21:00:06 Got protocol: binary 14/01/2020 21:00:06 - webSocketsHandshake: using binary/raw encoding 14/01/2020 21:00:06 - WebSockets client version hybi-13 14/01/2020 21:00:06 Disabled X server key autorepeat. 14/01/2020 21:00:06 to force back on run: 'xset r on' (3 times) 14/01/2020 21:00:06 incr accepted_client=4 for 127.0.0.1:52812 sock=10 14/01/2020 21:00:06 Client Protocol Version 3.8 14/01/2020 21:00:06 Protocol version sent 3.8, using 3.8 14/01/2020 21:00:06 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 21:00:06 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 21:00:06 Pixel format for client 127.0.0.1: 14/01/2020 21:00:06 32 bpp, depth 24, little endian 14/01/2020 21:00:06 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 21:00:06 no translation needed 14/01/2020 21:00:06 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 21:00:06 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 21:00:06 Using image quality level 6 for client 127.0.0.1 14/01/2020 21:00:06 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 21:00:06 Using compression level 9 for client 127.0.0.1 14/01/2020 21:00:06 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 21:00:06 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 21:00:06 Using tight encoding for client 127.0.0.1 14/01/2020 21:00:10 client_set_net: 127.0.0.1 0.0000 14/01/2020 21:00:10 active keyboard: turning X autorepeat off. 14/01/2020 21:00:10 created xdamage object: 0x40002f 14/01/2020 21:05:08 idle keyboard: turning X autorepeat back on. 14/01/2020 21:10:09 got closure, reason 1001 14/01/2020 21:10:09 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 21:10:09 client_count: 0 14/01/2020 21:10:09 Client 127.0.0.1 gone 14/01/2020 21:10:09 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 21:10:09 FramebufferUpdate : 388 | 0/ 0 ( 0.0%) 14/01/2020 21:10:09 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 21:10:09 tight : 421 | 408370/ 4929724 ( 91.7%) 14/01/2020 21:10:09 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 21:10:09 TOTALS : 811 | 409756/ 4931110 ( 91.7%) 14/01/2020 21:10:09 Statistics events Received/ RawEquiv ( saved) 14/01/2020 21:10:09 FramebufferUpdate : 389 | 3890/ 3890 ( 0.0%) 14/01/2020 21:10:09 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 21:10:09 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 21:10:09 TOTALS : 391 | 3966/ 3966 ( 0.0%) 14/01/2020 21:10:09 destroyed xdamage object: 0x40002f 14/01/2020 21:11:02 Got connection from client 127.0.0.1 14/01/2020 21:11:02 other clients: 14/01/2020 21:11:02 Got 'ws' WebSockets handshake 14/01/2020 21:11:02 Got protocol: binary 14/01/2020 21:11:02 - webSocketsHandshake: using binary/raw encoding 14/01/2020 21:11:02 - WebSockets client version hybi-13 14/01/2020 21:11:02 Disabled X server key autorepeat. 14/01/2020 21:11:02 to force back on run: 'xset r on' (3 times) 14/01/2020 21:11:02 incr accepted_client=5 for 127.0.0.1:53144 sock=10 14/01/2020 21:11:02 Client Protocol Version 3.8 14/01/2020 21:11:02 Protocol version sent 3.8, using 3.8 14/01/2020 21:11:02 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 21:11:02 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 21:11:02 Pixel format for client 127.0.0.1: 14/01/2020 21:11:02 32 bpp, depth 24, little endian 14/01/2020 21:11:02 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 21:11:02 no translation needed 14/01/2020 21:11:02 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 21:11:02 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 21:11:02 Using image quality level 6 for client 127.0.0.1 14/01/2020 21:11:02 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 21:11:02 Using compression level 9 for client 127.0.0.1 14/01/2020 21:11:02 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 21:11:02 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 21:11:02 Using tight encoding for client 127.0.0.1 14/01/2020 21:11:02 client 5 network rate 320.7 KB/sec (52646.6 eff KB/sec) 14/01/2020 21:11:02 client 5 latency: 1.2 ms 14/01/2020 21:11:02 dt1: 0.0112, dt2: 0.0641 dt3: 0.0012 bytes: 23965 14/01/2020 21:11:02 link_rate: LR_LAN - 1 ms, 320 KB/s 14/01/2020 21:11:03 client_set_net: 127.0.0.1 0.0001 14/01/2020 21:11:03 active keyboard: turning X autorepeat off. 14/01/2020 21:11:03 created xdamage object: 0x400030 14/01/2020 21:16:03 idle keyboard: turning X autorepeat back on. 14/01/2020 21:21:05 got closure, reason 1001 14/01/2020 21:21:05 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 21:21:05 client_count: 0 14/01/2020 21:21:05 Client 127.0.0.1 gone 14/01/2020 21:21:05 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 21:21:05 FramebufferUpdate : 611 | 0/ 0 ( 0.0%) 14/01/2020 21:21:05 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 21:21:05 tight : 644 | 510341/ 5196848 ( 90.2%) 14/01/2020 21:21:05 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 21:21:05 TOTALS : 1257 | 511727/ 5198234 ( 90.2%) 14/01/2020 21:21:05 Statistics events Received/ RawEquiv ( saved) 14/01/2020 21:21:05 FramebufferUpdate : 612 | 6120/ 6120 ( 0.0%) 14/01/2020 21:21:05 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 21:21:05 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 21:21:05 TOTALS : 614 | 6196/ 6196 ( 0.0%) 14/01/2020 21:21:05 destroyed xdamage object: 0x400030 14/01/2020 21:22:16 Got connection from client 127.0.0.1 14/01/2020 21:22:16 other clients: 14/01/2020 21:22:16 Got 'ws' WebSockets handshake 14/01/2020 21:22:16 Got protocol: binary 14/01/2020 21:22:16 - webSocketsHandshake: using binary/raw encoding 14/01/2020 21:22:16 - WebSockets client version hybi-13 14/01/2020 21:22:16 Disabled X server key autorepeat. 14/01/2020 21:22:16 to force back on run: 'xset r on' (3 times) 14/01/2020 21:22:16 incr accepted_client=6 for 127.0.0.1:53480 sock=10 14/01/2020 21:22:16 Client Protocol Version 3.8 14/01/2020 21:22:16 Protocol version sent 3.8, using 3.8 14/01/2020 21:22:16 rfbProcessClientSecurityType: executing handler for type 1 14/01/2020 21:22:16 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 14/01/2020 21:22:17 Pixel format for client 127.0.0.1: 14/01/2020 21:22:17 32 bpp, depth 24, little endian 14/01/2020 21:22:17 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 14/01/2020 21:22:17 no translation needed 14/01/2020 21:22:17 Enabling NewFBSize protocol extension for client 127.0.0.1 14/01/2020 21:22:17 Enabling full-color cursor updates for client 127.0.0.1 14/01/2020 21:22:17 Using image quality level 6 for client 127.0.0.1 14/01/2020 21:22:17 Using JPEG subsampling 0, Q79 for client 127.0.0.1 14/01/2020 21:22:17 Using compression level 9 for client 127.0.0.1 14/01/2020 21:22:17 Enabling LastRect protocol extension for client 127.0.0.1 14/01/2020 21:22:17 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 14/01/2020 21:22:17 Using tight encoding for client 127.0.0.1 14/01/2020 21:22:17 client_set_net: 127.0.0.1 0.0001 14/01/2020 21:22:17 active keyboard: turning X autorepeat off. 14/01/2020 21:22:17 created xdamage object: 0x400031 14/01/2020 21:27:17 idle keyboard: turning X autorepeat back on. 14/01/2020 21:32:52 got closure, reason 1001 14/01/2020 21:32:52 rfbProcessClientNormalMessage: read: Connection reset by peer 14/01/2020 21:32:52 client_count: 0 14/01/2020 21:32:52 Client 127.0.0.1 gone 14/01/2020 21:32:52 Statistics events Transmit/ RawEquiv ( saved) 14/01/2020 21:32:52 FramebufferUpdate : 880 | 0/ 0 ( 0.0%) 14/01/2020 21:32:52 LastRect : 1 | 12/ 12 ( 0.0%) 14/01/2020 21:32:52 tight : 909 | 678200/ 5614620 ( 87.9%) 14/01/2020 21:32:52 RichCursor : 1 | 1374/ 1374 ( 0.0%) 14/01/2020 21:32:52 TOTALS : 1791 | 679586/ 5616006 ( 87.9%) 14/01/2020 21:32:52 Statistics events Received/ RawEquiv ( saved) 14/01/2020 21:32:52 PointerEvent : 71 | 426/ 426 ( 0.0%) 14/01/2020 21:32:52 FramebufferUpdate : 881 | 8810/ 8810 ( 0.0%) 14/01/2020 21:32:52 SetEncodings : 1 | 56/ 56 ( 0.0%) 14/01/2020 21:32:52 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 14/01/2020 21:32:52 TOTALS : 954 | 9312/ 9312 ( 0.0%) 14/01/2020 21:32:52 destroyed xdamage object: 0x400031 Corrupt JPEG data: 524288 extraneous bytes before marker 0xdb 15/01/2020 07:31:12 Got connection from client 127.0.0.1 15/01/2020 07:31:12 other clients: 15/01/2020 07:31:12 Got 'ws' WebSockets handshake 15/01/2020 07:31:12 Got protocol: binary 15/01/2020 07:31:12 - webSocketsHandshake: using binary/raw encoding 15/01/2020 07:31:12 - WebSockets client version hybi-13 15/01/2020 07:31:12 Disabled X server key autorepeat. 15/01/2020 07:31:12 to force back on run: 'xset r on' (3 times) 15/01/2020 07:31:12 incr accepted_client=7 for 127.0.0.1:44222 sock=10 15/01/2020 07:31:12 Client Protocol Version 3.8 15/01/2020 07:31:12 Protocol version sent 3.8, using 3.8 15/01/2020 07:31:12 rfbProcessClientSecurityType: executing handler for type 1 15/01/2020 07:31:12 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 15/01/2020 07:31:12 Pixel format for client 127.0.0.1: 15/01/2020 07:31:12 32 bpp, depth 24, little endian 15/01/2020 07:31:12 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 15/01/2020 07:31:12 no translation needed 15/01/2020 07:31:12 Enabling NewFBSize protocol extension for client 127.0.0.1 15/01/2020 07:31:12 Using image quality level 6 for client 127.0.0.1 15/01/2020 07:31:12 Using JPEG subsampling 0, Q79 for client 127.0.0.1 15/01/2020 07:31:12 Using compression level 9 for client 127.0.0.1 15/01/2020 07:31:12 Enabling LastRect protocol extension for client 127.0.0.1 15/01/2020 07:31:12 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 15/01/2020 07:31:12 Using tight encoding for client 127.0.0.1 15/01/2020 07:31:14 client_set_net: 127.0.0.1 0.0000 15/01/2020 07:31:14 active keyboard: turning X autorepeat off. 15/01/2020 07:31:14 created xdamage object: 0x400032 15/01/2020 07:31:35 client 7 network rate 793.3 KB/sec (9893.3 eff KB/sec) 15/01/2020 07:31:35 client 7 latency: 2.3 ms 15/01/2020 07:31:35 dt1: 0.0027, dt2: 0.0174 dt3: 0.0023 bytes: 15096 15/01/2020 07:31:35 link_rate: LR_LAN - 2 ms, 793 KB/s 15/01/2020 07:38:00 idle keyboard: turning X autorepeat back on. 15/01/2020 07:45:03 got closure, reason 1001 15/01/2020 07:45:03 rfbProcessClientNormalMessage: read: Connection reset by peer 15/01/2020 07:45:03 client_count: 0 15/01/2020 07:45:03 Client 127.0.0.1 gone 15/01/2020 07:45:03 Statistics events Transmit/ RawEquiv ( saved) 15/01/2020 07:45:03 FramebufferUpdate : 546 | 0/ 0 ( 0.0%) 15/01/2020 07:45:03 LastRect : 35 | 420/ 420 ( 0.0%) 15/01/2020 07:45:03 tight : 1553 | 831284/ 11704724 ( 92.9%) 15/01/2020 07:45:03 TOTALS : 2134 | 831704/ 11705144 ( 92.9%) 15/01/2020 07:45:03 Statistics events Received/ RawEquiv ( saved) 15/01/2020 07:45:03 KeyEvent : 70 | 560/ 560 ( 0.0%) 15/01/2020 07:45:03 PointerEvent : 1112 | 6672/ 6672 ( 0.0%) 15/01/2020 07:45:03 FramebufferUpdate : 547 | 5470/ 5470 ( 0.0%) 15/01/2020 07:45:03 SetEncodings : 1 | 52/ 52 ( 0.0%) 15/01/2020 07:45:03 SetPixelFormat : 1 | 20/ 20 ( 0.0%) 15/01/2020 07:45:03 TOTALS : 1731 | 12774/ 12774 ( 0.0%) 15/01/2020 07:45:06 destroyed xdamage object: 0x400032 15/01/2020 07:46:11 Got connection from client 127.0.0.1 15/01/2020 07:46:11 other clients: 15/01/2020 07:46:11 Got 'ws' WebSockets handshake 15/01/2020 07:46:11 Got protocol: binary 15/01/2020 07:46:11 - webSocketsHandshake: using binary/raw encoding 15/01/2020 07:46:11 - WebSockets client version hybi-13 15/01/2020 07:46:11 Disabled X server key autorepeat. 15/01/2020 07:46:11 to force back on run: 'xset r on' (3 times) 15/01/2020 07:46:11 incr accepted_client=8 for 127.0.0.1:44680 sock=10 15/01/2020 07:46:11 Client Protocol Version 3.8 15/01/2020 07:46:11 Protocol version sent 3.8, using 3.8 15/01/2020 07:46:11 rfbProcessClientSecurityType: executing handler for type 1 15/01/2020 07:46:11 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8 15/01/2020 07:46:11 Pixel format for client 127.0.0.1: 15/01/2020 07:46:11 32 bpp, depth 24, little endian 15/01/2020 07:46:11 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0 15/01/2020 07:46:11 no translation needed 15/01/2020 07:46:11 Enabling NewFBSize protocol extension for client 127.0.0.1 15/01/2020 07:46:11 Using image quality level 6 for client 127.0.0.1 15/01/2020 07:46:11 Using JPEG subsampling 0, Q79 for client 127.0.0.1 15/01/2020 07:46:11 Using compression level 9 for client 127.0.0.1 15/01/2020 07:46:11 Enabling LastRect protocol extension for client 127.0.0.1 15/01/2020 07:46:11 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC) 15/01/2020 07:46:11 Using tight encoding for client 127.0.0.1 15/01/2020 07:46:12 client_set_net: 127.0.0.1 0.0000 15/01/2020 07:46:12 active keyboard: turning X autorepeat off. 15/01/2020 07:46:12 created xdamage object: 0x400033 If there is any error from dupeGuru, they should appear in the container's log. So dupeGuru is able to successfully identify duplicates, but it freeze when you apply an action? Which action (and its settings) are you applying and on how many files? Quote Link to comment
RadOD Posted January 22, 2020 Share Posted January 22, 2020 I found a workaround - I was able to save the results quickly then it immediately froze. Restarting the container and loading the results works with none of the previous issues and a was able to mark, move and delete without any issues. As far as errors in the container's log - unless I'm mistaken, that was the container's log that I posted. And before setting the memory variable I did see lots of malloc errors there. But I see nothing in that log that helps. Quote Link to comment
zejohn Posted March 22, 2020 Share Posted March 22, 2020 I just had a 30TB scan with dupeguru and once it finished, the results are no where to be found. When I click view, the "Results Window" button is greyed out. Anyone know what's going on? The scan took 4 days so I'd prefer not to do this again. Also, when I press Scan on a new scan thinking that the scan didn't actually work, it says that I currently have unsaved results, but I have no idea where to find them. What should I do? Quote Link to comment
Djoss Posted March 26, 2020 Author Share Posted March 26, 2020 On 3/21/2020 at 9:16 PM, zejohn said: I just had a 30TB scan with dupeguru and once it finished, the results are no where to be found. When I click view, the "Results Window" button is greyed out. Anyone know what's going on? The scan took 4 days so I'd prefer not to do this again. Also, when I press Scan on a new scan thinking that the scan didn't actually work, it says that I currently have unsaved results, but I have no idea where to find them. What should I do? Sorry, not sure what happened, maybe a glitch with dupeGuru itself... Quote Link to comment
dadarara Posted August 24, 2020 Share Posted August 24, 2020 Hi Also have the same issue as above. after a day of running and showing progress (finding more than 4000 matches) it just stops and no results are shown. I left it sitting idle , thinking it maybe doing something. but eventually I was just able to push the Scan again and it starts scanning. and the cycle is the same. no results after the scan. any idea? where should I look for the logs? Quote Link to comment
BVD Posted September 16, 2020 Share Posted September 16, 2020 On 3/21/2020 at 8:16 PM, zejohn said: I just had a 30TB scan with dupeguru and once it finished, the results are no where to be found. When I click view, the "Results Window" button is greyed out. Anyone know what's going on? The scan took 4 days so I'd prefer not to do this again. Also, when I press Scan on a new scan thinking that the scan didn't actually work, it says that I currently have unsaved results, but I have no idea where to find them. What should I do? ____ I've just had the same issue on my first time running it - I reran it to see what went wrong, but mine only took something like 45 minutes or so across. Seems to happen when a significant amount of dupes are found and you close out the findings without taking any action initially (at least in my case). Quote Link to comment
RadOD Posted September 17, 2020 Share Posted September 17, 2020 I don't have an answer to your specific question, but hopefully this is helpful: I found DupeGuru's all-or-nothing results to be too unreliable and require too much user interaction. Instead, if you install the nerd pack plug in, there are two command line dupe checkers - fdupes and jdupes. Install either (reportedly jdupes is faster) and the user scripts plug in. Write a script to delete dupes and set it to run periodically. Or, a little more complicated, but you can create a script to move the dupes and create a log of what it did and you can review everything and manually delete. I can't access them right now, but I can post mine if anyone wants them. Quote Link to comment
Djoss Posted September 29, 2020 Author Share Posted September 29, 2020 You may also want to seek help on the project itself: https://github.com/arsenetar/dupeguru/issues Quote Link to comment
SPOautos Posted October 22, 2020 Share Posted October 22, 2020 On 9/16/2020 at 8:18 PM, RadOD said: I don't have an answer to your specific question, but hopefully this is helpful: I found DupeGuru's all-or-nothing results to be too unreliable and require too much user interaction. Instead, if you install the nerd pack plug in, there are two command line dupe checkers - fdupes and jdupes. Install either (reportedly jdupes is faster) and the user scripts plug in. Write a script to delete dupes and set it to run periodically. Or, a little more complicated, but you can create a script to move the dupes and create a log of what it did and you can review everything and manually delete. I can't access them right now, but I can post mine if anyone wants them. I'm going to try this app but if it doesnt work right (like others are experiencing), do you have any info regarding how to write the script for deleting duplicates? I can paste in a script but I have NO idea how to write one. Quote Link to comment
jtcweb Posted May 27, 2021 Share Posted May 27, 2021 (edited) I have a bunch of dup files that fix common problems found. However I can figure out how to do the initial scan with this tool. I think I need to select some directories to scan, but I can't find where to do that. Nevermind - I found the + in the lower left corner to add directories to scan. Edited May 27, 2021 by jtcweb Quote Link to comment
Zonediver Posted October 2, 2022 Share Posted October 2, 2022 Question: Is this Docker EOL? It doesnt work anymore... Quote Link to comment
Djoss Posted October 2, 2022 Author Share Posted October 2, 2022 38 minutes ago, Zonediver said: Question: Is this Docker EOL? It doesnt work anymore... What is the issue exactly ? I'm using it frequently and it works fine. Quote Link to comment
Zonediver Posted October 3, 2022 Share Posted October 3, 2022 (edited) 13 hours ago, Djoss said: What is the issue exactly ? I'm using it frequently and it works fine. When i open the GUI, its empty... no buttons or something else - a white Screen... EDIT: There is a Messag: Server disconnected (Code: 1006) Edited October 3, 2022 by Zonediver Quote Link to comment
Djoss Posted October 3, 2022 Author Share Posted October 3, 2022 3 hours ago, Zonediver said: When i open the GUI, its empty... no buttons or something else - a white Screen... EDIT: There is a Messag: Server disconnected (Code: 1006) Can you try to clear your browser's cache or try in an incognito/private window to see if it's working ? Quote Link to comment
Zonediver Posted October 3, 2022 Share Posted October 3, 2022 23 minutes ago, Djoss said: Can you try to clear your browser's cache or try in an incognito/private window to see if it's working ? It has something to do with FireFox... on Chrom, it works 👍 Quote Link to comment
Steviewunda Posted January 25, 2023 Share Posted January 25, 2023 Hi - does it make any difference whether disk shares are enabled or not? I have had them enabled, but I have read that I am less likely to screw up when moving data around if I disable disk shares, and work only with user shares. Does Dupeguru care whether disk shares are disabled or not? Quote Link to comment
Djoss Posted January 25, 2023 Author Share Posted January 25, 2023 With default container settings, dupeGuru works with data under /mnt/user. To my knowledge this is safe and you cannot screw up things. 1 Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.