[Support] Djoss - dupeGuru


Recommended Posts

Thanks for trying to help, Squid.  I just changed the port to 7902 and 8902 and went about my day.
 
J
Lol yeah, the older I get the more I realize that time is sometimes too precious to spend an hour to find out why something is not working right, and prefer to just fix it and move onto something more interesting

Sent via tapatalk because my boss won't let me sit in front of the computer all day long and it's beyond his comprehension that the only thing stopping me from putting a bullet in my head to get out of the lame ass job is the unraid forums :)

Link to comment
  • 2 weeks later...

Does anyone know of a way to get dupeguru to scan unassigned devices? I have a drive that holds a copy of my moives just incase something happens to unraid. But I think I have copies of movies I have deleted from plex still on the drive and also movies I have upgraded (bought the blu-ray version) and I just wanted to clean it up. If not, my only option is to delete all the files and recopy them back..  Any ideas?  Thanks in advance.

Link to comment
  • 6 months later...

Hi,

Is there a way to adjust the display of the results page? The height of the rows and displaying the files and the overall window size is squashed. I cannot make out the results properly without exporting them to .csv first, which is less than ideal.

 

I've tried looking in dupeGuru.conf file and adjusting some of the values for the layout. For example:

 

ResultWindowIsMaximized=true
ResultWindowRect=0, 40, 1280,30  (I've changed these figures already), they seem to get written back to their original values on restart.

Link to comment
16 hours ago, Geck0 said:

Hi,

Is there a way to adjust the display of the results page? The height of the rows and displaying the files and the overall window size is squashed. I cannot make out the results properly without exporting them to .csv first, which is less than ideal.

 

I've tried looking in dupeGuru.conf file and adjusting some of the values for the layout. For example:

 

ResultWindowIsMaximized=true
ResultWindowRect=0, 40, 1280,30  (I've changed these figures already), they seem to get written back to their original values on restart.

Did you try to increase the resolution of the window with "Display Width" and "Display Height" in container's settings?

Link to comment

The dupeguru docker freezes after a fairly large task: 7.5 TiB, 534,090 files, 1,298 sub-folders -- all photos.

 

Initially the task would cause the entire Unraid system to slow to a crawl and eventually hang.  Logs showed memory allocation errors.  I have 32GB so I added ran it with 16GB with the --memory option.  The task ran without a hitch but hangs upon trying to take action at the end.  Docker log (below) does not seem to show anything useful -- mainly VNC type stuff not dupeguru itself.  System logs show nothing related.  At the time of freeze up just a lot of 'Monitor: No array operation currently in progress'.

 

It takes >24h to run, so trial and error here is not a good option. Is there a log someplace within the docker I should look to find errors thrown off by the dupeguru process itself?

ErrorWarningSystemArrayLogin


14/01/2020 09:28:23 Protocol version sent 3.8, using 3.8

14/01/2020 09:28:23 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 09:28:23 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 09:28:23 Pixel format for client 127.0.0.1:
14/01/2020 09:28:23 32 bpp, depth 24, little endian
14/01/2020 09:28:23 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 09:28:23 no translation needed
14/01/2020 09:28:23 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 09:28:23 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 09:28:23 Using image quality level 6 for client 127.0.0.1
14/01/2020 09:28:23 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 09:28:23 Using compression level 9 for client 127.0.0.1
14/01/2020 09:28:23 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 09:28:23 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 09:28:23 Using tight encoding for client 127.0.0.1
14/01/2020 09:28:24 client 1 network rate 119.5 KB/sec (30840.4 eff KB/sec)
14/01/2020 09:28:24 client 1 latency: 1.5 ms
14/01/2020 09:28:24 dt1: 0.0043, dt2: 0.1240 dt3: 0.0015 bytes: 15237
14/01/2020 09:28:24 link_rate: LR_BROADBAND - 1 ms, 119 KB/s
14/01/2020 09:28:24 client_set_net: 127.0.0.1 0.0000
14/01/2020 09:28:24 created xdamage object: 0x40002c
14/01/2020 09:28:32 created selwin: 0x40002d
14/01/2020 09:28:32 called initialize_xfixes()
14/01/2020 09:28:33 copy_tiles: allocating first_line at size 41
14/01/2020 09:28:53 increased wireframe timeouts for slow network connection.
14/01/2020 09:28:53 netrate: 119 KB/sec, latency: 1 ms
14/01/2020 09:33:24 idle keyboard: turning X autorepeat back on.

14/01/2020 10:27:30 Got connection from client 127.0.0.1
14/01/2020 10:27:30 other clients:
14/01/2020 10:27:30 127.0.0.1
14/01/2020 10:27:30 Got 'ws' WebSockets handshake
14/01/2020 10:27:30 Got protocol: binary
14/01/2020 10:27:30 - webSocketsHandshake: using binary/raw encoding
14/01/2020 10:27:30 - WebSockets client version hybi-13

14/01/2020 10:27:30 incr accepted_client=2 for 127.0.0.1:33966 sock=11
14/01/2020 10:27:30 Client Protocol Version 3.8

14/01/2020 10:27:30 Protocol version sent 3.8, using 3.8

14/01/2020 10:27:30 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 10:27:30 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 10:27:30 Pixel format for client 127.0.0.1:
14/01/2020 10:27:30 32 bpp, depth 24, little endian
14/01/2020 10:27:30 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 10:27:30 no translation needed
14/01/2020 10:27:30 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 10:27:30 Using image quality level 6 for client 127.0.0.1
14/01/2020 10:27:30 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 10:27:30 Using compression level 9 for client 127.0.0.1
14/01/2020 10:27:30 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 10:27:30 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 10:27:30 Using tight encoding for client 127.0.0.1
14/01/2020 10:27:30 client 2 network rate 217.9 KB/sec (38794.9 eff KB/sec)
14/01/2020 10:27:30 client 2 latency: 2.7 ms
14/01/2020 10:27:30 dt1: 0.0090, dt2: 0.0937 dt3: 0.0027 bytes: 22084
14/01/2020 10:27:30 link_rate: LR_BROADBAND - 2 ms, 119 KB/s
14/01/2020 10:27:30 client_set_net: 127.0.0.1 0.0001
14/01/2020 10:27:31 active keyboard: turning X autorepeat off.

14/01/2020 10:29:14 client_count: 1
14/01/2020 10:29:14 Client 127.0.0.1 gone
14/01/2020 10:29:14 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 10:29:14 FramebufferUpdate : 105 | 0/ 0 ( 0.0%)
14/01/2020 10:29:14 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 10:29:14 tight : 193 | 73124/ 4117772 ( 98.2%)
14/01/2020 10:29:14 TOTALS : 299 | 73136/ 4117784 ( 98.2%)
14/01/2020 10:29:14 Statistics events Received/ RawEquiv ( saved)
14/01/2020 10:29:14 PointerEvent : 43 | 258/ 258 ( 0.0%)
14/01/2020 10:29:14 FramebufferUpdate : 106 | 1060/ 1060 ( 0.0%)
14/01/2020 10:29:14 SetEncodings : 1 | 52/ 52 ( 0.0%)
14/01/2020 10:29:14 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 10:29:14 TOTALS : 151 | 1390/ 1390 ( 0.0%)
14/01/2020 10:29:53 got closure, reason 1001
14/01/2020 10:29:53 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 10:29:53 client_count: 0
14/01/2020 10:29:53 Restored X server key autorepeat to: 1
14/01/2020 10:29:53 Client 127.0.0.1 gone
14/01/2020 10:29:53 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 10:29:53 ServerCutText : 1 | 8/ 8 ( 0.0%)
14/01/2020 10:29:53 FramebufferUpdate : 2738 | 0/ 0 ( 0.0%)
14/01/2020 10:29:53 copyRect : 1 | 16/ 691824 (100.0%)
14/01/2020 10:29:53 LastRect : 43 | 516/ 516 ( 0.0%)
14/01/2020 10:29:53 tight : 2997 | 1844512/ 13936412 ( 86.8%)
14/01/2020 10:29:53 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 10:29:53 TOTALS : 5781 | 1846426/ 14630134 ( 87.4%)
14/01/2020 10:29:53 Statistics events Received/ RawEquiv ( saved)
14/01/2020 10:29:53 PointerEvent : 1687 | 10122/ 10122 ( 0.0%)
14/01/2020 10:29:53 FramebufferUpdate : 2741 | 27410/ 27410 ( 0.0%)
14/01/2020 10:29:53 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 10:29:53 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 10:29:53 TOTALS : 4430 | 37608/ 37608 ( 0.0%)
14/01/2020 10:29:53 destroyed xdamage object: 0x40002c
14/01/2020 18:29:20 Got connection from client 127.0.0.1
14/01/2020 18:29:20 other clients:
14/01/2020 18:29:20 Got 'ws' WebSockets handshake
14/01/2020 18:29:20 Got protocol: binary
14/01/2020 18:29:20 - webSocketsHandshake: using binary/raw encoding
14/01/2020 18:29:20 - WebSockets client version hybi-13

14/01/2020 18:29:20 Disabled X server key autorepeat.
14/01/2020 18:29:20 to force back on run: 'xset r on' (3 times)
14/01/2020 18:29:20 incr accepted_client=3 for 127.0.0.1:48316 sock=10
14/01/2020 18:29:20 Client Protocol Version 3.8

14/01/2020 18:29:20 Protocol version sent 3.8, using 3.8

14/01/2020 18:29:20 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 18:29:20 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 18:29:21 Pixel format for client 127.0.0.1:
14/01/2020 18:29:21 32 bpp, depth 24, little endian
14/01/2020 18:29:21 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 18:29:21 no translation needed
14/01/2020 18:29:21 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 18:29:21 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 18:29:21 Using image quality level 6 for client 127.0.0.1
14/01/2020 18:29:21 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 18:29:21 Using compression level 9 for client 127.0.0.1
14/01/2020 18:29:21 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 18:29:21 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 18:29:21 Using tight encoding for client 127.0.0.1
14/01/2020 18:29:25 client_set_net: 127.0.0.1 0.0000
14/01/2020 18:29:25 created xdamage object: 0x40002e
14/01/2020 18:34:21 idle keyboard: turning X autorepeat back on.

14/01/2020 19:29:21 got closure, reason 1001
14/01/2020 19:29:21 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 19:29:21 client_count: 0
14/01/2020 19:29:21 Client 127.0.0.1 gone
14/01/2020 19:29:21 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 19:29:21 FramebufferUpdate : 2726 | 0/ 0 ( 0.0%)
14/01/2020 19:29:21 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 19:29:21 tight : 2780 | 2546996/ 10724048 ( 76.2%)
14/01/2020 19:29:21 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 19:29:21 TOTALS : 5508 | 2548382/ 10725434 ( 76.2%)
14/01/2020 19:29:21 Statistics events Received/ RawEquiv ( saved)
14/01/2020 19:29:21 FramebufferUpdate : 2728 | 27280/ 27280 ( 0.0%)
14/01/2020 19:29:21 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 19:29:21 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 19:29:21 TOTALS : 2730 | 27356/ 27356 ( 0.0%)
14/01/2020 19:29:21 destroyed xdamage object: 0x40002e
14/01/2020 21:00:06 Got connection from client 127.0.0.1
14/01/2020 21:00:06 other clients:
14/01/2020 21:00:06 Got 'ws' WebSockets handshake
14/01/2020 21:00:06 Got protocol: binary
14/01/2020 21:00:06 - webSocketsHandshake: using binary/raw encoding
14/01/2020 21:00:06 - WebSockets client version hybi-13

14/01/2020 21:00:06 Disabled X server key autorepeat.
14/01/2020 21:00:06 to force back on run: 'xset r on' (3 times)
14/01/2020 21:00:06 incr accepted_client=4 for 127.0.0.1:52812 sock=10
14/01/2020 21:00:06 Client Protocol Version 3.8

14/01/2020 21:00:06 Protocol version sent 3.8, using 3.8

14/01/2020 21:00:06 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 21:00:06 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 21:00:06 Pixel format for client 127.0.0.1:
14/01/2020 21:00:06 32 bpp, depth 24, little endian
14/01/2020 21:00:06 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 21:00:06 no translation needed
14/01/2020 21:00:06 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 21:00:06 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 21:00:06 Using image quality level 6 for client 127.0.0.1
14/01/2020 21:00:06 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 21:00:06 Using compression level 9 for client 127.0.0.1
14/01/2020 21:00:06 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 21:00:06 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 21:00:06 Using tight encoding for client 127.0.0.1
14/01/2020 21:00:10 client_set_net: 127.0.0.1 0.0000
14/01/2020 21:00:10 active keyboard: turning X autorepeat off.

14/01/2020 21:00:10 created xdamage object: 0x40002f
14/01/2020 21:05:08 idle keyboard: turning X autorepeat back on.

14/01/2020 21:10:09 got closure, reason 1001
14/01/2020 21:10:09 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 21:10:09 client_count: 0
14/01/2020 21:10:09 Client 127.0.0.1 gone
14/01/2020 21:10:09 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 21:10:09 FramebufferUpdate : 388 | 0/ 0 ( 0.0%)
14/01/2020 21:10:09 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 21:10:09 tight : 421 | 408370/ 4929724 ( 91.7%)
14/01/2020 21:10:09 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 21:10:09 TOTALS : 811 | 409756/ 4931110 ( 91.7%)
14/01/2020 21:10:09 Statistics events Received/ RawEquiv ( saved)
14/01/2020 21:10:09 FramebufferUpdate : 389 | 3890/ 3890 ( 0.0%)
14/01/2020 21:10:09 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 21:10:09 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 21:10:09 TOTALS : 391 | 3966/ 3966 ( 0.0%)
14/01/2020 21:10:09 destroyed xdamage object: 0x40002f
14/01/2020 21:11:02 Got connection from client 127.0.0.1
14/01/2020 21:11:02 other clients:
14/01/2020 21:11:02 Got 'ws' WebSockets handshake
14/01/2020 21:11:02 Got protocol: binary
14/01/2020 21:11:02 - webSocketsHandshake: using binary/raw encoding
14/01/2020 21:11:02 - WebSockets client version hybi-13

14/01/2020 21:11:02 Disabled X server key autorepeat.
14/01/2020 21:11:02 to force back on run: 'xset r on' (3 times)
14/01/2020 21:11:02 incr accepted_client=5 for 127.0.0.1:53144 sock=10
14/01/2020 21:11:02 Client Protocol Version 3.8

14/01/2020 21:11:02 Protocol version sent 3.8, using 3.8

14/01/2020 21:11:02 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 21:11:02 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 21:11:02 Pixel format for client 127.0.0.1:
14/01/2020 21:11:02 32 bpp, depth 24, little endian
14/01/2020 21:11:02 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 21:11:02 no translation needed
14/01/2020 21:11:02 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 21:11:02 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 21:11:02 Using image quality level 6 for client 127.0.0.1
14/01/2020 21:11:02 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 21:11:02 Using compression level 9 for client 127.0.0.1
14/01/2020 21:11:02 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 21:11:02 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 21:11:02 Using tight encoding for client 127.0.0.1
14/01/2020 21:11:02 client 5 network rate 320.7 KB/sec (52646.6 eff KB/sec)
14/01/2020 21:11:02 client 5 latency: 1.2 ms
14/01/2020 21:11:02 dt1: 0.0112, dt2: 0.0641 dt3: 0.0012 bytes: 23965
14/01/2020 21:11:02 link_rate: LR_LAN - 1 ms, 320 KB/s
14/01/2020 21:11:03 client_set_net: 127.0.0.1 0.0001
14/01/2020 21:11:03 active keyboard: turning X autorepeat off.

14/01/2020 21:11:03 created xdamage object: 0x400030
14/01/2020 21:16:03 idle keyboard: turning X autorepeat back on.

14/01/2020 21:21:05 got closure, reason 1001
14/01/2020 21:21:05 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 21:21:05 client_count: 0
14/01/2020 21:21:05 Client 127.0.0.1 gone
14/01/2020 21:21:05 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 21:21:05 FramebufferUpdate : 611 | 0/ 0 ( 0.0%)
14/01/2020 21:21:05 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 21:21:05 tight : 644 | 510341/ 5196848 ( 90.2%)
14/01/2020 21:21:05 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 21:21:05 TOTALS : 1257 | 511727/ 5198234 ( 90.2%)
14/01/2020 21:21:05 Statistics events Received/ RawEquiv ( saved)
14/01/2020 21:21:05 FramebufferUpdate : 612 | 6120/ 6120 ( 0.0%)
14/01/2020 21:21:05 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 21:21:05 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 21:21:05 TOTALS : 614 | 6196/ 6196 ( 0.0%)
14/01/2020 21:21:05 destroyed xdamage object: 0x400030
14/01/2020 21:22:16 Got connection from client 127.0.0.1
14/01/2020 21:22:16 other clients:
14/01/2020 21:22:16 Got 'ws' WebSockets handshake
14/01/2020 21:22:16 Got protocol: binary
14/01/2020 21:22:16 - webSocketsHandshake: using binary/raw encoding
14/01/2020 21:22:16 - WebSockets client version hybi-13

14/01/2020 21:22:16 Disabled X server key autorepeat.
14/01/2020 21:22:16 to force back on run: 'xset r on' (3 times)
14/01/2020 21:22:16 incr accepted_client=6 for 127.0.0.1:53480 sock=10
14/01/2020 21:22:16 Client Protocol Version 3.8

14/01/2020 21:22:16 Protocol version sent 3.8, using 3.8

14/01/2020 21:22:16 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 21:22:16 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 21:22:17 Pixel format for client 127.0.0.1:
14/01/2020 21:22:17 32 bpp, depth 24, little endian
14/01/2020 21:22:17 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 21:22:17 no translation needed
14/01/2020 21:22:17 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 21:22:17 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 21:22:17 Using image quality level 6 for client 127.0.0.1
14/01/2020 21:22:17 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 21:22:17 Using compression level 9 for client 127.0.0.1
14/01/2020 21:22:17 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 21:22:17 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 21:22:17 Using tight encoding for client 127.0.0.1
14/01/2020 21:22:17 client_set_net: 127.0.0.1 0.0001
14/01/2020 21:22:17 active keyboard: turning X autorepeat off.

14/01/2020 21:22:17 created xdamage object: 0x400031
14/01/2020 21:27:17 idle keyboard: turning X autorepeat back on.

14/01/2020 21:32:52 got closure, reason 1001
14/01/2020 21:32:52 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 21:32:52 client_count: 0
14/01/2020 21:32:52 Client 127.0.0.1 gone
14/01/2020 21:32:52 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 21:32:52 FramebufferUpdate : 880 | 0/ 0 ( 0.0%)
14/01/2020 21:32:52 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 21:32:52 tight : 909 | 678200/ 5614620 ( 87.9%)
14/01/2020 21:32:52 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 21:32:52 TOTALS : 1791 | 679586/ 5616006 ( 87.9%)
14/01/2020 21:32:52 Statistics events Received/ RawEquiv ( saved)
14/01/2020 21:32:52 PointerEvent : 71 | 426/ 426 ( 0.0%)
14/01/2020 21:32:52 FramebufferUpdate : 881 | 8810/ 8810 ( 0.0%)
14/01/2020 21:32:52 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 21:32:52 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 21:32:52 TOTALS : 954 | 9312/ 9312 ( 0.0%)
14/01/2020 21:32:52 destroyed xdamage object: 0x400031
Corrupt JPEG data: 524288 extraneous bytes before marker 0xdb
15/01/2020 07:31:12 Got connection from client 127.0.0.1
15/01/2020 07:31:12 other clients:
15/01/2020 07:31:12 Got 'ws' WebSockets handshake
15/01/2020 07:31:12 Got protocol: binary
15/01/2020 07:31:12 - webSocketsHandshake: using binary/raw encoding
15/01/2020 07:31:12 - WebSockets client version hybi-13

15/01/2020 07:31:12 Disabled X server key autorepeat.
15/01/2020 07:31:12 to force back on run: 'xset r on' (3 times)
15/01/2020 07:31:12 incr accepted_client=7 for 127.0.0.1:44222 sock=10
15/01/2020 07:31:12 Client Protocol Version 3.8

15/01/2020 07:31:12 Protocol version sent 3.8, using 3.8

15/01/2020 07:31:12 rfbProcessClientSecurityType: executing handler for type 1
15/01/2020 07:31:12 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

15/01/2020 07:31:12 Pixel format for client 127.0.0.1:
15/01/2020 07:31:12 32 bpp, depth 24, little endian
15/01/2020 07:31:12 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
15/01/2020 07:31:12 no translation needed
15/01/2020 07:31:12 Enabling NewFBSize protocol extension for client 127.0.0.1
15/01/2020 07:31:12 Using image quality level 6 for client 127.0.0.1
15/01/2020 07:31:12 Using JPEG subsampling 0, Q79 for client 127.0.0.1
15/01/2020 07:31:12 Using compression level 9 for client 127.0.0.1
15/01/2020 07:31:12 Enabling LastRect protocol extension for client 127.0.0.1
15/01/2020 07:31:12 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
15/01/2020 07:31:12 Using tight encoding for client 127.0.0.1
15/01/2020 07:31:14 client_set_net: 127.0.0.1 0.0000
15/01/2020 07:31:14 active keyboard: turning X autorepeat off.

15/01/2020 07:31:14 created xdamage object: 0x400032
15/01/2020 07:31:35 client 7 network rate 793.3 KB/sec (9893.3 eff KB/sec)
15/01/2020 07:31:35 client 7 latency: 2.3 ms
15/01/2020 07:31:35 dt1: 0.0027, dt2: 0.0174 dt3: 0.0023 bytes: 15096
15/01/2020 07:31:35 link_rate: LR_LAN - 2 ms, 793 KB/s
15/01/2020 07:38:00 idle keyboard: turning X autorepeat back on.

15/01/2020 07:45:03 got closure, reason 1001
15/01/2020 07:45:03 rfbProcessClientNormalMessage: read: Connection reset by peer
15/01/2020 07:45:03 client_count: 0
15/01/2020 07:45:03 Client 127.0.0.1 gone
15/01/2020 07:45:03 Statistics events Transmit/ RawEquiv ( saved)
15/01/2020 07:45:03 FramebufferUpdate : 546 | 0/ 0 ( 0.0%)
15/01/2020 07:45:03 LastRect : 35 | 420/ 420 ( 0.0%)
15/01/2020 07:45:03 tight : 1553 | 831284/ 11704724 ( 92.9%)
15/01/2020 07:45:03 TOTALS : 2134 | 831704/ 11705144 ( 92.9%)
15/01/2020 07:45:03 Statistics events Received/ RawEquiv ( saved)
15/01/2020 07:45:03 KeyEvent : 70 | 560/ 560 ( 0.0%)
15/01/2020 07:45:03 PointerEvent : 1112 | 6672/ 6672 ( 0.0%)
15/01/2020 07:45:03 FramebufferUpdate : 547 | 5470/ 5470 ( 0.0%)
15/01/2020 07:45:03 SetEncodings : 1 | 52/ 52 ( 0.0%)
15/01/2020 07:45:03 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
15/01/2020 07:45:03 TOTALS : 1731 | 12774/ 12774 ( 0.0%)
15/01/2020 07:45:06 destroyed xdamage object: 0x400032
15/01/2020 07:46:11 Got connection from client 127.0.0.1
15/01/2020 07:46:11 other clients:
15/01/2020 07:46:11 Got 'ws' WebSockets handshake
15/01/2020 07:46:11 Got protocol: binary
15/01/2020 07:46:11 - webSocketsHandshake: using binary/raw encoding
15/01/2020 07:46:11 - WebSockets client version hybi-13

15/01/2020 07:46:11 Disabled X server key autorepeat.
15/01/2020 07:46:11 to force back on run: 'xset r on' (3 times)
15/01/2020 07:46:11 incr accepted_client=8 for 127.0.0.1:44680 sock=10
15/01/2020 07:46:11 Client Protocol Version 3.8

15/01/2020 07:46:11 Protocol version sent 3.8, using 3.8

15/01/2020 07:46:11 rfbProcessClientSecurityType: executing handler for type 1
15/01/2020 07:46:11 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

15/01/2020 07:46:11 Pixel format for client 127.0.0.1:
15/01/2020 07:46:11 32 bpp, depth 24, little endian
15/01/2020 07:46:11 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
15/01/2020 07:46:11 no translation needed
15/01/2020 07:46:11 Enabling NewFBSize protocol extension for client 127.0.0.1
15/01/2020 07:46:11 Using image quality level 6 for client 127.0.0.1
15/01/2020 07:46:11 Using JPEG subsampling 0, Q79 for client 127.0.0.1
15/01/2020 07:46:11 Using compression level 9 for client 127.0.0.1
15/01/2020 07:46:11 Enabling LastRect protocol extension for client 127.0.0.1
15/01/2020 07:46:11 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
15/01/2020 07:46:11 Using tight encoding for client 127.0.0.1
15/01/2020 07:46:12 client_set_net: 127.0.0.1 0.0000
15/01/2020 07:46:12 active keyboard: turning X autorepeat off.

15/01/2020 07:46:12 created xdamage object: 0x400033

 

Link to comment
11 hours ago, RadOD said:

The dupeguru docker freezes after a fairly large task: 7.5 TiB, 534,090 files, 1,298 sub-folders -- all photos.

 

Initially the task would cause the entire Unraid system to slow to a crawl and eventually hang.  Logs showed memory allocation errors.  I have 32GB so I added ran it with 16GB with the --memory option.  The task ran without a hitch but hangs upon trying to take action at the end.  Docker log (below) does not seem to show anything useful -- mainly VNC type stuff not dupeguru itself.  System logs show nothing related.  At the time of freeze up just a lot of 'Monitor: No array operation currently in progress'.

 

It takes >24h to run, so trial and error here is not a good option. Is there a log someplace within the docker I should look to find errors thrown off by the dupeguru process itself?


ErrorWarningSystemArrayLogin


14/01/2020 09:28:23 Protocol version sent 3.8, using 3.8

14/01/2020 09:28:23 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 09:28:23 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 09:28:23 Pixel format for client 127.0.0.1:
14/01/2020 09:28:23 32 bpp, depth 24, little endian
14/01/2020 09:28:23 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 09:28:23 no translation needed
14/01/2020 09:28:23 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 09:28:23 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 09:28:23 Using image quality level 6 for client 127.0.0.1
14/01/2020 09:28:23 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 09:28:23 Using compression level 9 for client 127.0.0.1
14/01/2020 09:28:23 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 09:28:23 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 09:28:23 Using tight encoding for client 127.0.0.1
14/01/2020 09:28:24 client 1 network rate 119.5 KB/sec (30840.4 eff KB/sec)
14/01/2020 09:28:24 client 1 latency: 1.5 ms
14/01/2020 09:28:24 dt1: 0.0043, dt2: 0.1240 dt3: 0.0015 bytes: 15237
14/01/2020 09:28:24 link_rate: LR_BROADBAND - 1 ms, 119 KB/s
14/01/2020 09:28:24 client_set_net: 127.0.0.1 0.0000
14/01/2020 09:28:24 created xdamage object: 0x40002c
14/01/2020 09:28:32 created selwin: 0x40002d
14/01/2020 09:28:32 called initialize_xfixes()
14/01/2020 09:28:33 copy_tiles: allocating first_line at size 41
14/01/2020 09:28:53 increased wireframe timeouts for slow network connection.
14/01/2020 09:28:53 netrate: 119 KB/sec, latency: 1 ms
14/01/2020 09:33:24 idle keyboard: turning X autorepeat back on.

14/01/2020 10:27:30 Got connection from client 127.0.0.1
14/01/2020 10:27:30 other clients:
14/01/2020 10:27:30 127.0.0.1
14/01/2020 10:27:30 Got 'ws' WebSockets handshake
14/01/2020 10:27:30 Got protocol: binary
14/01/2020 10:27:30 - webSocketsHandshake: using binary/raw encoding
14/01/2020 10:27:30 - WebSockets client version hybi-13

14/01/2020 10:27:30 incr accepted_client=2 for 127.0.0.1:33966 sock=11
14/01/2020 10:27:30 Client Protocol Version 3.8

14/01/2020 10:27:30 Protocol version sent 3.8, using 3.8

14/01/2020 10:27:30 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 10:27:30 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 10:27:30 Pixel format for client 127.0.0.1:
14/01/2020 10:27:30 32 bpp, depth 24, little endian
14/01/2020 10:27:30 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 10:27:30 no translation needed
14/01/2020 10:27:30 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 10:27:30 Using image quality level 6 for client 127.0.0.1
14/01/2020 10:27:30 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 10:27:30 Using compression level 9 for client 127.0.0.1
14/01/2020 10:27:30 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 10:27:30 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 10:27:30 Using tight encoding for client 127.0.0.1
14/01/2020 10:27:30 client 2 network rate 217.9 KB/sec (38794.9 eff KB/sec)
14/01/2020 10:27:30 client 2 latency: 2.7 ms
14/01/2020 10:27:30 dt1: 0.0090, dt2: 0.0937 dt3: 0.0027 bytes: 22084
14/01/2020 10:27:30 link_rate: LR_BROADBAND - 2 ms, 119 KB/s
14/01/2020 10:27:30 client_set_net: 127.0.0.1 0.0001
14/01/2020 10:27:31 active keyboard: turning X autorepeat off.

14/01/2020 10:29:14 client_count: 1
14/01/2020 10:29:14 Client 127.0.0.1 gone
14/01/2020 10:29:14 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 10:29:14 FramebufferUpdate : 105 | 0/ 0 ( 0.0%)
14/01/2020 10:29:14 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 10:29:14 tight : 193 | 73124/ 4117772 ( 98.2%)
14/01/2020 10:29:14 TOTALS : 299 | 73136/ 4117784 ( 98.2%)
14/01/2020 10:29:14 Statistics events Received/ RawEquiv ( saved)
14/01/2020 10:29:14 PointerEvent : 43 | 258/ 258 ( 0.0%)
14/01/2020 10:29:14 FramebufferUpdate : 106 | 1060/ 1060 ( 0.0%)
14/01/2020 10:29:14 SetEncodings : 1 | 52/ 52 ( 0.0%)
14/01/2020 10:29:14 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 10:29:14 TOTALS : 151 | 1390/ 1390 ( 0.0%)
14/01/2020 10:29:53 got closure, reason 1001
14/01/2020 10:29:53 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 10:29:53 client_count: 0
14/01/2020 10:29:53 Restored X server key autorepeat to: 1
14/01/2020 10:29:53 Client 127.0.0.1 gone
14/01/2020 10:29:53 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 10:29:53 ServerCutText : 1 | 8/ 8 ( 0.0%)
14/01/2020 10:29:53 FramebufferUpdate : 2738 | 0/ 0 ( 0.0%)
14/01/2020 10:29:53 copyRect : 1 | 16/ 691824 (100.0%)
14/01/2020 10:29:53 LastRect : 43 | 516/ 516 ( 0.0%)
14/01/2020 10:29:53 tight : 2997 | 1844512/ 13936412 ( 86.8%)
14/01/2020 10:29:53 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 10:29:53 TOTALS : 5781 | 1846426/ 14630134 ( 87.4%)
14/01/2020 10:29:53 Statistics events Received/ RawEquiv ( saved)
14/01/2020 10:29:53 PointerEvent : 1687 | 10122/ 10122 ( 0.0%)
14/01/2020 10:29:53 FramebufferUpdate : 2741 | 27410/ 27410 ( 0.0%)
14/01/2020 10:29:53 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 10:29:53 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 10:29:53 TOTALS : 4430 | 37608/ 37608 ( 0.0%)
14/01/2020 10:29:53 destroyed xdamage object: 0x40002c
14/01/2020 18:29:20 Got connection from client 127.0.0.1
14/01/2020 18:29:20 other clients:
14/01/2020 18:29:20 Got 'ws' WebSockets handshake
14/01/2020 18:29:20 Got protocol: binary
14/01/2020 18:29:20 - webSocketsHandshake: using binary/raw encoding
14/01/2020 18:29:20 - WebSockets client version hybi-13

14/01/2020 18:29:20 Disabled X server key autorepeat.
14/01/2020 18:29:20 to force back on run: 'xset r on' (3 times)
14/01/2020 18:29:20 incr accepted_client=3 for 127.0.0.1:48316 sock=10
14/01/2020 18:29:20 Client Protocol Version 3.8

14/01/2020 18:29:20 Protocol version sent 3.8, using 3.8

14/01/2020 18:29:20 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 18:29:20 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 18:29:21 Pixel format for client 127.0.0.1:
14/01/2020 18:29:21 32 bpp, depth 24, little endian
14/01/2020 18:29:21 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 18:29:21 no translation needed
14/01/2020 18:29:21 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 18:29:21 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 18:29:21 Using image quality level 6 for client 127.0.0.1
14/01/2020 18:29:21 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 18:29:21 Using compression level 9 for client 127.0.0.1
14/01/2020 18:29:21 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 18:29:21 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 18:29:21 Using tight encoding for client 127.0.0.1
14/01/2020 18:29:25 client_set_net: 127.0.0.1 0.0000
14/01/2020 18:29:25 created xdamage object: 0x40002e
14/01/2020 18:34:21 idle keyboard: turning X autorepeat back on.

14/01/2020 19:29:21 got closure, reason 1001
14/01/2020 19:29:21 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 19:29:21 client_count: 0
14/01/2020 19:29:21 Client 127.0.0.1 gone
14/01/2020 19:29:21 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 19:29:21 FramebufferUpdate : 2726 | 0/ 0 ( 0.0%)
14/01/2020 19:29:21 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 19:29:21 tight : 2780 | 2546996/ 10724048 ( 76.2%)
14/01/2020 19:29:21 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 19:29:21 TOTALS : 5508 | 2548382/ 10725434 ( 76.2%)
14/01/2020 19:29:21 Statistics events Received/ RawEquiv ( saved)
14/01/2020 19:29:21 FramebufferUpdate : 2728 | 27280/ 27280 ( 0.0%)
14/01/2020 19:29:21 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 19:29:21 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 19:29:21 TOTALS : 2730 | 27356/ 27356 ( 0.0%)
14/01/2020 19:29:21 destroyed xdamage object: 0x40002e
14/01/2020 21:00:06 Got connection from client 127.0.0.1
14/01/2020 21:00:06 other clients:
14/01/2020 21:00:06 Got 'ws' WebSockets handshake
14/01/2020 21:00:06 Got protocol: binary
14/01/2020 21:00:06 - webSocketsHandshake: using binary/raw encoding
14/01/2020 21:00:06 - WebSockets client version hybi-13

14/01/2020 21:00:06 Disabled X server key autorepeat.
14/01/2020 21:00:06 to force back on run: 'xset r on' (3 times)
14/01/2020 21:00:06 incr accepted_client=4 for 127.0.0.1:52812 sock=10
14/01/2020 21:00:06 Client Protocol Version 3.8

14/01/2020 21:00:06 Protocol version sent 3.8, using 3.8

14/01/2020 21:00:06 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 21:00:06 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 21:00:06 Pixel format for client 127.0.0.1:
14/01/2020 21:00:06 32 bpp, depth 24, little endian
14/01/2020 21:00:06 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 21:00:06 no translation needed
14/01/2020 21:00:06 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 21:00:06 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 21:00:06 Using image quality level 6 for client 127.0.0.1
14/01/2020 21:00:06 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 21:00:06 Using compression level 9 for client 127.0.0.1
14/01/2020 21:00:06 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 21:00:06 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 21:00:06 Using tight encoding for client 127.0.0.1
14/01/2020 21:00:10 client_set_net: 127.0.0.1 0.0000
14/01/2020 21:00:10 active keyboard: turning X autorepeat off.

14/01/2020 21:00:10 created xdamage object: 0x40002f
14/01/2020 21:05:08 idle keyboard: turning X autorepeat back on.

14/01/2020 21:10:09 got closure, reason 1001
14/01/2020 21:10:09 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 21:10:09 client_count: 0
14/01/2020 21:10:09 Client 127.0.0.1 gone
14/01/2020 21:10:09 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 21:10:09 FramebufferUpdate : 388 | 0/ 0 ( 0.0%)
14/01/2020 21:10:09 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 21:10:09 tight : 421 | 408370/ 4929724 ( 91.7%)
14/01/2020 21:10:09 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 21:10:09 TOTALS : 811 | 409756/ 4931110 ( 91.7%)
14/01/2020 21:10:09 Statistics events Received/ RawEquiv ( saved)
14/01/2020 21:10:09 FramebufferUpdate : 389 | 3890/ 3890 ( 0.0%)
14/01/2020 21:10:09 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 21:10:09 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 21:10:09 TOTALS : 391 | 3966/ 3966 ( 0.0%)
14/01/2020 21:10:09 destroyed xdamage object: 0x40002f
14/01/2020 21:11:02 Got connection from client 127.0.0.1
14/01/2020 21:11:02 other clients:
14/01/2020 21:11:02 Got 'ws' WebSockets handshake
14/01/2020 21:11:02 Got protocol: binary
14/01/2020 21:11:02 - webSocketsHandshake: using binary/raw encoding
14/01/2020 21:11:02 - WebSockets client version hybi-13

14/01/2020 21:11:02 Disabled X server key autorepeat.
14/01/2020 21:11:02 to force back on run: 'xset r on' (3 times)
14/01/2020 21:11:02 incr accepted_client=5 for 127.0.0.1:53144 sock=10
14/01/2020 21:11:02 Client Protocol Version 3.8

14/01/2020 21:11:02 Protocol version sent 3.8, using 3.8

14/01/2020 21:11:02 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 21:11:02 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 21:11:02 Pixel format for client 127.0.0.1:
14/01/2020 21:11:02 32 bpp, depth 24, little endian
14/01/2020 21:11:02 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 21:11:02 no translation needed
14/01/2020 21:11:02 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 21:11:02 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 21:11:02 Using image quality level 6 for client 127.0.0.1
14/01/2020 21:11:02 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 21:11:02 Using compression level 9 for client 127.0.0.1
14/01/2020 21:11:02 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 21:11:02 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 21:11:02 Using tight encoding for client 127.0.0.1
14/01/2020 21:11:02 client 5 network rate 320.7 KB/sec (52646.6 eff KB/sec)
14/01/2020 21:11:02 client 5 latency: 1.2 ms
14/01/2020 21:11:02 dt1: 0.0112, dt2: 0.0641 dt3: 0.0012 bytes: 23965
14/01/2020 21:11:02 link_rate: LR_LAN - 1 ms, 320 KB/s
14/01/2020 21:11:03 client_set_net: 127.0.0.1 0.0001
14/01/2020 21:11:03 active keyboard: turning X autorepeat off.

14/01/2020 21:11:03 created xdamage object: 0x400030
14/01/2020 21:16:03 idle keyboard: turning X autorepeat back on.

14/01/2020 21:21:05 got closure, reason 1001
14/01/2020 21:21:05 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 21:21:05 client_count: 0
14/01/2020 21:21:05 Client 127.0.0.1 gone
14/01/2020 21:21:05 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 21:21:05 FramebufferUpdate : 611 | 0/ 0 ( 0.0%)
14/01/2020 21:21:05 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 21:21:05 tight : 644 | 510341/ 5196848 ( 90.2%)
14/01/2020 21:21:05 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 21:21:05 TOTALS : 1257 | 511727/ 5198234 ( 90.2%)
14/01/2020 21:21:05 Statistics events Received/ RawEquiv ( saved)
14/01/2020 21:21:05 FramebufferUpdate : 612 | 6120/ 6120 ( 0.0%)
14/01/2020 21:21:05 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 21:21:05 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 21:21:05 TOTALS : 614 | 6196/ 6196 ( 0.0%)
14/01/2020 21:21:05 destroyed xdamage object: 0x400030
14/01/2020 21:22:16 Got connection from client 127.0.0.1
14/01/2020 21:22:16 other clients:
14/01/2020 21:22:16 Got 'ws' WebSockets handshake
14/01/2020 21:22:16 Got protocol: binary
14/01/2020 21:22:16 - webSocketsHandshake: using binary/raw encoding
14/01/2020 21:22:16 - WebSockets client version hybi-13

14/01/2020 21:22:16 Disabled X server key autorepeat.
14/01/2020 21:22:16 to force back on run: 'xset r on' (3 times)
14/01/2020 21:22:16 incr accepted_client=6 for 127.0.0.1:53480 sock=10
14/01/2020 21:22:16 Client Protocol Version 3.8

14/01/2020 21:22:16 Protocol version sent 3.8, using 3.8

14/01/2020 21:22:16 rfbProcessClientSecurityType: executing handler for type 1
14/01/2020 21:22:16 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

14/01/2020 21:22:17 Pixel format for client 127.0.0.1:
14/01/2020 21:22:17 32 bpp, depth 24, little endian
14/01/2020 21:22:17 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
14/01/2020 21:22:17 no translation needed
14/01/2020 21:22:17 Enabling NewFBSize protocol extension for client 127.0.0.1
14/01/2020 21:22:17 Enabling full-color cursor updates for client 127.0.0.1
14/01/2020 21:22:17 Using image quality level 6 for client 127.0.0.1
14/01/2020 21:22:17 Using JPEG subsampling 0, Q79 for client 127.0.0.1
14/01/2020 21:22:17 Using compression level 9 for client 127.0.0.1
14/01/2020 21:22:17 Enabling LastRect protocol extension for client 127.0.0.1
14/01/2020 21:22:17 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
14/01/2020 21:22:17 Using tight encoding for client 127.0.0.1
14/01/2020 21:22:17 client_set_net: 127.0.0.1 0.0001
14/01/2020 21:22:17 active keyboard: turning X autorepeat off.

14/01/2020 21:22:17 created xdamage object: 0x400031
14/01/2020 21:27:17 idle keyboard: turning X autorepeat back on.

14/01/2020 21:32:52 got closure, reason 1001
14/01/2020 21:32:52 rfbProcessClientNormalMessage: read: Connection reset by peer
14/01/2020 21:32:52 client_count: 0
14/01/2020 21:32:52 Client 127.0.0.1 gone
14/01/2020 21:32:52 Statistics events Transmit/ RawEquiv ( saved)
14/01/2020 21:32:52 FramebufferUpdate : 880 | 0/ 0 ( 0.0%)
14/01/2020 21:32:52 LastRect : 1 | 12/ 12 ( 0.0%)
14/01/2020 21:32:52 tight : 909 | 678200/ 5614620 ( 87.9%)
14/01/2020 21:32:52 RichCursor : 1 | 1374/ 1374 ( 0.0%)
14/01/2020 21:32:52 TOTALS : 1791 | 679586/ 5616006 ( 87.9%)
14/01/2020 21:32:52 Statistics events Received/ RawEquiv ( saved)
14/01/2020 21:32:52 PointerEvent : 71 | 426/ 426 ( 0.0%)
14/01/2020 21:32:52 FramebufferUpdate : 881 | 8810/ 8810 ( 0.0%)
14/01/2020 21:32:52 SetEncodings : 1 | 56/ 56 ( 0.0%)
14/01/2020 21:32:52 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
14/01/2020 21:32:52 TOTALS : 954 | 9312/ 9312 ( 0.0%)
14/01/2020 21:32:52 destroyed xdamage object: 0x400031
Corrupt JPEG data: 524288 extraneous bytes before marker 0xdb
15/01/2020 07:31:12 Got connection from client 127.0.0.1
15/01/2020 07:31:12 other clients:
15/01/2020 07:31:12 Got 'ws' WebSockets handshake
15/01/2020 07:31:12 Got protocol: binary
15/01/2020 07:31:12 - webSocketsHandshake: using binary/raw encoding
15/01/2020 07:31:12 - WebSockets client version hybi-13

15/01/2020 07:31:12 Disabled X server key autorepeat.
15/01/2020 07:31:12 to force back on run: 'xset r on' (3 times)
15/01/2020 07:31:12 incr accepted_client=7 for 127.0.0.1:44222 sock=10
15/01/2020 07:31:12 Client Protocol Version 3.8

15/01/2020 07:31:12 Protocol version sent 3.8, using 3.8

15/01/2020 07:31:12 rfbProcessClientSecurityType: executing handler for type 1
15/01/2020 07:31:12 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

15/01/2020 07:31:12 Pixel format for client 127.0.0.1:
15/01/2020 07:31:12 32 bpp, depth 24, little endian
15/01/2020 07:31:12 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
15/01/2020 07:31:12 no translation needed
15/01/2020 07:31:12 Enabling NewFBSize protocol extension for client 127.0.0.1
15/01/2020 07:31:12 Using image quality level 6 for client 127.0.0.1
15/01/2020 07:31:12 Using JPEG subsampling 0, Q79 for client 127.0.0.1
15/01/2020 07:31:12 Using compression level 9 for client 127.0.0.1
15/01/2020 07:31:12 Enabling LastRect protocol extension for client 127.0.0.1
15/01/2020 07:31:12 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
15/01/2020 07:31:12 Using tight encoding for client 127.0.0.1
15/01/2020 07:31:14 client_set_net: 127.0.0.1 0.0000
15/01/2020 07:31:14 active keyboard: turning X autorepeat off.

15/01/2020 07:31:14 created xdamage object: 0x400032
15/01/2020 07:31:35 client 7 network rate 793.3 KB/sec (9893.3 eff KB/sec)
15/01/2020 07:31:35 client 7 latency: 2.3 ms
15/01/2020 07:31:35 dt1: 0.0027, dt2: 0.0174 dt3: 0.0023 bytes: 15096
15/01/2020 07:31:35 link_rate: LR_LAN - 2 ms, 793 KB/s
15/01/2020 07:38:00 idle keyboard: turning X autorepeat back on.

15/01/2020 07:45:03 got closure, reason 1001
15/01/2020 07:45:03 rfbProcessClientNormalMessage: read: Connection reset by peer
15/01/2020 07:45:03 client_count: 0
15/01/2020 07:45:03 Client 127.0.0.1 gone
15/01/2020 07:45:03 Statistics events Transmit/ RawEquiv ( saved)
15/01/2020 07:45:03 FramebufferUpdate : 546 | 0/ 0 ( 0.0%)
15/01/2020 07:45:03 LastRect : 35 | 420/ 420 ( 0.0%)
15/01/2020 07:45:03 tight : 1553 | 831284/ 11704724 ( 92.9%)
15/01/2020 07:45:03 TOTALS : 2134 | 831704/ 11705144 ( 92.9%)
15/01/2020 07:45:03 Statistics events Received/ RawEquiv ( saved)
15/01/2020 07:45:03 KeyEvent : 70 | 560/ 560 ( 0.0%)
15/01/2020 07:45:03 PointerEvent : 1112 | 6672/ 6672 ( 0.0%)
15/01/2020 07:45:03 FramebufferUpdate : 547 | 5470/ 5470 ( 0.0%)
15/01/2020 07:45:03 SetEncodings : 1 | 52/ 52 ( 0.0%)
15/01/2020 07:45:03 SetPixelFormat : 1 | 20/ 20 ( 0.0%)
15/01/2020 07:45:03 TOTALS : 1731 | 12774/ 12774 ( 0.0%)
15/01/2020 07:45:06 destroyed xdamage object: 0x400032
15/01/2020 07:46:11 Got connection from client 127.0.0.1
15/01/2020 07:46:11 other clients:
15/01/2020 07:46:11 Got 'ws' WebSockets handshake
15/01/2020 07:46:11 Got protocol: binary
15/01/2020 07:46:11 - webSocketsHandshake: using binary/raw encoding
15/01/2020 07:46:11 - WebSockets client version hybi-13

15/01/2020 07:46:11 Disabled X server key autorepeat.
15/01/2020 07:46:11 to force back on run: 'xset r on' (3 times)
15/01/2020 07:46:11 incr accepted_client=8 for 127.0.0.1:44680 sock=10
15/01/2020 07:46:11 Client Protocol Version 3.8

15/01/2020 07:46:11 Protocol version sent 3.8, using 3.8

15/01/2020 07:46:11 rfbProcessClientSecurityType: executing handler for type 1
15/01/2020 07:46:11 rfbProcessClientSecurityType: returning securityResult for client rfb version >= 3.8

15/01/2020 07:46:11 Pixel format for client 127.0.0.1:
15/01/2020 07:46:11 32 bpp, depth 24, little endian
15/01/2020 07:46:11 true colour: max r 255 g 255 b 255, shift r 16 g 8 b 0
15/01/2020 07:46:11 no translation needed
15/01/2020 07:46:11 Enabling NewFBSize protocol extension for client 127.0.0.1
15/01/2020 07:46:11 Using image quality level 6 for client 127.0.0.1
15/01/2020 07:46:11 Using JPEG subsampling 0, Q79 for client 127.0.0.1
15/01/2020 07:46:11 Using compression level 9 for client 127.0.0.1
15/01/2020 07:46:11 Enabling LastRect protocol extension for client 127.0.0.1
15/01/2020 07:46:11 rfbProcessClientNormalMessage: ignoring unsupported encoding type Enc(0xFFFFFECC)
15/01/2020 07:46:11 Using tight encoding for client 127.0.0.1
15/01/2020 07:46:12 client_set_net: 127.0.0.1 0.0000
15/01/2020 07:46:12 active keyboard: turning X autorepeat off.

15/01/2020 07:46:12 created xdamage object: 0x400033

 

If there is any error from dupeGuru, they should appear in the container's log.

 

So dupeGuru is able to successfully identify duplicates, but it freeze when you apply an action?  Which action (and its settings) are you applying and on how many files?

 

Link to comment

I found a workaround - I was able to save the results quickly then it immediately froze.  Restarting the container and loading the results works with none of the previous issues and a was able to mark, move and delete without any issues.  

 

As far as errors in the container's log - unless I'm mistaken, that was the container's log that I posted.  And before setting the memory variable I did see lots of malloc errors there.  But I see nothing in that log that helps. 

Link to comment
  • 1 month later...

I just had a 30TB scan with dupeguru and once it finished, the results are no where to be found. When I click view, the "Results Window" button is greyed out. Anyone know what's going on? The scan took 4 days so I'd prefer not to do this again. Also, when I press Scan on a new scan thinking that the scan didn't actually work, it says that I currently have unsaved results, but I have no idea where to find them. What should I do? 

 

image.png.d2d7af3ac255a32ba7196cd68fd4a5e1.png

 

 image.png.5adbbf37c10123c99200dfa545dfe4db.png

Link to comment
On 3/21/2020 at 9:16 PM, zejohn said:

I just had a 30TB scan with dupeguru and once it finished, the results are no where to be found. When I click view, the "Results Window" button is greyed out. Anyone know what's going on? The scan took 4 days so I'd prefer not to do this again. Also, when I press Scan on a new scan thinking that the scan didn't actually work, it says that I currently have unsaved results, but I have no idea where to find them. What should I do? 

 

image.png.d2d7af3ac255a32ba7196cd68fd4a5e1.png

 

 image.png.5adbbf37c10123c99200dfa545dfe4db.png

Sorry, not sure what happened, maybe a glitch with dupeGuru itself...  

Link to comment
  • 4 months later...

Hi

Also have the same issue as above.  after a day of running and showing progress (finding more than 4000 matches)  it just stops and no results are shown.

I left it sitting idle , thinking it maybe doing something.  but eventually I was just able to push the Scan again and it starts scanning.  and the cycle is the same.  no results after the scan.

any idea?  where should I look for the logs? 

Link to comment
  • 4 weeks later...
On 3/21/2020 at 8:16 PM, zejohn said:

I just had a 30TB scan with dupeguru and once it finished, the results are no where to be found. When I click view, the "Results Window" button is greyed out. Anyone know what's going on? The scan took 4 days so I'd prefer not to do this again. Also, when I press Scan on a new scan thinking that the scan didn't actually work, it says that I currently have unsaved results, but I have no idea where to find them. What should I do? 

 

image.png.d2d7af3ac255a32ba7196cd68fd4a5e1.png

 

 image.png.5adbbf37c10123c99200dfa545dfe4db.png

____

I've just had the same issue on my first time running it - I reran it to see what went wrong, but mine only took something like 45 minutes or so across. Seems to happen when a significant amount of dupes are found and you close out the findings without taking any action initially (at least in my case). 

Link to comment

I don't have an answer to your specific question, but hopefully this is helpful: I found DupeGuru's all-or-nothing results to be too unreliable and require too much user interaction. Instead, if you install the nerd pack plug in, there are two command line dupe checkers - fdupes and jdupes.  Install either (reportedly jdupes is faster) and the user scripts plug in.  Write a script to delete dupes and set it to run periodically.  Or, a little more complicated, but you can create a script to move the dupes and create a log of what it did and you can review everything and manually delete.  I can't access them right now, but I can post mine if anyone wants them.

 

 

 

 

Link to comment
  • 2 weeks later...
  • 4 weeks later...
On 9/16/2020 at 8:18 PM, RadOD said:

I don't have an answer to your specific question, but hopefully this is helpful: I found DupeGuru's all-or-nothing results to be too unreliable and require too much user interaction. Instead, if you install the nerd pack plug in, there are two command line dupe checkers - fdupes and jdupes.  Install either (reportedly jdupes is faster) and the user scripts plug in.  Write a script to delete dupes and set it to run periodically.  Or, a little more complicated, but you can create a script to move the dupes and create a log of what it did and you can review everything and manually delete.  I can't access them right now, but I can post mine if anyone wants them.

 

 

 

 

 

I'm going to try this app but if it doesnt work right (like others are experiencing), do you have any info regarding how to write the script for deleting duplicates? I can paste in a script but I have NO idea how to write one.

Link to comment
  • 7 months later...

I have a bunch of dup files that fix common problems found.  However I can figure out how to do the initial scan with this tool.  I think I need to select some directories to scan, but I can't find where to do that.

 

Nevermind - I found the + in the lower left corner to add directories to scan.

Edited by jtcweb
Link to comment
  • 1 year later...
3 hours ago, Zonediver said:

 

When i open the GUI, its empty... no buttons or something else - a white Screen...

EDIT: There is a Messag: Server disconnected (Code: 1006)

Can you try to clear your browser's cache or try in an incognito/private window to see if it's working ?

Link to comment
  • 3 months later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.