Redxd
-
Posts
37 -
Joined
-
Last visited
Content Type
Profiles
Forums
Downloads
Store
Gallery
Bug Reports
Documentation
Landing
Posts posted by Redxd
-
-
I'd also been keen to see the imfile module included in the default OS so I can onforward logs like /var/log/ipmifan which generates temp readings from my motherboards IPMI and adjust the fans accordingly.
-
24 minutes ago, ice pube said:
I would switch to youtube-dl material
It's exactly what I did!
-
With Youtube URL's now changed, has anyone figured out how to download a full channel when 'Usernames' are no longer being accepted?
{"level":"error","msg":"There was an error downloading the video: ERROR: u'' is not a valid URL. Set --default-search \"ytsearch\" (or run youtube-dl \"ytsearch:\" ) to search YouTube\n[youtube:user] destinws2: Downloading channel page\n[youtube:playlist] UU6107grRI4m0o2-emgoDnAA: Downloading webpage\n[download] Downloading playlist: Uploads from SmarterEveryDay\n[youtube:playlist] UU6107grRI4m0o2-emgoDnAA: Downloading page #1\nERROR: u'content_html'\n","time":"2020-07-27T13:50:46Z"} {"level":"info","msg":"returning response: {Error ERROR_DOWNLOADING There was an error downloading the target Download: DownloadVideo: ERROR: u'' is not a valid URL. Set --default-search \"ytsearch\" (or run youtube-dl \"ytsearch:\" ) to search YouTube\n[youtube:user] destinws2: Downloading channel page\n[youtube:playlist] UU6107grRI4m0o2-emgoDnAA: Downloading webpage\n[download] Downloading playlist: Uploads from SmarterEveryDay\n[youtube:playlist] UU6107grRI4m0o2-emgoDnAA: Downloading page #1\nERROR: u'content_html'\n}","time":"2020-07-27T13:50:46Z"} -
On 2/7/2020 at 10:25 PM, eXtremeSHOK said:
Please can you add support for dual gpu systems which have 8 fans.
ie. add FANB, FANC, FAND to FAN A
ipmitool sensor list all | grep FAN FAN1 | 5600.000 | RPM | nr | 100.000 | 200.000 | 300.000 | 1000.000 | 2300.000 | 3000.000 FAN2 | 5500.000 | RPM | nr | 100.000 | 200.000 | 300.000 | 1000.000 | 2300.000 | 3000.000 FAN3 | 5500.000 | RPM | nr | 100.000 | 200.000 | 300.000 | 1000.000 | 2300.000 | 3000.000 FAN4 | 5500.000 | RPM | nr | 100.000 | 200.000 | 300.000 | 1000.000 | 2300.000 | 3000.000 FANA | 5300.000 | RPM | nr | 100.000 | 200.000 | 300.000 | 1000.000 | 2300.000 | 3000.000 FANB | 5300.000 | RPM | nr | 100.000 | 200.000 | 300.000 | 1000.000 | 2300.000 | 3000.000 FANC | 21000.000 | RPM | nr | 100.000 | 200.000 | 300.000 | 1000.000 | 2300.000 | 3000.000 FAND | 20400.000 | RPM | nr | 100.000 | 200.000 | 300.000 | 1000.000 | 2300.000 | 3000.000
I second this request.
I have an X11 that has FAN1-7 and also FANAB
-
On 1/12/2020 at 11:15 PM, Jidovu Marius Adrian said:
Do you have the json config files in the config folder with the read and write permissions?
I've just updated the docker as well and i'm getting the same error message. Docker doesn't even start.
usermod: no changes groupmod: GID '100' already exists {"level":"info","msg":"Initiating db","time":"2020-01-14T07:23:08Z"} {"level":"error","msg":"database.load: could not read file: json: cannot unmarshal string into Go struct field DownloadTarget.CheckingInterval of type int","time":"2020-01-14T07:23:08Z"} {"level":"fatal","msg":"\u003cnil\u003e","time":"2020-01-14T07:23:08Z"}I also removed the image completely and re-downloaded it just in case, still same issue. I checked the permissions on the json config files and they are exactly the same as what's set in the docker config.
-
I've just got back from holidays and the docker is working pretty good now.
One thing I have started to notice is that every once and a while (maybe when it does it's check for new videos) the docker will consume 100% CPU on my server (As shown on the dashboard) and slow down everything else.
This has happened before though while pre-clearing disks and it wasn't the CPU that was maxing it, it was the IO wait time increasing.
It goes straight back to normal when i kill the auto-yt docker.
What information can I provide to help diagnose it?
-
17 minutes ago, Redxd said:
{"level":"info","msg":"received a request to add a target","time":"2019-12-20T11:02:27Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl -j --playlist-end 1 https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:27Z"} {"level":"info","msg":"DOWNLOAD: {https://www.youtube.com/user/destinws2 Video And Audio Uploads from SmarterEveryDay mp4 [] 12-20-2019 11:02:35 Channel %(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"downloading video","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"{ youtube-dl --ignore-errors bestvideo[ext=mp4] downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=mp4] -o downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"DOWNLOAD: {https://www.youtube.com/user/destinws2 Video And Audio Uploads from SmarterEveryDay mp4 [] 12-20-2019 11:02:35 Channel %(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"downloading video","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"{ youtube-dl --ignore-errors bestvideo[ext=mp4] downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=mp4] -o downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:35Z"}
I just tried manually within the docker using the same command but changing the 'bestvideo[ext=mp4]' to just 'best'. This downloaded normal like any other time but it included video. I think when choosing the 'bestvideo' option it's just doing video and it may also be missing the audio part and then needing to join the two?
-
I'm able to get the whole channel to download now by choose the quality as MP4, it doesn't work when set to 'Any'. With MP4 selected the videos download in the background but my guess is the 'channel' dosn't get added to the bottom of the gui until all videos are downloaded.
I have noticed that all the videos it does download don't have any audio. Nothing in the logs about it.
{"level":"info","msg":"received a request to add a target","time":"2019-12-20T11:02:27Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl -j --playlist-end 1 https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:27Z"} {"level":"info","msg":"DOWNLOAD: {https://www.youtube.com/user/destinws2 Video And Audio Uploads from SmarterEveryDay mp4 [] 12-20-2019 11:02:35 Channel %(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"downloading video","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"{ youtube-dl --ignore-errors bestvideo[ext=mp4] downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=mp4] -o downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"DOWNLOAD: {https://www.youtube.com/user/destinws2 Video And Audio Uploads from SmarterEveryDay mp4 [] 12-20-2019 11:02:35 Channel %(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"downloading video","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"{ youtube-dl --ignore-errors bestvideo[ext=mp4] downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=mp4] -o downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:35Z"}
-
1 minute ago, Jidovu Marius Adrian said:
Do you add any custom folder or custom format ?
I have tried a few different custom paths in troubleshooting this.
With a /channels/ folder (created and not created)
No channels folder so just /
/Downloads/ but then in the logs it must already prefix Downloads show it was showing up as downloads/downloads/
-
14 minutes ago, Jidovu Marius Adrian said:
A picture with goautoyt before you click add channel.
i've tried multiple scenarios with the custom output path. Even the default it dosn't work.
-
4 minutes ago, Jidovu Marius Adrian said:
Can you make a picture with the settings you are using and post it ?
This is the docker settings I have set.
Downloads location pointing to my array and config file pointing to my cache directory.
-
No matter what i set the download folder path to be, or what customised path I set, I'm always getting the same error messages in the logs.
I've tried a two different youtube channels but get the same error.
{"level":"info","msg":"received a request to add a target","time":"2019-12-14T08:09:58Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl -j --playlist-end 1 https://youtube.com/users/destinws2","time":"2019-12-14T08:09:58Z"} {"level":"error","msg":"From GetMetadata(): unexpected end of JSON input","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"adding {https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s} to DB","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"DOWNLOAD: {https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s}","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"downloading video","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"{ youtube-dl --ignore-errors bestvideo[ext=any] downloads/%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s https://youtube.com/users/destinws2}","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=any] -o downloads/%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s https://youtube.com/users/destinws2","time":"2019-12-14T08:10:02Z"} {"level":"error","msg":"exit status 1/usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=any] -o downloads/%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s https://youtube.com/users/destinws2","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"updating latest downloaded video id","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"latest downloaded video id updated successfully","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"updating download history","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"[{https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s}]","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"returning response: {Error ERROR_DOWNLOADING There was an error downloading the target Download: DownloadVideo: exit status 1}","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"got this data: {channels}","time":"2019-12-14T08:10:06Z"} {"level":"info","msg":"getting all channels from channels.json","time":"2019-12-14T08:10:06Z"} {"level":"info","msg":"successfully read all channels","time":"2019-12-14T08:10:06Z"} {"level":"info","msg":"[{https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s}]","time":"2019-12-14T08:10:06Z"} {"level":"info","msg":"got this data: {channels}","time":"2019-12-14T08:10:43Z"} {"level":"info","msg":"getting all channels from channels.json","time":"2019-12-14T08:10:43Z"} {"level":"info","msg":"successfully read all channels","time":"2019-12-14T08:10:43Z"} {"level":"info","msg":"[{https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s}]","time":"2019-12-14T08:10:43Z"} -
4 minutes ago, gfjardim said:
Nothing strange on your logs, but I've experienced some slowness on some USB derives before. Which speeds are you seeing on those writes.
For this drive and the other 12TB that successfully worked I was seeing easy 120MB/s.
The drives were plugged into the same SAS card as all the other drives in the array. all the speeds I was seeing both read and write seems normal.
It's just this one drive grinded everything to a halt once writing zeros.
I've currently got it booted off a trial unraid instance on my main PC doing its preclear.
-
2 hours ago, gfjardim said:
Please send your diagnostics log.
See attached
-
I just shucked two 12TB WD White's and only one seems to have preclear'd without any issues.
I've tried the old Preclear plugin, then the preclear docker when I saw notes that the plugin wasn't working well with 6.7 and then the most up to date plugin once updates were made for the MBR issues others were receiving.
This one 12TB drive keeps on slowing down my unraid to a crawl. Hogs all I/O. When using the docker if left on for a while it takes minutes to run the docker stop command.
The pre-read seems to run fine but it's not until it starts writing zero's that 1-2 minutes in the dashboard shows all CPU's maxed out. iotop shows the dd process writing the zero's at a high % and another process labeled [kworker/u16:7+flush-8:32]. see attached screenshot.
Logs don't show much. I'm unable to find how to turn debugging on based on what gfjardim said a few posts back.
Here are the preclear plugin logs for the drive itself
Dec 01 19:10:01 preclear_disk_8CJLTRWE_10041: Zeroing: dd if=/dev/zero of=/dev/sdc bs=2097152 seek=26138902528 count=11973999722496 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes Dec 01 19:10:01 preclear_disk_8CJLTRWE_10041: Zeroing: dd pid [12894] Dec 01 19:12:50 preclear_disk_8CJLTRWE_10041: SIGTERM received, exiting... Dec 01 20:45:44 preclear_disk_8CJLTRWE_10404: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --notify 2 --frequency 2 --cycles 1 --no-prompt /dev/sdc Dec 01 20:45:44 preclear_disk_8CJLTRWE_10404: Preclear Disk Version: 1.0.6 Dec 01 20:45:45 preclear_disk_8CJLTRWE_10404: S.M.A.R.T. info type: default Dec 01 20:45:45 preclear_disk_8CJLTRWE_10404: S.M.A.R.T. attrs type: default Dec 01 20:45:45 preclear_disk_8CJLTRWE_10404: Disk size: 12000138625024 Dec 01 20:45:45 preclear_disk_8CJLTRWE_10404: Disk blocks: 2929721344 Dec 01 20:45:45 preclear_disk_8CJLTRWE_10404: Blocks (512 byte): 23437770752 Dec 01 20:45:45 preclear_disk_8CJLTRWE_10404: Block size: 4096 Dec 01 20:45:45 preclear_disk_8CJLTRWE_10404: Start sector: 0 Dec 01 20:45:47 preclear_disk_8CJLTRWE_10404: Pre-Read: dd if=/dev/sdc of=/dev/null bs=2097152 skip=0 count=12000138625024 conv=notrunc iflag=nocache,count_bytes,skip_bytes Dec 01 20:47:40 preclear_disk_8CJLTRWE_10404: SIGTERM received, exiting... Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --load-file /tmp/.preclear/8CJLTRWE.resume /dev/sdc Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: Preclear Disk Version: 1.0.6 Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: Restoring previous instance of preclear Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: S.M.A.R.T. info type: default Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: S.M.A.R.T. attrs type: default Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: Disk size: 12000138625024 Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: Disk blocks: 2929721344 Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: Blocks (512 byte): 23437770752 Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: Block size: 4096 Dec 01 20:49:38 preclear_disk_8CJLTRWE_32581: Start sector: 0 Dec 01 20:49:40 preclear_disk_8CJLTRWE_32581: Continuing disk read from byte 26449281024 Dec 01 20:49:40 preclear_disk_8CJLTRWE_32581: Pre-Read: dd if=/dev/sdc of=/dev/null bs=2097152 skip=26449281024 count=11973689344000 conv=notrunc iflag=nocache,count_bytes,skip_bytes Dec 01 21:11:45 preclear_disk_8CJLTRWE_32581: SIGTERM received, exiting... Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --cycles 1 --skip-preread --no-prompt /dev/sdc Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: Preclear Disk Version: 1.0.6 Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: S.M.A.R.T. info type: default Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: S.M.A.R.T. attrs type: default Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: Disk size: 12000138625024 Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: Disk blocks: 2929721344 Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: Blocks (512 byte): 23437770752 Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: Block size: 4096 Dec 01 21:11:56 preclear_disk_8CJLTRWE_25713: Start sector: 0 Dec 01 21:11:58 preclear_disk_8CJLTRWE_25713: Zeroing: emptying the MBR. Dec 01 21:11:58 preclear_disk_8CJLTRWE_25713: Zeroing: dd if=/dev/zero of=/dev/sdc bs=2097152 seek=2097152 count=12000136527872 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes Dec 01 21:11:58 preclear_disk_8CJLTRWE_25713: Zeroing: dd pid [28276] Dec 01 21:15:12 preclear_disk_8CJLTRWE_25713: SIGTERM received, exiting...
And disk log information
Nov 21 18:52:32 Tower kernel: sd 1:0:1:0: [sdc] 23437770752 512-byte logical blocks: (12.0 TB/10.9 TiB) Nov 21 18:52:32 Tower kernel: sd 1:0:1:0: [sdc] 4096-byte physical blocks Nov 21 18:52:32 Tower kernel: sd 1:0:1:0: [sdc] Write Protect is off Nov 21 18:52:32 Tower kernel: sd 1:0:1:0: [sdc] Mode Sense: 73 00 00 08 Nov 21 18:52:32 Tower kernel: sd 1:0:1:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Nov 21 18:52:32 Tower kernel: sd 1:0:1:0: [sdc] Attached SCSI disk Nov 21 18:52:58 Tower emhttpd: WDC_WD120EMAZ-11BLFA0_8CJLTRWE (sdc) 512 23437770752 Nov 28 21:35:27 Tower emhttpd: WDC_WD120EMAZ-11BLFA0_8CJLTRWE (sdc) 512 23437770752 Nov 28 21:35:48 Tower emhttpd: WDC_WD120EMAZ-11BLFA0_8CJLTRWE (sdc) 512 23437770752 Nov 28 21:39:09 Tower emhttpd: WDC_WD120EMAZ-11BLFA0_8CJLTRWE (sdc) 512 23437770752 Nov 28 21:39:42 Tower emhttpd: WDC_WD120EMAZ-11BLFA0_8CJLTRWE (sdc) 512 23437770752 Nov 30 09:05:32 Tower emhttpd: WDC_WD120EMAZ-11BLFA0_8CJLTRWE (sdc) 512 23437770752 Nov 30 09:07:45 Tower emhttpd: WDC_WD120EMAZ-11BLFA0_8CJLTRWE (sdc) 512 23437770752 Nov 30 09:07:57 Tower emhttpd: WDC_WD120EMAZ-11BLFA0_8CJLTRWE (sdc) 512 23437770752 Dec 1 19:34:59 Tower preclear_disk_8CJLTRWE[16263]: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --cycles 1 --skip-preread --no-prompt /dev/sdc Dec 1 19:35:03 Tower preclear_disk_8CJLTRWE[16263]: Zeroing: dd if=/dev/zero of=/dev/sdc bs=2097152 seek=2097152 count=12000136527872 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes Dec 1 19:39:59 Tower preclear_disk_8CJLTRWE[10041]: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --load-file /tmp/.preclear/8CJLTRWE.resume /dev/sdc Dec 1 19:40:01 Tower preclear_disk_8CJLTRWE[10041]: Zeroing: dd if=/dev/zero of=/dev/sdc bs=2097152 seek=26138902528 count=11973999722496 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes Dec 1 21:15:44 Tower preclear_disk_8CJLTRWE[10404]: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --notify 2 --frequency 2 --cycles 1 --no-prompt /dev/sdc Dec 1 21:15:47 Tower preclear_disk_8CJLTRWE[10404]: Pre-Read: dd if=/dev/sdc of=/dev/null bs=2097152 skip=0 count=12000138625024 conv=notrunc iflag=nocache,count_bytes,skip_bytes Dec 1 21:19:38 Tower preclear_disk_8CJLTRWE[32581]: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --load-file /tmp/.preclear/8CJLTRWE.resume /dev/sdc Dec 1 21:19:40 Tower preclear_disk_8CJLTRWE[32581]: Pre-Read: dd if=/dev/sdc of=/dev/null bs=2097152 skip=26449281024 count=11973689344000 conv=notrunc iflag=nocache,count_bytes,skip_bytes Dec 1 21:41:56 Tower preclear_disk_8CJLTRWE[25713]: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --cycles 1 --skip-preread --no-prompt /dev/sdc Dec 1 21:41:58 Tower preclear_disk_8CJLTRWE[25713]: Zeroing: dd if=/dev/zero of=/dev/sdc bs=2097152 seek=2097152 count=12000136527872 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes
-
I'm not able to replicate this error, it seems to install fine for me. Try running this from command line:
installplg https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg
See if that installs it (although it should be the exact same since this is what the web gui runs essentially).
Got the same error message about a certain line error in the Sonarr-script. So I deleted the script and tried again...hey presto it worked!!
root@Tower:~# installplg https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg plugin: installing: https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg plugin: downloading https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg plugin: downloading: https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg ... done Installing Sonarr plugin Checking for current bundle files Control file: Found correct version Dependency file: Found correct version Mono file: Not found Check OK! /tmp/Sonarr-script: line 330: syntax error: unexpected end of file plugin: run failed: /bin/bash retval: 2 root@Tower:~# rm /tmp/Sonarr-script root@Tower:~# installplg https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg plugin: installing: https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg plugin: downloading https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg plugin: downloading: https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg ... done Installing Sonarr plugin Checking for current bundle files Control file: Found correct version Dependency file: Found correct version Mono file: Not found Check OK! Downloading new Mono file Download OK: Mono file passed MD5 check Running install script for Sonarr Installing control file Control file install OK! Cleaning up temp files and folders Install complete! plugin: installed
-
So i've finally decided to switch from SickBeard to Sonarr. But when I try to install the plg both using the file and using the github link i'm getting errors.
This is what the popup window shows
plugin: installing: https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg plugin: downloading https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg plugin: downloading: https://github.com/PhAzE-Variance/unRAID/raw/master/Plugins/Sonarr.plg ... done Installing Sonarr plugin Checking for current bundle files Control file: Not Found Dependency file: Not found Mono file: Not found Check OK! Downloading new control file Download OK: Control file passed MD5 check Downloading new dependency file Download OK: Dependency file passed MD5 check plugin: run failed: /bin/bash retval: 2
And this is what is showing on the unraid terminal
/tmp/Sonarr-script: line 330: syntax error: unexpected end of line
Any ideas?
-
Just want to give an update.
Managed to move all my plugins off of the cache drive directly on to one of the disks, and redirected all of the apps settings.
Went out and purchased a WD Red 1TB drive, gave it a preclear and moved everything back on with no issues
All back to running smoothly
-
G'day Guys,
So got home this arvo only to see I have some issues with my Plex (which runs from my cache drive) taking it's time to load via the web and via my rasberry pi (running rasplex). It also wouldn't play shows straight away like normal or when it did it would be all glitchy and eventually quit out.
I've kinda come to the conclusion that it could be my cache drive thats the issue as I was trying to transfer files from my cache disk into my array but kept on getting errors at random points during the transfer.
I checked out the smart reporting but i'm no wiz bang smart kid on ready this stuff....was hoping someone could help me out and tell me if what it's trying to tell me is that its imminent to failure very soon.
I've attached the report it gave me which i don't think it even finished because of reading errors.
Smart Self Test History
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed: read failure 90% 47479 1237926811 # 2 Extended offline Completed without error 00% 40658 - # 3 Short offline Completed without error 00% 40654 - # 4 Extended offline Completed without error 00% 16033 - # 5 Short offline Completed without error 00% 16029 -
-
It would seem you were right, my app folders were moved each night by the mover for some reason. Anyway, last night it didn't break and I didn't have to set it all up again.
Thankyou
:) -
My guess is going to be that /mnt/cache/apps/ isn't set to cache only and is being moved to the array every night thus breaking your plugins..
So that was one of my thoughts, but I go to that share and the 'Use Cache Disk' is set to 'Only'
Have you also checked that you do nor have an 'apps' folder on any of your data disks?
I just did a search and yes you are correct there was an Apps folder on one of my disks. It seems every folder that was in there didnt have an active app asociated with it plus some of the sick/sab and couch. I've deleted that whole App folder (Not sure how it got in there in the first place). So we shall see what happens tomorrow
-
My guess is going to be that /mnt/cache/apps/ isn't set to cache only and is being moved to the array every night thus breaking your plugins..
So that was one of my thoughts, but I go to that share and the 'Use Cache Disk' is set to 'Only'
-
Hey all,
So running 6.0 Beta 12 and recently upgraded my SAB/Sick/Couch PHaze plugins.
They all run on a 1TB cache drive and since the upgrade had to change their config folder location to /mnt/cache/Apps/Sabnzbd/config instead of just straight in the main application folder like they previously were. This happened with all the plugins.
So ever since re-setting it all up back up again using settings off of the previous config files (server names/api's etc) the plugins keep failing.
I'll get home and they have failed, check the settings on the main lime page and it's got it sitting there as the program isn't installed. Click install, it installs fine, uses the same config and comes back (except for sickbeard, he never goes back to the same config). Wake up the next morning and they are all 'uninstalled' again. When i orignally goto their links I get an error page saying something like Last command failed in big red writing (ill try get a screen shot next time).
Naturally I go look at the logs but it's clear, there is nothing in them except some random stuff that happened at about 4am.
Today the same thing happened with all the plugins, i checked the logs (recently wiped plex and started from scratch cause of metadata not showing) and all I get is the following. No mention of couch/sick or sab.
Aug 19 04:51:07 Tower logger: *** Skipping any contents from this failed directory *** Aug 19 04:51:07 Tower logger: cd+++++++++ Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia/ Aug 19 04:51:07 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.0] Aug 19 04:51:07 Tower logger: ./Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia/seasons/3/episodes/19.xml Aug 19 04:51:07 Tower shfs/user0: shfs_mkdir: assign_disk: Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia (28) No space left on device Aug 19 04:51:07 Tower logger: rsync: recv_generator: mkdir "/mnt/user0/Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia" failed: No space left on device (28) Aug 19 04:51:07 Tower logger: *** Skipping any contents from this failed directory *** Aug 19 04:51:07 Tower logger: cd+++++++++ Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia/ Aug 19 04:51:07 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.0] Aug 19 04:51:07 Tower logger: ./Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia/seasons/3/episodes/20.xml Aug 19 04:51:07 Tower shfs/user0: shfs_mkdir: assign_disk: Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia (28) No space left on device Aug 19 04:51:07 Tower logger: rsync: recv_generator: mkdir "/mnt/user0/Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia" failed: No space left on device (28) Aug 19 04:51:07 Tower logger: *** Skipping any contents from this failed directory *** Aug 19 04:51:07 Tower logger: cd+++++++++ Apps/Plex/config/Plex Media Server/Metadata/TV Shows/1/09a7557bd300c468ab2f7e5795269fc243320b0.bundle/Contents/com.plexapp.agents.localmedia/ Aug 19 04:51:07 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.0] Aug 19 04:51:07 Tower logger: ./Apps/Plex/config/Plex Media Server/Metadata/TV
My raid has about 1TB free space left, and my cache drive has only about 5GB taken up which leaves like 995GB free.
I'm very confused as to what is happening.
-
I ended up upgrading to version 6 B12 with no issues. With Dynamix inbedded I was able to see the main page and go through the process of installing the main plugins with success.
Admin can you please delete this thread?
Issue with XFS Docker disk format and docker port binding
in Docker Engine
Posted
I just changed my docker disk format from BTRFS to XFS due to heaps of errors in my unraid log showing up. Quick google showed a rebuild of the disk was the easiest way to resolve (ignore) it.
I stopped the docker service, chose an XFS disk format instead and started it again.
I have a user made bridged docker network where all of my dockers have access to so they are able to send logs to my log collector even if they don't have an external IP.
Everything was all good up until I tried to start a PostgreSQL docker when there was already one started for another web service. Then I got the error
Intrigued why changing only the format of the disk caused this I jumped back to the old disk to confirm I wasn't going crazy and both of the PostgreSQL dockers started up perfectly fine with no port conflicts.
They are both being composed using the exact same docker stack, although each in a different stack.
I then did a docker inspect on the same docker, composed in both the BTRFS and XFS disk formats, and here is the main difference (minus different ID's etc).
The BTRFS 'Ports' section is empty, but the XFS section has the following.
"Ports": { "5432/tcp": [ { "HostIp": "0.0.0.0", "HostPort": "5432" }, { "HostIp": "::", "HostPort": "5432" } ] },Am I running into a bug? Or have I been using a bug with BTRFS and XFS is the correct way it should be?