falconexe

Welp, I just read something that I was not aware of, but it makes total sense: So, should I just stop the data rebuild if the rebuild is going to be corrupted anyway? Or am I fine BECAUSE I HAVE DUAL PARITY? I could throw back in my original 8TB disk and try to get disk1 resolved? I am now REALLY thinking that I should not do anything until someone with experience chimes in. If the data rebuild is going to be corrupted on my new 18TB disk because disk1 had 2048 read errors, what is the best protocol to NOT LOSE DATA at this point? I always thought if you had dual parity, even if a disk failed during a rebuild, everything would remain intact so long as you didn't lose a 3rd. Currently, everything is still accessible. I have the original disk I am expanding from, and I have spares to replace disk1 if needed. Thanks again!

Hey everyone. I've been running my 30 drive server for years without any issues. Today, I decided to swap an 8TB drive for a new 18TB drive. New drive was previously successfully pre-cleared. So, I went ahead and swapped it out and started a data rebuild. I've upgraded over a dozen drives in the last year the same way, without ever having an issue. Today my luck ran out and Disk1 (1.5 year old Seagate 14TB with XFS) threw 2048 read errors and went offline (red X) about 30 mins into the rebuild. It is now showing up in the Unassigned devices area. I checked the file system and it shows corruption. Short SMART was perfect. Long SMART is not able to be run currently (greyed out). All attributes look normal. SO, just because it has been a VERY LONG time since I've dealt with this, and because I have seen a lot of people lose data and make the situation worse by panicking and making mistakes, I just wanted to run my plan of action by everyone. Open to any advice, and any help is appreciated to keep me on track for a successful outcome. 1. The data rebuild is continuing and has about 50+ hours left. I will not stop it as disk1 is emulated and the data is accessible. Since i have dual parity, I am only going to be in a world of hurt if a 3rd disk craps out. Fingers crossed... 2. Once the data rebuild is successful for the new disk I just swapped, I can either try to repair disk 1, or just swap it for another new 18TB disk. I have plenty of spares on standby. Questions on #2. If I did want to attempt a XFS file system repair, and if that was successful, how do I get it back into the array? I was planning on a full shutdown, re-seating disk1, then attempting the repair via the "RUN WITH CORRECT FLAG" button. I've never ran this before, so have no idea what to expect. If it is successful, will the disk just pop back into the array like normal, or after a reboot? I could also just throw this disk into my backup server, run a new pre-clear, extended test, and see if it is stable. If it is, then at least it is serving some purpose in expanding my backup server's space, and I don't have to worry about it blowing up again in my production server. For now, I am not going to touch anything until the data rebuild is finished. I'll refrain from posting diags, and just looking for overall advice. Thanks and Happy Thanksgiving!

While I was researching how to currently install Varken, I noticed that it only supports InfluxDB 1.8. From the Varken GitHub: https://github.com/Boerderij/Varken So, if we were to move the UUD to Influx 3.X using SQL, it would require someone to pick up the mantel on Varken, and branch it. If anyone is serious about it, and willing to continue that project, I'm willing to try and get the UUD to Influx 3.X in tandem, once they release it and we can get our hands on it. Once Varken's repository is gone gone, the main part of the UUD that I use (Plex) would need something else to get the Tautulli data into InfluxDB. I'm open to suggestions. We don't necessarily need Varken, we just need the code equivalent that moves the data. Perhaps a direct API call from Tautulli to InfluxDB? Let me know your thoughts (anyone). @Jufy111 @viktortras

Varken is no longer being developed, but I still see it in Community Applications, and it doesn't appear to be officially deprecated. Do you see this? This is the way it is installed.

I found this using a web search. Please open a topic on InfuxDB’s forum. I have never seen this before, and it sounds like you have reached the upper limit regarding cardinality. I have data going back 5 years. My InfluxDB database is 100GB+ with millions of records. Something seems off. Let us know when you get it figured out, and how, so others in the future have the help they need too. https://community.influxdata.com/t/max-series-per-database-limit-exceeded-1000000-error-question/12273

I really appreciate this info. As a result, I have added you as a contributor on page #1. Once I get my server updated to 6.12.X, I'll give this a whirl. I may pick your brain on some stuff if you are up for it in the future. Thanks!

Na, don't feel obligated. I appreciate the info you have already provided and that is a contribution. A lot of people have helped over the years with providing me leads for the UUD. If you want to help with InfluxDB 3.0 stuff, I'm all for it, but no pressure. Thanks.

Thanks! Yeah man, no worries. It was long overdue. Let me know if you get the Jellyfin stuff figured out. I run Plex, but I can maybe add some similar stuff if it makes sense on that side of the house. I also wonder if there is an equivalent data ingester for Emby?

This is fantastic news, as I am a professional SQL developer. So yeah, I'll wait until InfluxDB Edge/Community comes out and roll with that. That should make it a lot easier to query the dataset and will open it up to a lot more of a mainstream/professional user base. Maybe we can work together (if time permits) to get something figured out to support this in the UUD. I suspect we'll need to wait until a new docker becomes available for InfluxDB 3.0. I am not a docker dev, but I'm sure someone will get on it eventually. I added you as an official contributor on post #1!

Pretty much just take a simple query from 1.8 and show me the translation to 2.X. If I can see how the query code syntax changed, I'll get it figured out. I haven't even looked into this officially, but I have heard all about it. Massive undertaking considering there are 100+ panels (hundreds? I've never counted LOL) in the UUD. It will all come down to time, and I'm an extremely busy guy for sure with work and family obligations. I appreciate the help and will add you as a contributor to the project once this gets rolling.

There is nothing to my knowledge in the 6 required dockers (Grafana/Telegraf/InfuxDB/Plex/Varken/Tautulli) that wouldn't work in the latest release of UNRAID. This is literally a JSON file and totally independent of UNRAID itself. It just displays the info from UNRAID. Not sure what you mean by "Manual Install Download Page" and "latest in a branch now". The UUD IS NOT ON GITHUB. Anything on GitHub is NOT OFFICIAL and is NOT SUPPORTED. This is the only official place to get the UUD. A lot of people have taken my JSON and bundled it with dockers, integrated it with a bunch of other software, and straight up just took it and called it their own. Though flattering, I cannot control and/or support these "unofficial branches". Finally, please elaborate and link the issue with remote mounts. I have not heard of this until now. What remote mounts would you be using the UUD with? To my knowledge, there is nothing in the UUD that uses remote mounts. If that is something you are doing, it is a custom you implemented. Honestly, I've been holding out on upgrading my UNRAID OS since there are no new features that interest me personally, and 6.11.4 has been rock solid. However, security is important, so I'll tell you what. I'll go ahead and update my server to the latest release this evening. If it breaks the UUD (doubtful), I'll resolve any issues and report back. There are NO SECURITY ISSUES in the UUD as it is ONLY a JSON Dashboard for GRAFANA which is completely independent of the UNRAID OS. Stay tuned... @SpencerJ

I just updated the release post with a bunch of info, direct download link (linked from post 1 of this thread), and a bunch of tutorials. READ POST #1 to get started.

Yes, still running on InfluxDB 1.8. If/when I decide to move to InfluxDB 2.0+, I'll rebrand the UUD as "UUD 2.1". I may do this and reintegrate the new version of the UNRAID API-RE at that point. I will likely also update Grafana to version 9+ and take my unRAID 0S to the current release as well. If I take on this project, it will be out of necessity. Great question BTW. I may pick your brain at that point if you are open to assist.

Thanks for this info. I was not aware of this. I'll take a look into it and may integrate it back in. Does anyone know if that memory leak was patched/resolved with this branch?

@SpencerJ Please add UUD 1.7's release to the official UNRAID Blog/Emails. Thanks!

DEVELOPER UPDATE - OFFICIAL RELEASE - Ultimate UNRAID Dashboard 1.7 Today is the release of the Ultimate UNRAID Dashboard version 1.7! Much has changed since the last official release of UUD 1.6. Various plugins and dependencies have been abandoned/deprecated, multiple unRAID OS updates have occurred, and my personal needs for the UUD have evolved over time. Nevertheless, I am very excited to share the new features, use cases, and updated design/architecture of this latest release with all of you. I feel it is the most refined and fine-tuned version yet, and I use it every single day. It is simply a pure joy to have in my life and I really love having all of this information at my fingertips. Please learn from this latest release and use it as a launch pad to create YOUR own Ultimate Dashboard. Without further delay, I bring to you the UUD 1.7! Screenshots (Click for Hi-Res): Deprecated: unRAID API The unRAID API was abandoned/deprecated by its developer after the release of UUD 1.6 It also contained a perpetual memory leak that was never patched All unRAID API panels have been removed from UUD 1.7 If another alternative is developed in the future, I will consider adding it to a future version of the UUD Variable for Future API Data Source Remains I also left this in for people who still wish to use the unRAID API (understanding the known risks) New Dependencies: None New Features: Plex Streams All Real-Time Plex Panels Have Been Moved to the Top of the UUD Provides a Overall Snapshot of Server/Media Use New/Reworked Panels Current LAN (Home Network) Numeric Transmit (TX) Bandwidth Current WAN (Internet) Numeric Transmit (TX) Bandwidth Current Transcode Streams Current Direct Play Streams Current Direct Streams Current Streams Provides a Detailed Real-Time Log of All Current Streams (Last 30 Seconds) Current Stream Types Current Stream Devices Historical Stream Heatmap Now (Last 1 Hour) Current Day (Last 24 Hours) Last Week (Last 7 Days) Last Month (Last 30 Days) Last Year (Last 365 Days) Current Stream Origination Detailed Stream Origination Map View via Geolocation by IP Address Stream Bandwidth Current WAN (Internet) / LAN (Home Network) Transmit (TX) Numeric Bandwidth Array Growth Array Growth Chart Detailed Heatmap Graph of Array Growth Over Time (Timeline Adjustable)\ Array Total Array Available Array Utilized Array Utilized % Overwatch "Cache Central" Completely redesigned array and cache overview section with net new panels with an increased focus on cache health, including real-time/historical disk statistics. Array Growth Day (Last 24 Hours) Array Growth Week (Last 7 Days) Array Growth Month (Last 30 Days) Array Growth Year (Last 365 Days) Array Growth Lifetime (Last X Number of Years - Adjustable) Cache Utilized Cache Available Cache Utilized % SSD Temperature SSD Life Used (Total) SSD Power On Time SSD Writes Current (Last 30 Seconds) SSD Writes Day (Last 24 Hours) SSD Writes Month (Last 30 Days) SSD Writes Lifetime (Total) SSD Reads Current (Last 30 Seconds) SSD Reads Day (Last 24 Hours) SSD Reads Month (Last 30 Days) SSD Reads Lifetime (Total) SSD I/O Current (Last Hour of Reads/Writes to Cache) SSD I/O Day (Last Day of Reads/Writes to Cache) SSD I/O Month (Last Month of Reads/Writes to Cache) SSD I/O Year (Last Year of Reads/Writes to Cache) Plex History Moved Plex Historical History to Its Own Section New Panel: Cumulative Stream Volume by User Graph Showing Cumulative Stream Volume (Last Month) Stacked by User (Timeline & Number of Users Adjustable) Device Types Historical Pie Chart of Stream Devices with Hover Over Key (Last 1 Month) Stream Types Historical Pie Chart of Stream Types (Direct Stream, Transcode, etc..) With Hover Over Key (Last 1 Month) Media Qualities Historical Pie Chart of Media Qualities (4K, 1080P, etc..) With Hover Over Key (Last 1 Month) Media Types Historical Pie Chart of Media Types (Movies, Shows, etc..) With Hover Over Key (Last 1 Month) Detailed Historical Stream Origination Map View via Geolocation by IP Address (Last 30 Days - Timeline Adjustable) Plex Stream Logs Standalone Panels Showing Detailed Plex Stream Logs Stream Log (Overview) Depicts an abbreviated log of all streams based on stream start times over the last 1 month Provides a Quick and Dirty List of What is Being Streamed By User Over Time Stream Log (Detailed) Depicts a full detailed log of all streams sorted by time over the last 1 week (Timeline Adjustable) Provides and in-depth look of all stream activity every 1 minute Can be used to track server issues/buffering/paused streams/abuse Historical UUD Panels All other historical panels (except for API) remain and have been improved/modified as needed for Grafana updates and bug-fixes Notes: unRAID OS UUD 1.7 was developed and tested on unRAID 6.11.4 It should be compatible with 6.12.X Please let me know if you run into any issues in this area Varken Even though Varken is no longer in development by its developer (from what I last heard), I am still using the latest Varken release for the UUD. I have seen zero issues with it and it is stable. Unless this becomes unavailable as a docker from Community Apps, it will remain along with all of the Plex functionality via Tautulli. Please refer to the first few posts in this thread to download, installation instructions and release note history. Direct Downland Link: Ultimate UNRAID Dashboard 1.7 Download (JSON) Install Instructions Are In Post #1 of This Thread: There are a few people out there who have made great documentation and videos on how to install the UUD if you need a detailed tutorial (for those that are new). These are not official, but may help you. A quick web search of "UUD" or "Ultimate UNRAID Dashboard" should give you what you need. Example Install Instructions (Not Official): Video Tutorial Playlist (4 Video Playlist) Based on UUD 1.5 Text Instructions Based on UUD 1.5 https://liltrublmakr.github.io/Ultimate-UNRAID-Dashboard/1.5.0/install15/ Someone Else's Alternate Docker Compose (Not Required) Method (Not Official): https://github.com/goodmase/Ultimate-Unraid-Dashboard-Guid Reddit Discussion (One of Several): I hope you all enjoy! ~ Thanks, falconexe (Community Developer) @SpencerJ

Later today.

There is not currently, as this is my personal preview build, and I still need to sanitize the code. If enough people are interested, and when I have time, I'll put together the release notes and post it as an official release.

Alright, everyone. Here is the UUD 1.7 preview. It looks pretty different from 1.6, and since I made this version, I haven't really changed it much. It is the most fined tuned and refined version that I have developed, and there isn't much more that I need for me personally. I'm pretty pleased with the way it turned out. Let me know your thoughts and/or if you have any questions! @SpencerJ ULTIMATE UNRAID DASHBOARD Version 1.7 (Click Each Image for 4K High Resolution)

Hi everyone! Sorry about the hiatus. I had to take a long break due to some upheaval in my personal life (all good now). A bunch of people recently were asking for the code and the project to be reinstated, so here it is. Thanks @SpencerJ for assisting with getting the topic reactivated in the forums. I've been tinkering on this on my personal build for a few months off and on. UUD 1.7 has been finished for a while now. I'll share some screen shots, and if anyone is interested, I can share the code. Not sure if I'll officially pick this back up, but we'll see where it goes. I still need to upgrade to UNRAID 6.12.X ha ha. Hope you are all doing well!

I second this! My spinning drives never get over 26C, but my Cache Nvme SSD can hit almost 70C while the Mover is running. These SSD temps are within normal operating ranges. Setting spinning drives too high poses risk, setting the SSD too low inundated me with emails 😂.

Is there a section for 30+? 😂

That is SERIOUSLY disappointing! No, I don't have anything to do with Varken, nor do I have the time to look into creating a replacement. If anyone takes up the VARKEN mantle, please let me know so we can collaborate. Note: Varken still works currently and it still in the UUD 1.7 forthcoming update. I actually just updated all of the UUD 1.7 panels to fully support Grafana 9.X. I'll be releasing the UUD 1.7 with Varken still as the dependent Plex/Tautulli DB plugin. Also, the UUD 1.7 is fully compatible with the latest UNRAID 6.10.X releases (just tested them personally). UUD 1.7 will most likely be my FINAL major update to this project as well. Everything should still work if you can download the dependencies/dockers, and if the UNRAID OS does not break anything in a future update. I did DEPRECATE the UNRAID API plugin/Docker, as a memory leak was pointed out by its developer (that project is dead also), and I have removed those panels from the UUD. There will be more than enough new bells and whistles in UUD 1.7 that I think are very useful and exciting for people to geek out on. It is the most polished, organized, slick, and purpose built UUD to date. I'm excited to share it with you guys. Now I just need to find some time to wrap it up and post it. Look out for it in Q1 2023. @SpencerJ

Hey there. I had no idea someone made a docker compose for the UUD. Thanks for letting me know. I would reach out to that developer directly. You could try starting over using the official instructions found at the beginning of this post and the 1.6 release notes right after.

DONE!