ChatNoir Posted March 6, 2021 Share Posted March 6, 2021 On 3/4/2021 at 4:57 AM, hogfixer said: One thing I did was change the displays to the last 24 hours, 7 days, 4 weeks, and 365 days. Under Query Options and Relative Time Today = now-24h Week = now-7d Month = now-30d Year = now-365d Thank you for the details, it was something that was bugging me for some time but I was not sure how to address it. I was able to quickly change all relevant fields with a Replace on the json in a text editor. 👍 Quote Link to comment
iccb Posted March 7, 2021 Share Posted March 7, 2021 Hmm. I have asrock rack X570D4U-2L2T motherboard. Cannot get ipmitool to working.... If I launch from my Debian machine command: ipmitool -H 192.168.xx.xx -U admin -P password -I lanplus sdr, I can see it is working great. But if I run that command from telegraf container, it won't work at all. Says only: Error: Unable to establish IPMI v2 / RMCP+ session. I have tryet on both, Alpine and Debian based containers... Any suggestions to try? In config I have: [[inputs.ipmi_sensor]] servers = ["admin:xxxx@lanplus(192.168.xx.xx)"] And in docker logs I can see: [inputs.ipmi_sensor] Error in plugin: failed to run command /usr/sbin/ipmitool -H 192.168.xx.xx -U admin -P xxx -I lanplus sdr: exit status 1 - Error: Unable to establish IPMI v2 / RMCP+ session Quote Link to comment
mwoods98 Posted March 12, 2021 Share Posted March 12, 2021 So I have followed the excellent guide on YouTube by Nate Harris. I have also adjusted the graphs to fit my setup but I'm still haven't trouble with a little missing data from some fields. I'm still not able to pull System Temps, Fan Speed and System Power. What they are not critical they are nice to haves if possible. For system temps 'B' is disabled - I have a feeling that if I get one of these working all 3 will work. Any help is appreciated. Thanks Quote Link to comment
mwoods98 Posted March 12, 2021 Share Posted March 12, 2021 16 minutes ago, mwoods98 said: So I have followed the excellent guide on YouTube by Nate Harris. I have also adjusted the graphs to fit my setup but I'm still haven't trouble with a little missing data from some fields. I'm still not able to pull System Temps, Fan Speed and System Power. What they are not critical they are nice to haves if possible. For system temps 'B' is disabled - I have a feeling that if I get one of these working all 3 will work. Any help is appreciated. Thanks Never mind, some how I missed the impi section in the telegraph conf. It's all working good now! Quote Link to comment
falconexe Posted March 12, 2021 Author Share Posted March 12, 2021 6 minutes ago, mwoods98 said: Never mind, some how I missed the impi section in the telegraph conf. It's all working good now! I was just writing up a reply to say check your Telegraf config file. Glad you got it figured out. Quote Link to comment
falconexe Posted March 15, 2021 Author Share Posted March 15, 2021 === DEVELOPER UPDATE === UUD 1.6 is close. Very close... 5 Quote Link to comment
falconexe Posted March 17, 2021 Author Share Posted March 17, 2021 On 3/14/2021 at 10:10 PM, falconexe said: === DEVELOPER UPDATE === UUD 1.6 is close. Very close... Alright, clear your schedules. 1.6 drops this weekend! My Target is Saturday. It's gonna be one where you'll want to upgrade ha ha. 3 1 Quote Link to comment
grigsby Posted March 17, 2021 Share Posted March 17, 2021 On 2/24/2021 at 8:57 AM, GilbN said: When you save, click the save variables checkbox OMG. Thank you! I feel dumb now. That was driving me crazy. Quote Link to comment
Flendor Posted March 18, 2021 Share Posted March 18, 2021 On 3/2/2021 at 11:15 PM, dbinott said: Wondering if anyone can help me figure out I am not getting data for some metrics? At one point I had the library data and stream data. I recently moved the server to a different location with different network, but I believe I changed IP addresses where applicable. Not sure why negative numbers in growth? Why some data about library but not others? I have disk data, but can't get overview? I had the same issue. I discovered that the database name and the Tautulli name for these were different. i.e. Movie vs Film, TV Show vs TV. If you edit each box you can change the section_name = xxxxxx to the correct name. Hope this helps as it took me a while to work out. Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 (edited) On 3/17/2021 at 12:35 PM, falconexe said: Alright, clear your schedules. 1.6 drops this weekend! My Target is Saturday. It's gonna be one where you'll want to upgrade ha ha. Development on UUD 1.6 is now COMPLETE! I'm finally heading to bed! When I wake up, I will gather screenshots and finish up the content and verbiage for the release posts. Still a few more hours of work, but I'll be glad to get this one out the door. I really hope you guys like it. Lots of exciting stuff for you to discover and unpack tomorrow! Edited March 20, 2021 by falconexe 6 Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 Engaging documentation mode... 4 Quote Link to comment
wes.crockett Posted March 20, 2021 Share Posted March 20, 2021 Apparently today was a good day to Google 'Unraid Grafana Dashboard'. I await your next post, @falconexe. Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 21 minutes ago, wes.crockett said: Apparently today was a good day to Google 'Unraid Grafana Dashboard'. I await your next post, @falconexe. Ha ha. Welp, it's about to happen. Uploading code now. Should be about 1-2 hours out. Screenshots are done, and I just have to get the posts written. Welcome to the UUD community. 1 Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 (edited) @SpencerJ @limetech The Ultimate UNRAID Dashboard Version 1.6 is here! This is the largest release yet 😁. Leveraging the power of the UNRAID API I bring you Array, VM, and Docker Monitoring. This new version also adds a dedicated SSD (Cache or otherwise) monitoring section complete with TBW monitoring to show SSD % of drive life used. There are a ton of other features, enhancements, bug fixes, improvements and continued refinement of the UI and color scheme. In total, UUD Version 1.6 adds 25 new Panels across 7 sections. Enjoy! 😉 New Dependencies: Dockers: UNRAID API (Install With Default Setup / Follow Current Project Install Guide) Download from Community Apps https://github.com/ElectricBrainUK/UnraidAPI New Grafana Plugins JSON API https://grafana.com/grafana/plugins/marcusolsson-json-datasource/?pg=plugins&plcmt=featured-undefined&src=grafana_footer Run Following Command in Docker: grafana-cli plugins install marcusolsson-json-datasource Dynamic Image Panel https://grafana.com/grafana/plugins/dalvany-image-panel/?pg=plugins&plcmt=featured-undefined&src=grafana_footer Run Following Command in Docker: grafana-cli plugins install dalvany-image-panel New Grafana Data Source: "UNRAID API" Dashboard Variables Please Note: This release is an example tailored to MY UNRAID Server. The intent here is that you will take this and modify it for your Setup. You have everything you require to template new panels and tailor it to your own needs. Highlights: New UNRAID API Related Panels Dynamic Header Host Name Array Status Parity Status Mover Running (True/False) Parity Check Running (True/False) Overwatch Docker Monitoring with Real Time Dynamic Images/Statuses Dockers (Running) Dockers (Stopped) VM Monitoring with Real Time Dynamic Images/Statuses VMs (Started) VMs (Stopped) Docker Dockers (All) Docker Details Virtual Machines VMs (All) VM Details Server Hardware Shows More Detail Regarding Specific Server Hardware Specifications Array Growth Array Growth (Lifetime) Shows Array Growth Over Rolling Last 10 Years (1 Data Point Per Day) SSD (Cache) Drive Health SSD Writes (Day) Shows SSD Writes For Rolling Last 24 Hours at 15 Minute Intervals Controlled By New SSD Drive Variable SSD Writes (Year) Shows SSD Writes For Rolling Last Year at 1 Day Intervals Controlled By New SSD Drive Variable SSD Lifetime Writes Measures SSD Lifetime Writes Math Based on Manufacturer Max TB Written (TBW) Specification Color Based on Thresholds (Derived From Manufacturer TBW) SSD Lifetime Reads Measures SSD Lifetime Writes Math Based on Manufacturer Max TB Written (TBW) Specification Color Based on Thresholds (Derived From Manufacturer TBW) SSD Life Used Calculates Used Drive Life Based on Lifetime Rights Divided by Manufacturer Max TBW Math Based on Manufacture Max TB Written (TBW) Specification Color Based on Thresholds (% of Manufacturer TBW) SSD Drive Temperature (Dynamic Colors Based Temp Thresholds) Plex Library Statistics Combined Growth Chart Across All Libraries The old way was just ugly and too performance intensive This is a nice one stop shop! Completely Overhauled with New Panels with Media Type Breakdowns Across Sub Libraries Changes Variable Now Used for Varken Datasource (Set at Top of Dashboard) Updated GUI Panels/Sizes/Locations/Colors/Themes Change Uptime Panel to Fit New Theme System Power Panel Changed System Power to Bar Charts Scaled the Volts to a Range Between 1V and 12V Array Growth Changed All Panels to Rolling Timelines Today So Far = Last 24 Hours This Week So Far = Last 7 Days This Month So Far = Last 30 Days This Year So Far = Last 365 Days Plex Stats Renamed to Plex Streams Plex Heatmaps Changed All Panels to Rolling Timelines Today So Far = Last 24 Hours This Week So Far = Last 7 Days This Month So Far = Last 30 Days This Year So Far = Last 365 Days Plex History Device Types Changed Chart from Pie to Donut Stream Types Changed Chart from Pie to Donut Media Types Changed Chart from Pie to Donut Media Qualities Changed Chart from Pie to Donut Changed Panels to Rolling Timelines Today So Far = Last 24 Hours This Week So Far = Last 7 Days This Month So Far = Last 30 Days This Year So Far = Last 365 Days Plex Library Growth Changed All Panels to Rolling Timelines Today So Far = Last 24 Hours This Week So Far = Last 7 Days This Month So Far = Last 30 Days This Year So Far = Last 365 Days CPU 01 Core Load Changed Labels So Cores Reflect Only the Core Number Before: Core01, Core02, ... After: 01, 02, ... This Improves Readability and Scalability on Smaller (Non 4K Displays) Array Disk Storage Used % Field: Removed Cell Background Colors and Changed Override to Basic Gauge Improved Visual Experience and Readability Array Total Storage Used % Field: Removed Cell Background Colors and Changed Override to Basic Gauge Improved Visual Experience and Readability Flash Storage Used % Field: Removed Cell Background Colors and Changed Override to Basic Gauge Improved Visual Experience and Readability Unassigned Storage Used % Field: Removed Cell Background Colors and Changed Override to Basic Gauge Improved Visual Experience and Readability Flash Storage Used % Field: Removed Cell Background Colors and Changed Override to Basic Gauge Improved Visual Experience and Readability Drive S.M.A.R.T. Health Overview Temp (C) Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Drive S.M.A.R.T. Health Overview Temp (C) Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability UDMA CRC Errors Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Current Pending Sectors Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Reallocated Sectors Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Reallocated Events Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Offline/Uncorrectable Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Helium Level Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Drive S.M.A.R.T. Health Summary Min Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Max Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Mean Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability Total Field: Removed Cell Background Colors and Changed Override to Colored Text Improved Visual Experience and Readability UPS Stats UPS Runtime Left Removed Exclamation Point From Panel Name Changed All Panels to Rolling Timelines Today So Far = Last 24 Hours This Week So Far = Last 7 Days This Month So Far = Last 30 Days This Year So Far = Last 365 Days Removed Cell Background Colors Improved Visual Experience and Readability Fixes/Improvements All Panels are Now Driven by Datasource Variables Adjusted All Drive Path Panels to Use Regex Resolves ROOTFS Issue Some Users Were Experiencing UUD Should Now Not Care How Your Paths are Setup and Just Work Adjusted Drive Variables to Select Distinct Based on Selected Time Interval Removes Missing/Old Drives From Panels and Removes Legacy Data Prevents Old Device IDs "SD*" From Showing Up After Reboots Provided You Select a Timeframe After the Reboot Varken Geolocation Map Fixed Bug Where Geo Map Header Was Hidden Behind UI Elements Gave Panel a New Name of "Stream Origination" Map Now Automatically Centers on Current Stream (Last Geo Hash) Changes Default Zoom Level to 3 (Zoom Out By Factor of 1) Changed Geo Location Blips to Yellow to Match Plex Color Theme Added Mouse Zooming/Scrolling (Wheel) to Map General Graphs Now Start at "0" Where Applicable (Docker Ram) % Graphs Now Cap at 100% (CPU Graphs) Drive Queries Now Correctly Account For Dynamic Host Variable (Custom Query and Parenthesis Placement) UUD 1.6 Screenshots (With Personal Info Redacted): A TREMENDOUS amount of work has gone into this release. There are a ton of people who have contributed to this release whether it be bug fixes, suggestions, improvements, or new ideas. I will do an updated post to specifically call out each and every person who helped with this 1.6 build. First, though, I just want to get this out to you guys ASAP. There are a few tips and tricks that I will also release in a post soon that will detail some of the gotchas with the UNRAID API and new Grafana Plugins. I just need some time to put that together. In the meantime, please let me know how your baseline 1.6 install is going. I really hope you guys enjoy this release!!! Edited March 21, 2021 by falconexe 1 3 Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 (edited) DEVELOPER UPDATE: UUD 1.6 Instructions UNRAID API Panels: You will need to adjust the UNRAID API related queries to get them to work for your server. Once you have the UNRAID API docker up and running, please amend any panels that use this docker (see release notes for a list) to include YOUR SERVER IP and Level of Security (HTTP Vs. HTTPS) where applicable. Do this for all of these panels that use the IP address (not all do...) and you should see data. Docker/VM Images and the Grafana Dynamic Image Panel Plugin Issues: There are a couple of things I noticed during development that are some quirks regarding the third party dependencies and plugins that we have to use to show all of this pretty data. One of the biggest issues I immediately found had to do with browser certificate security and the Image Panel Plugin. Many of you may have run into an issue by now where the Docker/VM images do not show up and only the item words do. It will look something like this: This is due to the plugin not recognizing the authentication to the UNRAID web front end where these images live. We need to help it out the first time around. This fix will last until the browser cookies get wiped or you delete your web history. In order to fix this (this example is Chrome, but this workflow will also work on FireFox and other browsers), you need to right click any one of the items, and open the image/link in a new window. Chrome Example: Firefox Example: Next, you will be presented with the UNRAID login page. Enter your credentials and you will land on your UNRAID web GUI homepage. Now go back to the Grafana UUD 1.6 dashboard tab and refresh it. The Docker/VM images should magically appear. You can now close that second UNRAID tab you opened. From what I can tell, this has something to do with the SSL certificate and the dynamic autogenerated URL that the UNRAID web GUI uses (if you chose to secure it). The image plugin just can't handle it natively. If anyone has a better fix for this, please let me know and I will incorporate it into the UUD. Regarding how these image panels actually work, YOU WILL NEED TO ENTER YOUR SERVER IP into each of the image panels. You can do this by editing the panel and going to the right side settings area. Finally, modify the URL > Base URL IP address. If you are using SSL with your UNRAID Web GUI, stick with "https://", if you are not, then use "http://". Calculating TBW For the SSD Health Panels In order for the SSD health panels to work correctly, there is some manual configuration that must be performed for YOUR SSD. If you do not do this, the numbers WILL NOT BE ACCURATE if you have a different SSD Make/Model/Size. First, you must manually edit the panels and select the Serial Number for your SSD. This IS NOT driven by the SSD variable due to the way these queries work. To Calculate Your TBW (Terabytes Written) You will need to do the following: 1. Identify your SSD Manufacturer, Make, and Model 2. Go to Your SSD Manufacturer's website and find the TBW value for for your drive in Terabytes 3. Change the MATH functions on the SSD drive health panels to match your TBW and Data Units (LBA Size) Example: My Cache Drive is a 1TB Samsung 970 EVO. https://www.samsung.com/semiconductor/minisite/ssd/product/consumer/970evo/ On the specification page, you will find a stat called TBW. For my particular drive, you will see 600 TBW. This means that you can write up to 600 Terabytes for the life of the drive before the manufacturer expects you to possibly run into problems. The rule of thumb is that if you approach that TBW threshold, you may want to start thinking about replacing that drive. This 600 TBW number (Yours may vary) needs to be entered into the following MATH function on the "SSD Life Used" panel in order for this to work for your drive. Another part of this formula uses something called Data Units Written. My SSD uses 512. You can find that number by looking at the properties of the drive within the UNRAID GUI. First go to the UNRAID Main Page and click on the Cache (or drive) Link: Next, go down to the Identity section at the bottom and look for the following property: Finally, ensure the following part of the MATH formula reflects this LBA Size (How Data Units Are Calculated Internally). In the end, the panel will spit out this nice number in %. This is the percent of drive life you have used thus far out of the total drive health (TBW). You will also need to adjust the Data Units number (512 in the example above) in the math sections of the "SSD Lifetime Writes" and "SSD Lifetime Reads" panels. Once you are done, To check your math, look at your SSD Lifetime Writes and divide it by the TBW number provided by the manufacturer. You should end up exactly correct! 49.31 TB Divided by 600 TB (TBW) = 8.22% Life Used Or in Other Words, I have 91.78% of my SSD drive life remaining. Edited March 21, 2021 by falconexe 2 Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 (edited) Collaborator Thanks 🤝🎉 I promised I would call out all those who helped with UUD 1.6. A big thanks to anyone and everyone who helped with bug fixes, new ideas, supplied example code, collaborated, etc... If I missed anyone, I apologize. Feel free to let me know so I can add you. @caplam SSD Heath Panel Inspiration (Page 18) @corgan UNRAID API Idea, Documentation and Examples (Page 19) @ChatNoir Docker RAM Graph Starting at 1 Instead of 0 (Page 19) & Drive Query Fix (Page 19) @jbartlett CPU Graph Wasn't Capped at 100% (Page 19) @RockDawg Bugfixes Page 21 @GilbN RootFS Wildcard Fix @LTM It's a surprise that will be announced soon! @ElectricBrainUK For Creating the UNRAID API Docker! Could not have done it without him! Edited March 21, 2021 by falconexe 2 Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 1 minute ago, SpencerJ said: 🙌🙌🙌🙌🙌 Epic! Ha ha LOVE IT! Thanks very much. Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 2 minutes ago, SpencerJ said: 🙌🙌🙌🙌🙌 Epic! @SpencerJ Feel Free to launch the social media and web campaigns LOL. 1 Quote Link to comment
Alex.b Posted March 20, 2021 Share Posted March 20, 2021 Hey, It seems amazing ! How is the CPU / Ram consumption of this all dashboard ? Quote Link to comment
falconexe Posted March 20, 2021 Author Share Posted March 20, 2021 17 minutes ago, Alex.b said: Hey, It seems amazing ! How is the CPU / Ram consumption of this all dashboard ? That really depends on a LOT of factors including how many panels you have, how far back the data is being queried for, what kind of browser you use, and how good your CPU is. Here is a snapshot of my average load going back 24 hours: On refresh it peaks at about 1GB of RAM and 25% CPU for about 10 seconds. Download it and give it a shot. Quote Link to comment
skaterpunk0187 Posted March 20, 2021 Share Posted March 20, 2021 I'm sure it's me not configuring my telegraf.conf file properly but I can not get my disks to show up in the variables. I thought this was normal till I seen the screen shots of the new 1.6 variable section. All my drives show under the Array Disk Storage and SMART data sections on the dashboard. Off hand does anyone know what I have to uncomment to fix. Thank you Quote Link to comment
deanpelton Posted March 21, 2021 Share Posted March 21, 2021 I have set this up but haven't got any images for my VM's or my Dockers. Is there some specific that looks at these that I can check out? Quote Link to comment
Frazzer951 Posted March 21, 2021 Share Posted March 21, 2021 I've just finished installing V6 and there were a few things I had to change to get things working/showing properly. First off, for the server name I had to update it to use the correct IP, being the same as I typed it into the UNRAID API docker, I also had to do the same change for the server status pane. For CPU temp, I changed it to use the search query for `sensors` instead of `ipmi_sensor`, but I had to modify it to be "WHERE feature = smbusmaster_0" IDK if that was because I'm using a Ryzen 7 3700x or if I just don't have something setup properly. Problems I'm having: Dockers are not showing their Images, only the names. It is showing "No data" for the panes with 'SSD Lifetime Writes', 'SSD Lifetime Reads', 'SSD Life Used', and 'SSD Temperature', I'm not sure what I need to do to fix those, I have a Samsung 970 Evo if that helps at all, but the SSD Writes day and year both work fine. Besides those problems everything seems to be working fine. Thanks for any help and suggestions people offer Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.