Jump to content

falconexe

Community Developer
  • Posts

    789
  • Joined

  • Days Won

    15

Posts posted by falconexe

  1. 5 minutes ago, FreeMan said:

    Well... sorta...

    For my (Day) query, where I've got the squared off graphs, I have this:

    
    SELECT last("used") FROM "disk" WHERE ("path" = '/mnt/user0' AND "host" =~ /^$Host$/) AND $timeFilter GROUP BY time($__interval)

    Note the group by ($__interval) (there are 2 underscores there)

    The (Week) query has:

    
    SELECT last("used") FROM "disk" WHERE ("path" = '/mnt/user0' AND "host" =~ /^$Host$/) AND $timeFilter GROUP BY time($interval)

    with no underscores in it.

     

    I tried editing the (Day) query, but it automatically changes it back. If I edit in "text editor" mode, then hit "Apply", it applies the change, but makes no change in what I see. When I go back in to edit, it's still in text edit mode and still shows no underscores. As soon as I go back to "graphic" editor mode, it shows it with the 2 underscores.

     

    Try clicking the $. It will sometimes turn blue and auto populate. You can also try removing the group by, and then reapplying it. You can also set it to however many seconds you want, like "30s", so "time(30s)".

     

    image.png.56e97b5bd2f98be153fe305ea657b4fd.png

  2. 2 hours ago, FreeMan said:

    On my array growth graphs, the Weekly growth shows rounded edges, while all the others seem to show pretty sharp corners. I took a look through the options and didn't see anything that looked like it should control this. Am I hallucinating, is my data growth for the week actually rounded like that, or did I miss some sort of obvious (to everyone else) setting?

    image.png.cc38df25e190cdeef3af13c357357c85.png

     

     

    No you are not hallucinating. That is controlled by the Group By "Interval" option within the query itself. Grouping by time will curve the edges. It is a nice feature to curve 0 values (nulls) into a graph without having a gap. You can add that group by to all, or remove it from all. I would definitely match them all up one way or the other though.

     

    image.png.85723ae44df0c05fd09163aad3d2faae.png

     

  3. 4 hours ago, RockDawg said:

    I'm new to Grafana myself so I may be wrong, but I think if you go in to edit the panel, you can click on the Query Inspector button.  In the pane that slides out you can click on the JSON tab.  I think if you copy an paste that code into here, we can copy and paste into our dashboard.

    Right click any panel and select...

     

    image.png.6ce3de48dfc86f2ce4ede679cde304e6.png

     

    Post the JSON.

     

    To import the JSON, click any panel, and select the same option. Copy the new JSON code (Control + C), Delete all existing JSON code from the original panel (Control + A), and then Paste in the new JSON (Control + V) to make it the new version.

     

    image.thumb.png.09b4046b16b75f4fe3a858e7a08cb984.png

     

    Click Apply. This creates the new Panel. Then to keep it, SAVE YOUR DASHBOARD.

     

    • Thanks 1
  4. Hey guys. We had a Corona virus scare over here (been super sick), so we've been dealing with that. I was hoping to have this out by tonight, but I am still working on it. I have the code written and the JSON is independently completed, but I have yet to integrate it into the UUD. And the the largest task of all is documentation and release notes (and that takes a LONG time). I've been going back and forth debating whether or not to release this independently as the Ultimate Plex Dashboard (UPD), or just integrate it into the UUD as version 1.5. I've decided to incorporate it into UUD, but for those of you who want a dedicated Plex Dashboard, I can release a standalone version of this as well, if there is enough demand. I'll post updates next week on a potential release date.

     

    I hope you all have a fantastic Thanksgiving!

    • Thanks 3
  5. Thanks @Hoopster and @MrLondon for helping out.

     

    Here is my Telegraf config.

     

    telegraf.conf

     

    If you import this into your appdata folder for Telegraf (mine is \\MassEffect\appdata\Telegraf), it should get that part running. You may still need to tweak things for your setup/liking including your server IP address (LINE 112). You also need to set ALL of your variables up top in the dashboard OR IT WILL NOT WORK. Finally, you will want to verify your Docker Configs for Telegraf/Grafana/InfluxDB.

     

    Everyone in here has been able to get the UUD at least up and running at a baseline. I suggest you carefully read page 1 of this topic (especially the DEPENDENCIES section), and then re-read @GilbN's fantastic tutorial website. Everything you need is in this forum or within that link. That is exactly how I got started knowing absolutely zero... Our UUD community is very helpful as you can see, so we'll get you sorted out one way or another. Good luck and report back.

     

  6. Just now, falconexe said:

     

    GUS includes UUD 1.3 with my permission. I am not sure if @testdasi has included my latest release UUD 1.4. However, as Hoopster said, you can manually import version 1.4, and soon 1.5, right into Grafana once GUS is installed.

     

     

    Once more thing. Since UUD version 1.5 will be using Varken to source Plex stats (via Tautulli), GUS will no longer provide all functionality out of the box (unless @testdasi adds Varken support).

     

    You will still need to install and configure Plex/Tautuilli/Varken if you want to see Plex stats. If Plex is of no interest to you, then you can just remove those panels and just get the 1.5 code updates everywhere else.

  7. 24 minutes ago, Hoopster said:

    I found it much easier to install the Grafana unRAID Stack (GUS) docker container which installs and configures all three containers.  After that, all I had to do was make sure the telegraf.conf was configured for the sources I wanted (basically uncommenting a few lines and adding one source that was "missing").  I then imported UUD as the dashboard used in GUS.  It was all very easy compared to trying to work with the containers individually.

     

    GUS includes UUD 1.3 with my permission. I am not sure if @testdasi has included my latest release UUD 1.4. However, as Hoopster said, you can manually import version 1.4, and soon 1.5, right into Grafana once GUS is installed.

     

  8. 3 minutes ago, stFfn said:

    thats what i tryed to follow but i got stuck at the telegraf settings as i mentioned ;)

    I can post my Telegraf Config later today. What SPECIFICALLY are you stuck on? If you read my instructions on page 1, you just need to enable certain features by removing the comment “#” in front.

     

  9. On 9/6/2019 at 1:09 AM, falconexe said:

    I just bought/built this insane rig. Dual 8 Core CPU, 30+ Devices, 200TB usable (still have one 14TB drive pre-clearing so those pics show 184TB). Meet "MassEffect". 45 Drives Storinator Q30 Turbo. Huge improvement over my old Norco 24 bay rig (now backup server). Rock solid temps peaking at 32C during parity/rebuilds. From the largest server poll thread, this may be 🤷‍♂️ the largest single UNRAID build yet (at least that I have seen documented) and completely pushes UNRAID to it's current limit on number of drives. I can take this thing all the way to 448TB with 28X16TB drives with dual parity if I want to get really crazy. Loving it!

     

    Just hit 270TB total in a single server with 240 Usable.

     

    image.png.bd0b53bc32b2116feced5e42053673a7.png

     

    I also just moved to a new house with a dedicated server room with built in cooling.

     

    I have had drives idle as low as 19C, and my array drives stay in the mid 20's under load. The yellow is my NVMe cache drive, and the green is another Unassigned Device. The array is always cool and the room is regulated at a constant 66F. This Storinator chassis continues to impress, and does even better when you give it some help with HVAC.

     

    image.thumb.png.b7e7c222a9a36bc341d75e44ead083b2.png

     

  10. 4 hours ago, jbartlett said:

    I stumbled across this thread and promptly had a nerdgasm.

     

    Loving the Dashboard! Only change I've made so far is to add an Y axis cap of 100 so the CPU graphs don't scale to 125% after a core hits 100%.

     

    Almost spit out my water when I read this. That is hilarious. Glad you are loving it! I'll add your suggestion and add you as a contributor once it is LIVE.

    • Thanks 1
  11. 7 hours ago, Vaggeto said:

    Hello! I'm having some issues getting this working. I've got all dockers installed and running, but it doesn't appear that the telegraf database is being created when I start telegraf because Grafana isn't finding it.

     

    My ports for influxDB are 8083 and 8086, which I've left at defaults and I've tried pointing Telegraf.conf at both of those and Grafana at both of those.

     

    Any ideas?

     

    Here is a telegraf.conf: https://pastebin.com/N0bGbjVe

     

    I don't have time right now to deep dive, but I would suggest following the link on Page 1 > Post 3 where I linked GilbN's great tutorial website for getting started. Here it is again below. Also have a good look at my instructions in post 1. If anyone else wants to take a crack at supporting Vaggeto, it would be much appreciated. I'm still unpacking and dealing with house related activities. Good luck!

     

    https://technicalramblings.com/blog/how-to-setup-grafana-influxdb-and-telegraf-to-monitor-your-unraid-system/

     

  12. On 11/12/2020 at 1:15 AM, corgan said:

    Hello,

     

    thanks for this awesome dashboard!

    One thing I always add to my dashboard are the running Docker/VM Icons and some switches to control the container/VMS from by overall IT Dashboard.

    Maybe you would implement this as an optional row?
    For this i'm using the unraid-api as direct json datasource and the dynamic image plugin in grafana.
     

     

    Yeah that is freakin sweet. If you want to DM me the code/documentation, I'll add that to version 1.6 (maybe 1.5), credit you, and add you as a contributor. This is what I love about this community. Keep stuff like this coming... 👍 

  13. Our move was successful, bit I'm still unpacking over here. Finally got my servers setup into my new dedicated sever room. I'll circle back on the previous posts (questions and bug fixes) and start working on the UUD again soon. My current plan is to release version 1.5 by Thanksgiving. Thanks for your continued patience and support everyone. Hope you guys are good and staying safe out there...

    • Like 2
  14. Welp, there is something seriously wrong with this drive. It just disappeared again, no where to be found in the GUI with the array started or stopped. Seems like it is going DEAD intermittently. Not a power issue, and not a cabling issue. I'm going to pull it and replace it with a new 14TB drive. I'll throw this old one into my backup server and run some pre-clears on it (if it can even handle that). Sucks because it is less than a year old. I'm not RMAing it either because of security concerns. No worries. Thanks.

     

     

     

  15. 10 hours ago, itimpi said:

    Q2: Do NOT format unless you want to lose the drives contents.  A format creates an empty file system on the drive (currently being emulated) and updates parity accordingly.   A rebuild always puts onto the drive exactly what you see on the emulated drive and is NOT preceded by a format.

     

    Maybe the issue is that IT IS trying to format. And that IS NOT a normal part of the rebuild process. I wonder of the XFS file system became corrupted and that is why it is not being recognized as the missing disk it actually is.

     

    So the real question is, is the GUI indicating that the disk will be REBUILT here? Or is it indicating that it will be FORMATTED?

  16. I am well versed with how to rebuild data drives after a failure and a the wiki. I've done this a few times in the past without any issues.

     

    Can you please clarify the following?

     

    Since UNRAID will not recognize Disk 7 as the true original disk, and it is trying to format it, won't it just rebuild the same Disk 7 (physical drive) with the contents from the emulated Disk 7? Yes, the physical drive will be wiped, but it would be rebuilt from the contents of itself. You said I should not do this in Q2...

     

    Screen Shot 2020-11-01 at 02.06.52.png

     

    Doesn't that mean that it will be OVERWRITTEN with the contents of the EMULATED Disk 7?

     

    I don't care if Disk 7 gets wiped as long as it gets replaced with itself. I just didn't want the emulated Disk 7 to disappear.

     

    In the end, it is just very odd that since the same disk that became disabled, was put back, and it won't just recognize that and start the array.

     

  17. 28 minutes ago, itimpi said:

    Q1:  As far as Unraid was concerned there WAS a problem.

     

    Q2: Do NOT format unless you want to lose the drives contents.  A format creates an empty file system on the drive (currently being emulated) and updates parity accordingly.   A rebuild always puts onto the drive exactly what you see on the emulated drive and is NOT preceded by a format.

     

    Q3: Not sure about the best way to handle this.   Are you certain that nothing has been written to the array since the drive played up?   

     

    Q1. Yeah, shoulda grabbed the logs/diags, but I was in the middle of a time sensitive move out...

     

    Q2. THANKS for confirming that I SHOULD NOT do that.

     

    Q3. YES, no writes to the array WHATSOEVER. The array was only started for about 2 minutes once it was physically moved to the new house (after I checked all cables), and I saw that drive 7 was not assigned, but was showing up in UD. I then stopped the array. Nothing writes to Drive 7 like a VM or anything docker/plugin related. All shares are set to READ ONLY.

     

     

    Here is my current plan. MOVE all emulated data (4.55 TB) via unBalance plugin to other drives. Once data is secure, perform the format (new device) of Disk 7 (same physical drive) and see how it responds. That way no data is actually lost/risked. Or I can do that same plan, but trash drive 7, and replace with a new larger (because why not?) precleared drive.

     

     

    Thoughts?

     

  18. Welp, I've gone a very long time without a single drive issue/failure, and I guess I was due.

     

    Here is the Order of Events:

     

    1. Stopped the Array (Was going to Power Off Due to a House Move)

    2. Disk 7 Threw an Error and Said "Not installed" Immediately After the Array Stopped. (Red Banner Notification Stating Disk Was Disabled)

    3. Rebooted UNRAID (Hoping the Problem Would Just Go Away)

    4. Upon Array Start, Disk 7 Still Showed "Not Installed" (Was Not Displaying Anywhere in GUI)

    5. Stopped the Array and Powered Off (Moved Chassis to New House)

    6. Once in New House, I Opened the Chassis and Reseated Every Cable on HBA cards

    7. Powered On Array

    8. Disk 7 Still Showed "Not installed", But is Now Showing Up and Powered on Under Unassigned Devices (UD) with XFS (correct) Partition

    9. Ran S.M.A.R.T Test on Disk 7 in UD and Came Back Clean

    10. Stopped Array

    11. Assigned UD Disk 7 to Array Disk 7

    12. Disk 7 Now Shows Blue Square (New Device) & UNRAID Warned That All Content on Drive 7 Will Be Lost (Assuming Due to Rebuild)

    223699868_ScreenShot2020-11-01at02_06_52.png.9988a85ab5608b037da134f25f032520.png

    13. Did NOT Proceed

     

     

    Questions:

     

    Q.1. How come UNRAID could not just start the array since the previous drive was placed back into the same exact drive assignment? The drive literally blinked out like a lightbulb, and there had been no signs of trouble prior to this. S.M.A.R.T. comes back clean. I thought if the same drive was assigned in the same spot, the array would just start right up.

     

    Q.2. Assuming I proceed with the format, the drive would be rebuilt from the Dual Parity (emulated contents of Disk 7). Is this a correct assumption? I also assume that NO DATA will be Lost that Was On Drive 7? I'd hate to proceed and find out that Drive 7 formats correctly, but that all of the previous data (emulated via parity) is now gone. From past experience, this would NOT be the case and once the disk is rebuilt from parity, it would be an exact duplicate of the pre-issue Drive 7.

     

    Q.3. Is there any way to get this drive to just start without a data rebuilt/format?

     

    I'm not touching this until some more seasoned experts chime in. I've been doing UNRAID since 2014, and have had drive failures/successful recoveries in the past, but I have never seen this particular set of circumstances and/or series of events (workflow). I did some searching on the forums and did not come across this exact scenario.

     

    I have everything properly backed up, but I would like to understand completely what just happened. I may just buy a new drive and move on, but that would be the easy road 😂

     

    @SSD Any thoughts? Maybe I'm just overthinking this. Been a very long 2 days with no sleep due to a pack/move/unpack for a new house... I just put this thing into its new air conditioned server room (not final, still building out the rack...)

     

     

    Thanks for the help guys!

     

     

     

     

×
×
  • Create New...