Skip to content
View in the app

A better way to browse. Learn more.
Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.
Unraid Summer Sale in live: 20% off Starter and Unleashed + buy one, get one 50% off

Unraid + LLM

mathomas3
in Lounge

Unraid + LLM 3 members have voted

  1. 1. LLM via...

    • Docker
      50%
      1
    • VM
      50%
      1

Please sign in or register to vote in this poll.

Featured Replies

Hello,

I just got in a pair of Tesla M40s that I would like to use for LLM. I plan on putting that into the server but am a little bit concerned about loading it up as a docker setup.

How would I limit the llm to those GPUs, are the llm and Plex going to fight for those resources?

Given that, would it be best to load it up into a VM and do hardware passthrough? Haven't done that in unraid as of yet, is that a thing?

Thanks

  • Quote

    • Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Reply to this topic...
    Go to topic listing

    Account

    Navigation

    Search

    Search

    Configure browser push notifications
    Chrome (Android)
    1. Tap the lock icon next to the address bar.
    2. Tap Permissions → Notifications.
    3. Adjust your preference.
    Chrome (Desktop)
    1. Click the padlock icon in the address bar.
    2. Select Site settings.
    3. Find Notifications and adjust your preference.