Von is a small local model for making quick decisions about text. A chat model writes its answer one token at a time. Von reads the text once and answers the questions you give it, each with a probability you can put a threshold on. That makes it handy in front of a bigger model: route a message to the right place, triage a ticket, or check a guardrail before anything expensive runs.

It serves the same /v1/systemone API as TypeSafe's Jev, so anything written for Jev can point at your server instead.

Von has no official Docker image, so I build one from the Von release on PyPI. A GitHub Action checks for a new version every day and rebuilds the image when one comes out.

Setup guide: https://github.com/PikkonMG/unraid-docker-templates/blob/main/docs/VON-SYSTEM-ONE.md
Project: https://github.com/wfzyx/von
Image build: https://github.com/PikkonMG/von-docker

What you can ask it

There are three kinds of question, and you can mix them in one request:

• choice picks one option from a list you give it

• score places the text on a scale you define

• noul gives the probability that a statement is true

Pick a tag when you install

Community Applications asks you which one you want.

• cpu works on any server and runs on OpenVINO.

• nvidia needs the Unraid NVIDIA Driver plugin and driver 560 or newer. CA fills in --runtime=nvidia for you.

First start

The first start downloads about 3 GB of model weights into /mnt/user/appdata/von-system-one. The cpu tag also saves an OpenVINO copy of the model there, about 3 GB more. The container shows healthy once the model is loaded, and later restarts skip the download.

The API key is optional. Leave it blank and anything on your network can call it. Set one and clients have to send it as a bearer token.

Try it

The API docs page is at http://MY-UNRAID-IP:8013/docs. For a quick test from any machine:

curl -s http://MY-UNRAID-IP:8013/v1/systemone \
  -H 'content-type: application/json' \
  --data '{
    "state": "I was charged twice. Please refund the duplicate charge.",
    "questions": {
      "department": {
        "type": "choice",
        "instructions": "Which team should handle this?",
        "criteria": {"billing": "payments and refunds", "technical": "bugs and outages"}
      }
    }
  }'

Add -H 'Authorization: Bearer MY-API-KEY' if you set a key. On my RTX 3060 an answer comes back in about 50 ms. The guide has a longer example with all three question types.

---

Post here if something breaks on the Unraid side and I will take a look. Bugs in Von itself are better raised on their tracker: https://github.com/wfzyx/von/issues

Reserve.