What is Laya?

Laya is a small AI model that makes quick decisions about text. You send it a piece of text and a few questions, and it answers all of them in one pass. Every answer comes with a probability, so your own code can tell how sure it is.

It understands three kinds of questions:

• Choice: pick one option from a list, like which department should handle a ticket

• Score: place the text on a scale, like how urgent it is

• Yes / no / unsure: like whether the user asked for a refund

What is it for?

Use it where you want a fast, structured answer and a full chat model would be slow or overkill. Good fits are sorting support tickets, routing requests to the right team or model, moderation, and guardrails in front of a larger model. It works in more than 100 languages, and a built-in router picks the right model for each request.

About this container

Laya does not publish a Docker image, so I build one from their source code. The Dockerfile and the GitHub workflow that builds it are public in the image build repo linked below, so you can see exactly what goes into it. The image rebuilds on its own whenever Laya puts out a new release.

When you install, Community Applications asks you to pick a tag:

• cpu runs on any server.

• nvidia runs on your NVIDIA GPU. It needs the Nvidia Driver plugin, and the template fills in Extra Parameters for you.

The API runs on port 8012. Open http://YOUR-SERVER-IP:8012/docs to try requests right in your browser. Setting an API key is optional.

Links

• Setup guide: https://github.com/PikkonMG/unraid-docker-templates/blob/main/docs/LAYA-SYSTEM-ONE.md

• Image build repo: https://github.com/PikkonMG/laya-system-one-docker

• Laya project: https://github.com/NandhaKishorM/laya

• Laya documentation: https://nandhakishorm.github.io/laya/

Need help?

Post your container log and the tag you installed, and I will take a look.

Reserve.