AINode Pocket

Install

Then open http://localhost:8430. New here? Install the farm CLI first.

What it does

Registers one or many Tiiny AI Pocket Labs, shows what each one is doing, manages the models on them, and puts a single OpenAI-compatible endpoint in front of the fleet. /v1/models is the union across your devices and /v1/chat/completions routes by model id to a device that has that model loaded. Requests to one device are serialised through a per-device lock, so several callers queue and get answers instead of colliding with device error 150004, and when nothing can serve a request the 503 says which device holds the model and what to do about it. Includes a chat page that uses the same endpoint and the tiiny-bench suite embedded as a page and a CLI subcommand. Python standard library only, no pip dependencies, no accounts, no cloud.

Home page

Screenshots

No screenshots yet.

Art in the farm's hand

Describe this app's scene in one sentence and the farm draws a header and an icon in the same style as every other app on the shelf. How this works.

Describe your app's scene in one sentence name the objects in the picture, not your app

Generate artThree drawings a day for one app.

Use these opens the update form with the new pair attached. A published app's images change through the same pull request as everything else.