minaiml

min ai ml — models on hardware you own

minaiml (say it minimal) is PYTHAI's delivery layer: the software that runs reasonable-sized models on hardware you already own. A mixture-of-experts model is mostly idle — a router wakes a handful of experts per token and leaves the rest on disk. Delivery is the art of exploiting that.

devicemodeltok/sresidentengine
MacBook Pro M3 Max, 48 GBQwen3.5-397B-A17B4.36~6 GB of 209 GBflash-moe
iPhone 17Qwen3.5-35B-A3B111.4 GB of 13 GBFlash-iOS
Raspberry Pi 5, 8 GBDeepSeek-V4-Flashflash-pi-dsv4
2-core CPU VPS, no GPUmindXtrain39, 135M dense0.19Ollama

The slowest row is ours, and it stays: a 135-million-parameter dense model runs three hundred times slower than a 397-billion-parameter sparse one. Sparsity, not size, decides what a small machine can run.

Smart phones, plural. A phone at 11 tok/s is not a terminal for somebody else's data centre — it is a node. That reframes the problem: not "how large a model fits on this device", but "what does a mesh of small devices know together". The catalogue already carries the cluster layer — exo builds an AI cluster from everyday devices, distributed-llama splits one model across machines on a LAN, petals does it over a swarm.

The floor is two processors. mindX is the existence proof, and it is deliberately unglamorous: 2 CPU cores, 7.8 GB of RAM, no GPU, self-throttled to a third of the processor. On that it trains its own weights from its own memory — dreams become a corpus, the corpus trains a 135M actor, and a proof-of-recall gate decides whether the result is allowed to exist. It usually isn't: generation 39 is the newest the gate accepted, and every generation after it was refused. A gate that never refuses is not a gate.

That is the paradigm the phone inherits. CPU is the standing resource — always on, marginal cost zero, already in your pocket. GPU and rented capacity are episodic: you pay for a training event, then tear it down. So intelligence originates at the bottom and scales on demand, rather than living in one large machine somebody else owns. A thousand phones that each know a little, and can ask each other, is a different architecture from one model that knows everything.

Licence position. PYTHAI hosts no engine and no engine-derived artifact. The catalogue is a set of pinned references on GitHub, each carrying a FORK.json with its upstream, commit and licence — and four of them declare no licence upstream, which means all rights reserved by their authors. Those are read and cited, never redistributed, and nothing derived from them is published in this namespace. The register is LICENSES.md.

The catalogue lives on GitHubgithub.com/minaiml: laptop engines, MoE streaming, phone and edge runtimes, browser targets, cluster inference, on-device speech and adaptation. Every fork carries a FORK.json recording upstream, the commit we pinned, the date and the licence — including the four that declare no licence upstream and are therefore never redistributed.

The models are at PYTHAI, licence-pinned at a commit: Qwen3.8 · GLM-5.3-Flash · Kimi K3 · Granite 4.2. Delivery software here, weights there.

Elsewhere: pythai.net · mindx.pythai.net · mindX, live. Built by Professor Codephreak.

Intelligence doesn't require a data center. It requires knowing which parameters are awake.