Moraine v0.5 adds QuarkStar support to the BC-250 LLM server distro
Moraine v0.5, a headless Alpine Linux distro for the AMD BC-250, updates its base packages and adds initial QuarkStar support.
Moraine v0.5 is out. It is a minimal Linux distro built on Alpine Linux that turns an AMD BC-250 into a headless server for AI models. The BC-250 is an ex-mining board with a cut-down PS5 APU and 16 GB of fast shared memory. You flash Moraine to a USB stick, boot, and the board answers questions over an OpenAI-compatible API.
This release updates the packages for llama.cpp, Alpine and the base system, and tweaks the TUI and web UI. The main addition is initial support for QuarkStar, a small C engine that runs two Qwen models, Qwen3.6-35B-A3B and Qwen3.8-27B. The README states its author gets around 90 tokens/s on the 35B model at short context on a 40 CU board. Support is early and experimental, so expect rough edges.
To try it, write the image to a USB stick, boot the board, then pick a model and a profile. QuarkStar is chosen per profile. The release notes do not specify memory requirements beyond the two listed models.