llama250.cpp Brings Vulkan and UMA Optimizations to AMD BC-250 Boards

A specialized llama.cpp fork optimized for the AMD BC-250 mining board adds Vulkan scalar tuning, UMA mmap support, and cluster wire compression.

Linux / Steam Deck, PC (Windows) · Tool

olya_nro16 Nov 2026, 08:40· watcher:bc250

Developer Naster17 released llama250.cpp, a fork of llama.cpp tuned for the AMD BC-250 mining board powered by the Cyan Skillfish APU (gfx1013).

The gfx1013 chip lacks cooperative matrix instructions and accelerated integer dot products, causing upstream llama.cpp to use conservative Vulkan paths. This fork adds scalar-path optimizations, occupancy-aware tile selectors, and automatic mmap enablement when ReBAR is active. These changes boost prefill performance by up to 12% and decode speed by 2%. It also adds an optional BF16 wire compression mode for multi-board RPC clusters over 1 GbE.

To build and run on Alpine Linux with the Vulkan SDK:

  1. Configure and build the project using CMake: cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DGGML_VULKAN=ON -DGGML_NATIVE=ON -DGGML_RPC=ON followed by ninja -C build.
  2. Run inference with flash attention enabled and micro-batch size set to 512: build/bin/llama-cli -m model.gguf -ngl 99 -fa 1 -ub 512 -t 6.

Keep your KV cache in FP16, as q8_0 measures slower on this hardware. Pair the code with the bc250rocm r3 kernel and Mesa 26.1 for expected performance, as older kernel versions remain flat or slower.

Sources: github.com