bos-settings: expose npu/rocm/cuda in breadsearch compute backend dropdown
All checks were successful
Mirror to GitHub / mirror (push) Successful in 3s

breadsearch v0.2.1+ ships breadmill built with --features full (npu + rocm
+ cuda in one binary via ort's load-dynamic/dlopen mode), so the earlier
CPU-only restriction here no longer applies. Hint explains what each
backend needs and how to confirm it actually took effect, since a failed
GPU EP registration falls back to CPU silently at the ONNX Runtime level.
This commit is contained in:
Breadway 2026-07-03 22:38:59 +08:00
parent 9119d99ba9
commit 41e7aaf9fc

View file

@ -34,22 +34,27 @@ pub fn build() -> GBox {
)); ));
c.append(&w::section("Model")); c.append(&w::section("Model"));
// breadmill supports npu/rocm backends in its own codebase, but the // breadsearch v0.2.1+ publishes breadmill built with --features full
// prebuilt binary bakery actually ships is CPU-only (no --features // (npu + rocm + cuda all in one binary, ort load-dynamic/dlopen — no
// npu/rocm in its release build) — offering them here would just be a // separate build needed per backend). Selecting a GPU/NPU backend here
// dropdown option that silently falls back to cpu. Re-add once a build // only takes effect if the matching ONNX Runtime is actually present on
// with those features is published. // this machine; breadmill logs which EP really registered at startup.
c.append(&w::dropdown_row( c.append(&w::dropdown_row(
"Compute backend", "Compute backend",
&doc, &doc,
&["model", "backend"], &["model", "backend"],
&["cpu"], &["cpu", "npu", "rocm", "cuda"],
"cpu", "cpu",
)); ));
c.append(&w::hint( c.append(&w::hint(
"The bakery-published breadmill is CPU-only for now. NPU (AMD Ryzen \ "npu = AMD Ryzen AI (XDNA), rocm = AMD GPU (via MIGraphX), cuda = \
AI) and ROCm backends exist in breadmill's own code but need a \ NVIDIA GPU. Each needs the matching ONNX Runtime installed and \
separately-built binary with those features enabled.", visible to breadmill (system package, or ORT_DYLIB_PATH) check \
`journalctl --user -u breadmill` after restarting for a \
\"Successfully registered\" line confirming it actually took. \
ROCm additionally needs ORT_MIGRAPHX_MODEL_CACHE_PATH set (bakery's \
breadmill.service sets this by default) or the first query after \
each backend/model change costs a one-time ~1-2 minute GPU compile.",
)); ));
c.append(&w::section("Index")); c.append(&w::section("Index"));