Breadway/breadsearch
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

breadmill 0.2.4: bind socket before loading the embedding model
All checks were successful
Mirror to GitHub / mirror (push) Successful in 41s
Details
release / build (push) Successful in 2m8s
Details

Browse source 
The model load ran synchronously on the main thread before serve::run()
bound the daemon's socket. A slow or stuck EP compile (OpenVINO in
particular) meant the socket didn't exist for as long as that took, so
every client -- including the breadsearch GUI -- saw a bare connection
refused with no way to tell "still loading" from "actually broken."

The load now happens on a background thread; the socket binds
immediately, and serve.rs's existing model_ready check answers
"model not ready" for any request that arrives before the load finishes.
This commit is contained in:
Breadway 2026-07-05 09:13:54 +08:00
parent c6ed6a41d8
commit 3d83bd747e
3 changed files with 21 additions and 11 deletions
Download patch file Download diff file Expand all files Collapse all files

2
Cargo.lock generated
View file

@ -133,7 +133,7 @@ dependencies = [
[[package]]
name = "breadmill"
version = "0.2.3"
version = "0.2.4"
dependencies = [
"breadsearch-shared",
"hex",